Job Title: Data Engineer
Location: Dubai (Onsite)
Experience: 5+ years
Compensation: Best in the market
Job Summary:
We are seeking a skilled Data Engineer to join our team, focusing on data collection, integration, and pipeline development from diverse sources. The ideal candidate will have a strong background in data engineering, with expertise in building scalable data pipelines, ensuring data quality, and working with structured and unstructured datasets.
Key Responsibilities:
Data Pipeline Development:
- Design, develop, and maintain scalable data pipelines to collect and process data from various sources.
- Ensure efficient data flow and transformation across systems.
Data Integration & Management:
- Aggregate and integrate data from multiple systems, ensuring consistency and quality.
- Optimize data storage and retrieval strategies for high-performance analytics.
Collaboration & Quality Assurance:
- Work closely with AI/ML Engineers and domain experts to understand data requirements.
- Implement data validation, cleansing, and standardization procedures to maintain accuracy.
Documentation & Best Practices:
- Maintain comprehensive documentation of data sources, methodologies, and pipeline processes.
- Ensure adherence to data security, privacy regulations, and best practices.
Required Skills & Qualifications:
- 5+ years of proven experience as a Data Engineer.
- Strong proficiency in Python and experience with data engineering libraries, such as:
- Pandas (data manipulation and analysis).
- NumPy (numerical computing).
- SQLAlchemy (database interactions).
- Apache Airflow (workflow automation).
- Beautiful Soup (web scraping).
- Experience with data pipeline and workflow management tools.
- Strong knowledge of SQL and NoSQL databases.
- Familiarity with cloud platforms (AWS, GCP, or Azure) for data processing.
Preferred Skills:
- Experience in big data technologies and distributed processing frameworks.
- Knowledge of machine learning frameworks and data preprocessing for AI models.
- Strong problem-solving skills with attention to detail.
Why Join Us?
✔ Competitive Compensation – Best in the market, based on expertise.
✔ Cutting-Edge Technologies – Work on scalable data solutions in a fast-paced environment.
✔ Global Exposure – Be part of an innovative team in Dubai.
✔ Career Growth – Opportunities to learn, innovate, and lead in the data engineering space.