Lead Large Scale Data Processing Specialist

About Careem

Our organization is dedicated to simplifying and improving the lives of people in the region. We achieve this goal by creating a platform for various services, including transportation, food delivery, grocery shopping, and payment management.

Our Journey So Far

We have been operating since 2012 and have successfully created earnings for over 2.5 million Captains, simplified the lives of over 70 million customers, and built a robust platform for entrepreneurs to scale their businesses. Our presence spans over 70 cities across 10 countries, from Morocco to Pakistan.

Job Description: Data Engineer

We are seeking an experienced Senior Data Warehouse Engineer I to join our team. This critical role will be responsible for designing, developing, and maintaining our data infrastructure to ensure its availability, scalability, and reliability. The selected candidate will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to support data-driven decision-making and enable efficient large-scale data processing.

Your Key Responsibilities:

• Design and Develop Robust Data Pipelines: Design and develop high-performance data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake.
• Collaborate with Stakeholders: Collaborate with stakeholders to understand their data requirements and design and implement appropriate data models and database schemas to support their needs.
• Optimize Data Pipelines: Optimize data pipelines and ETL processes for performance and efficiency to ensure timely and accurate data delivery to end-users.
• Data Quality and Integrity: Monitor, troubleshoot, and resolve issues related to data quality, data consistency, and data integrity to ensure the reliability and correctness of our data systems.
• Data Governance: Implement and maintain data governance practices and policies to ensure compliance with data privacy and security regulations.
• Collaboration with Data Scientists: Collaborate with data scientists and analysts to provide them with necessary data infrastructure and tools for conducting advanced analytics and deriving insights.
• Stay Up-to-Date: Stay up-to-date with the latest trends and technologies in data engineering and recommend innovative solutions to improve data engineering processes and systems.
• Documentation: Document data engineering processes, data flows, and system architectures to ensure knowledge sharing and maintain an up-to-date repository of technical documentation.
• Cross-Functional Collaboration: Work closely with cross-functional teams, including software engineers and infrastructure teams, to optimize data infrastructure and ensure seamless integration with other systems.

Requirements:

• Education: Bachelor's degree in Computer Science, Engineering, or a related field.
• Experience: At least 6 years of experience as a Data Engineer or in a similar role, working with large-scale data processing and ETL pipelines.
• Programming Skills: Strong programming skills in languages such as Python, Java, or Scala, with experience in data manipulation and processing frameworks like Apache Spark.
• SQL and Database Technologies: Experience with SQL and database technologies (e.g., relational databases, SQL queries, data modeling).
• Big Data Technologies: Proficiency in working with big data technologies such as Hadoop, Hive and knowledge of distributed systems and cloud computing platforms (e.g., AWS, Azure, GCP).
• Data Integration and Workflow Management Tools: Familiarity with data integration and workflow management tools such as Apache Airflow.
• Data Warehousing Concepts: Knowledge of data warehousing concepts and experience with data warehousing solutions is highly desirable.
• Analytical and Problem-Solving Skills: Strong analytical and problem-solving skills, with the ability to analyze complex data-related issues and propose effective solutions.
• Communication and Collaboration Skills: Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
• Attention to Detail: Attention to detail and a strong commitment to delivering high-quality work within established timelines.

What We Offer:

As a full-time colleague, you will have the opportunity to drive impact in the region while learning and growing. You will enjoy flexible work arrangements, access to healthcare benefits, and fitness reimbursements. Additionally, you will be part of a community of inspiring colleagues who share your passion for creating positive change.