Big Data Engineer

6 days ago

Islamabad, Islamabad, Pakistan beBee Careers Full time

About this role

We are looking for talented data engineers to join our Data & Analytics team and help design and implement innovative data solutions.

Key Responsibilities

  1. Design and build scalable data architectures and systems using cloud-based services.
  2. Collaborate with cross-functional teams to understand data requirements and develop suitable solutions.
  3. Develop and implement automated ETL processes to extract, transform, and load data from various sources.
  4. Develop real-time data pipelines and applications using serverless and managed AWS services.
  5. Develop scalable ETL pipelines for structured, semi-structured, and unstructured data.
  6. Standardize and cleanse data for AI, Data Science, and Analytics use cases.
  7. Create and optimize databases and data models for efficiency and performance.
  8. Ensure data quality and integrity by performing data validations and implementing quality checks.
  9. Develop and maintain documentation related to data infrastructure and processes.
  10. Troubleshoot and resolve data-related issues.

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 4+ years of experience working with customer-centric data on a big data scale, preferably in a banking, online, or e-commerce context.
  • Hands-on experience building production data pipelines and working with structured, semi-structured, and unstructured data.
  • 3+ years of experience in engineering data solutions within both cloud and hybrid infrastructures, with strong expertise in AWS Cloud.
  • 2+ years of experience with one or more programming languages, especially Python.
  • Experience with data integration/ETL technologies such as Python, Spark/PySpark, Kafka/Kinesis/EMR, Lambda, API Gateway, REST API, AWS Glue, etc.
  • Proficient in database technologies like AWS S3, MongoDB, DynamoDB, AWS Redshift, Glacier, and other SQL and NoSQL databases.
  • Experienced with CI/CD pipelines and tools such as Jenkins, GitLab CI, or Azure DevOps.
  • Experience with modern real-time data pipelines (e.g., serverless framework, Lambda, Kinesis, etc.).

  • Big Data Engineering Expert

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    A Senior Big Data Engineer is required to design and develop complex ETL jobs and pipelines using Big Data technologies. The ideal candidate will have over 4 years of experience in Data Engineering, with expertise in designing and developing large-scale ETL pipelines using tools such as Python, Hadoop, Spark, and Hive.Requirements:Strong software development...

  • Senior Big Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...

  • Sr Big Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan Datamatics Technologies Full time

    Direct message the job poster from Datamatics TechnologiesTalent Acquisition Lead | Global Technical Recruitment | Technical Recruitment | EMEA & MENAJob Summary:We are looking for a highly skilled Big Data Engineer to spearhead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark,...

  • Big Data Architect

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job TitleA Big Data Engineer plays a crucial role in designing, developing, and implementing large-scale data processing systems.

  • Big Data Systems Developer

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job OverviewAs a Big Data Engineer, you will play a key role in designing, developing, and implementing large-scale data processing systems. Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing vast amounts of data.

  • Senior Big Data Engineer

    2 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Big Data ArchitectWe are seeking an experienced Data Architect to join our team of analytics experts. This individual will be responsible for designing and optimizing data and data pipeline architecture, as well as enhancing data flow and collection for cross-functional teams.Main ResponsibilitiesCreate and maintain optimal data pipeline architecture that...

  • Big Data Architect

    3 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Join to apply for the Big Data Architect role at ConfizWe are looking for a savvy Data Architect to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams.ResponsibilitiesCreate and maintain optimal...

  • Senior IT Director

    5 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    As a Sr. Executive IT, you will be responsible for designing and developing ETL pipelines, investigating unusual patterns, and fixing data quality issues. You will also provide operational support and lead data engineering initiatives as a technical lead for big data platform projects.Eligibility Criteria:Bachelor's degree or above in Computer...

  • Big Data Automation Tester

    2 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    We're seeking a skilled Big Data Manual QA professional to join our team.Job DescriptionAs a key member of our QA team, you will be responsible for ensuring the accuracy and reliability of our big data processing systems. Your primary focus will be on testing sprint tickets and providing progress updates on assigned tasks.You will have the opportunity to...

  • Big Data Platform Developer

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Engineer - Scalable Platform DevelopmentThe ideal candidate will have extensive experience with Kafka, Flink, Spark, Python, and Talend, along with expertise in Apache Ranger, Prometheus, and strong SQL skills.Job RequirementsDesign and implement data pipelines, ensuring security and monitoring system performance.Collaborate with cross-functional teams...