Data Engineer

3 days ago

Karachi, Sindh, Pakistan Horizon Tech Full time

We are seeking an experienced Data Engineer to join our team. The Data Engineer will be responsible for extracting, transforming, and loading data from various sources into data lakes and data warehouses using AWS while ensuring the efficiency and alignment of data systems with business goals. The ideal candidate should have strong analytical skills, familiarity with programming languages such as Python, SQL, and experience in building ETL/ELT pipelines.

Must Haves:

  • Bachelors degree in Computer Science or equivalent required.
  • 2+ years of progressive experience in working on AWS services.
  • Previous experience as a data engineer or in a similar role.
  • Technical expertise with data models, data scraping, data cleansing, and segmentation techniques.
  • Knowledge and understanding of Amazon Web Services such as AWS Glue (Crawler, Job, Database, Workflow), AWS S3, AWS App flow, AWS Athena, AWS Lambda, etc.
  • Knowledge and experience in connecting with multiple data sources using different AWS Services or APIs or connection protocols such as ODBC, JDBC, etc.
  • Knowledge and experience of Python and PySpark.
  • Knowledge and experience in SQL and SparkSQL queries.
  • Knowledge of MS Excel and ability to build various views using pivot tables.
  • Great numerical, statistical, and analytical skills.
  • Data engineering certification will be a plus.
  • Interest in and experience with leveraging AI for data engineering is a plus
  • Knowledge and experience on Terraform will be a plus.

Responsibilities:

  • Extract data from multiple sources (Cloud/On-Prem) and ingest it into a data lake (AWS S3) through different AWS Services or APIs or connection protocols such as ODBC, JDBC, etc.
  • Cleanse, transform, and maintain data quality in data lakes and data warehouses.
  • Build and maintain data lakes, data warehouses, and data marts on AWS as per the business requirements.
  • Develop and manage data catalogs.
  • Build data pipelines and workflows to ingest raw data and transform/clean data into data lakes and data warehouses respectively using AWS Glue.
  • Conduct complex data analysis and report on results.
  • Explore and implement methods to enhance data quality, reliability, and governance
  • Evaluate business needs and objectives.
  • Interpret trends and patterns.

Other Details

  • Work Days: Monday-Friday
  • Office location: Off to Shahrah-e-Faisal, PECHS, Karachi
#J-18808-Ljbffr

  • Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

    Job Title: Data EngineerJob Title: Data EngineerLocation: Karachi, Lahore , Islamabad (Hybrid)Experience: 5+ YearsJob Type: Full-TimeJob OverviewWe are looking for a highly skilled and experienced Data Engineer with a strong foundation in Big Data, distributed computing, and cloud-based data solutions. This role demands a strong understanding of end-to-end...

  • Data Engineer

    3 days ago

    Karachi, Sindh, Pakistan HR Ways Full time

    About the job Data Engineer - Karachi, PakistanClient company introduction:The company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to UK-based clients.Job Description:The Data Engineer will play a pivotal role in shaping company's data capabilities, working on projects for UK-based clients....

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Pakistan Single Window (PSW) Full time

    Develop and implement data pipelines that extract, load and transform data from various sources: This includes using ELT tools and technologies to clean, transform, and integrate data from differentsystems using Oracle Data IntegratorDesign and develop data models that store data in a way that is efficient and scalable: This includesusing data modelling...

  • Data Engineer– Palantir

    4 weeks ago

    Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

    3 weeks ago Be among the first 25 applicantsLocation: RemoteExperience: 8+ years in Data Architecture, including 3+ years with Ontology Modeling and Palantir FoundryType: Full timeJob SummaryWe are seeking a highly skilled Data Architect with deep expertise in Ontology modeling and hands-on experience with Palantir Foundry. The ideal candidate will play a...

  • Intermediate Data Enginer

    3 weeks ago

    Karachi, Sindh, Pakistan Autonomous Full time

    Direct message the job poster from AutonomousWe're looking for a data engineer who can transform raw data into clean, reliable insights. If you know why a dimension table belongs in a star schema, can spot a broken DAG before breakfast, and can confidently explain it all on a 9 a.m. PST Zoom call, you might be the one we're looking for.Key...

  • Senior Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan Logiciel Services, Llc Full time

    - Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field Master's preferred .- 3–5 years of experience in data engineering, with proven expertise in governance frameworks, metadata management, and knowledge graph / ontologies .- Demonstrated experience with tools/platforms such as Apache Atlas, Neo4j, Spark, Kafka,...

  • Senior Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan metroConnections, Inc. Full time

    The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.RESPONSIBILITIESDesign and implement scalable data ingestion and...

  • Principal Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Experience Range: Minimum 7+ years experience required in desire technologies.Data Engineering (Mandatory): Strong SQL skills; experience with NoSQL databases; proven ability to design and build robust data pipelines using orchestration tools (e.g., Airflow, cloud-native services); experience with data modeling, ETL/ELT processes; experience handling large...

  • Senior ETL Data Engineer

    4 weeks ago

    Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

    3 weeks ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Job Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with...

  • Senior ETL Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Job Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout the Role:We are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working with large-scale datasets, and leveraging...