Data Engineer

2 days ago

Islamabad, Islamabad, Pakistan NorthBay Solutions LLC Full time
Job Title: Data Engineer

Location:Karachi, Lahore , Islamabad (Hybrid)
Experience:5+ Years
Job Type: Full-Time

Job Overview:

We are looking for a highly skilled and experienced Data Engineer with a strong foundation in Big Data, distributed computing, and cloud-based data solutions. This role demands a strong understanding of end-to-end Data pipelines, data modeling, and advanced data engineering practices across diverse data sources and environments. You will play a pivotal role in building, deploying, and optimizing data infrastructure and pipelines in a scalable cloud-based architecture.


Key Responsibilities:

  • Design, develop, and maintain large-scale Data pipelines using modern big data technologies and cloud-native tools.

  • Build scalable and efficient distributed data processing systems using Hadoop, Spark, Hive, and Kafka.

  • Work extensively with cloud platforms (preferably AWS) and services like EMR, Glue, Lambda, Athena, S3.

  • Design and implement data integration solutions pulling from multiple sources into a centralized data warehouse or data lake.

  • Develop pipelines using DBT (Data Build Tool) and manage workflows with Apache Airflow or Step Functions.

  • Write clean, maintainable, and efficient code using Python, PySpark, or Scala for data transformation and processing.

  • Build and manage relational and columnar data stores such as PostgreSQL, MySQL, Redshift, Snowflake, HBase, ClickHouse.

  • Implement CI/CD pipelines using Docker, Jenkins, and other DevOps tools.

  • Collaborate with data scientists, analysts, and other engineering teams to deploy data models into production.

  • Drive data quality, integrity, and consistency across systems.

  • Participate in Agile/Scrum ceremonies and utilize JIRA for task management.

  • Provide mentorship and technical guidance to junior team members.

  • Contribute to continuous improvement by making recommendations to enhance data engineering processes and architecture.


Required Skills & Experience:

  • 5+ years of hands-on experience as a Data Engineer

  • Deep knowledge of Big Data technologies – Hadoop, Spark, Hive, Kafka.

  • Expertise in Python, PySpark and/or Scala.

  • Proficient with data modeling, SQL scripting, and working with large-scale datasets.

  • Experience with distributed storage like HDFS and cloud storage (e.g., AWS S3).

  • Hands-on with data orchestration tools like Apache Airflow or StepFunction.

  • Experience working in AWS environments with services such as EMR, Glue, Lambda, Athena.

  • Familiarity with data warehousing concepts and experience with tools like Redshift, Snowflake (preferred).

  • Exposure to tools like Informatica, AbInitio, Apache Iceberg is a plus.

  • Knowledge of Docker, Jenkins, and other CI/CD tools.

  • Strong problem-solving skills, initiative, and a continuous learning mindset.


Preferred Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.

  • Experience with open table formats such as Apache Iceberg.

  • Hands-on with AbInitio (GDE, Collect > IT) or Informatica tools.

  • Knowledge of Agile methodology, working experience in JIRA.


Soft Skills:

  • Self-driven, proactive, and a strong team player.

  • Excellent communication and interpersonal skills.

  • Passion for data and technology innovation.

  • Ability to work independently and manage multiple priorities in a fast-paced environment.

#J-18808-Ljbffr

  • Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan LMK Resources Ltd. Full time

    Job Summary:The Data Engineer will design, build, and maintain data pipelines and data models to support analytics and reporting needs.Responsibilities:Design, build, and maintain robust and efficient data pipelines using SQL and Oracle Data Integrator.Develop data models to support analytics, reporting, and machine learning use cases.Ensure data pipelines...

  • Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Leed | Pakistan Full time

    Direct message the job poster from Leed | PakistanCertified Human Resources Professional -CHRPCompany Description:Leed Pakistan is a software development company established in 2020, headquartered in Canada, with development offices in Germany and Pakistan. Despite our rapid growth to 50+ professionals, we prioritize quality and customer care. We work with...

  • Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan AXIAN Group Full time

    Job Title: Data Engineer (AWS + MLOps)Department: Data & PredictionReports to: Head of Data & PredictionType: Full-timeAbout Axian OIFDo you thrive in complex, dynamic environments where data-driven decisions drive significant financial and social impact? Are you passionate about mobile money's potential to revolutionize financial inclusion across Africa? If...

  • Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About us: VisionX works with world-leading brands, Fortune 1000 as their innovation partner, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and by creating Intellectual Property.VisionX has been listed in the Top 10 Most Innovative Companies of 2020 by Fast Company – ranked alongside...

  • Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Nisum Full time

    Get AI-powered advice on this job and more exclusive features.Job DescriptionNisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric mottoJob...

  • Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Nisum Full time

    Job DescriptionNisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto "Building Success Together," Nisum has grown to over 1,800 professionals...

  • Lead Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Stixor Full time

    3 days ago Be among the first 25 applicantsExperience: 4+ years of experienceAbout the RoleThe Lead Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architecture. You'll lead a team of engineers and work with cross-functional stakeholders to ensure data reliability, scalability, and availability. You will...

  • Strategic Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeData Full time 1,200,000 - 1,500,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team.Design and develop complex data pipelines using Big Data and cloud-native technologies.Leverage tools such as Ab Initio, Informatica, DBT, and Apache Spark to build scalable data workflows.Implement distributed data processing using Hadoop, Hive, Kafka, and Spark.Build...

  • Senior Data Engineer

    4 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time

    About Our MissionWe strive to create a better world by connecting people who don't speak the local language with medical professionals and other essential services.Our goal is to empower individuals in need through technology. We do this by arranging translators and interpreters for patients, crime victims, and others who require assistance navigating their...

  • Mid Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About us:VisionX works with world-leading brands, Fortune 1000 as their innovation partner, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and by creating Intellectual Property. VisionX has been listed in the Top 10 Most Innovative Companies of 2020 by Fast Company – ranked alongside...