Data Engineer

3 weeks ago

Islamabad, Islamabad, Pakistan NorthBay Solutions LLC Full time
Job Title: Data Engineer

Location:Karachi, Lahore , Islamabad (Hybrid)
Experience:5+ Years
Job Type: Full-Time

Job Overview:

We are looking for a highly skilled and experienced Data Engineer with a strong foundation in Big Data, distributed computing, and cloud-based data solutions. This role demands a strong understanding of end-to-end Data pipelines, data modeling, and advanced data engineering practices across diverse data sources and environments. You will play a pivotal role in building, deploying, and optimizing data infrastructure and pipelines in a scalable cloud-based architecture.


Key Responsibilities:

  • Design, develop, and maintain large-scale Data pipelines using modern big data technologies and cloud-native tools.

  • Build scalable and efficient distributed data processing systems using Hadoop, Spark, Hive, and Kafka.

  • Work extensively with cloud platforms (preferably AWS) and services like EMR, Glue, Lambda, Athena, S3.

  • Design and implement data integration solutions pulling from multiple sources into a centralized data warehouse or data lake.

  • Develop pipelines using DBT (Data Build Tool) and manage workflows with Apache Airflow or Step Functions.

  • Write clean, maintainable, and efficient code using Python, PySpark, or Scala for data transformation and processing.

  • Build and manage relational and columnar data stores such as PostgreSQL, MySQL, Redshift, Snowflake, HBase, ClickHouse.

  • Implement CI/CD pipelines using Docker, Jenkins, and other DevOps tools.

  • Collaborate with data scientists, analysts, and other engineering teams to deploy data models into production.

  • Drive data quality, integrity, and consistency across systems.

  • Participate in Agile/Scrum ceremonies and utilize JIRA for task management.

  • Provide mentorship and technical guidance to junior team members.

  • Contribute to continuous improvement by making recommendations to enhance data engineering processes and architecture.


Required Skills & Experience:

  • 5+ years of hands-on experience as a Data Engineer

  • Deep knowledge of Big Data technologies – Hadoop, Spark, Hive, Kafka.

  • Expertise in Python, PySpark and/or Scala.

  • Proficient with data modeling, SQL scripting, and working with large-scale datasets.

  • Experience with distributed storage like HDFS and cloud storage (e.g., AWS S3).

  • Hands-on with data orchestration tools like Apache Airflow or StepFunction.

  • Experience working in AWS environments with services such as EMR, Glue, Lambda, Athena.

  • Familiarity with data warehousing concepts and experience with tools like Redshift, Snowflake (preferred).

  • Exposure to tools like Informatica, AbInitio, Apache Iceberg is a plus.

  • Knowledge of Docker, Jenkins, and other CI/CD tools.

  • Strong problem-solving skills, initiative, and a continuous learning mindset.


Preferred Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.

  • Experience with open table formats such as Apache Iceberg.

  • Hands-on with AbInitio (GDE, Collect > IT) or Informatica tools.

  • Knowledge of Agile methodology, working experience in JIRA.


Soft Skills:

  • Self-driven, proactive, and a strong team player.

  • Excellent communication and interpersonal skills.

  • Passion for data and technology innovation.

  • Ability to work independently and manage multiple priorities in a fast-paced environment.

#J-18808-Ljbffr

  • Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Codeaza Technologies Full time

    Codeaza Technologies is dedicated to helping individuals and businesses showcase their ideas. Whether it's building a website, launching an online store, or selling services, our team of experienced developers can turn your dreams into reality. We are passionate about providing innovative solutions and exceptional customer experiences.Company...

  • Lead Data Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan STARZPLAY Full time

    Join to apply for the Lead Data Engineer role at STARZPLAYJoin to apply for the Lead Data Engineer role at STARZPLAYGet AI-powered advice on this job and more exclusive features.We are looking for a highly skilled Lead or Principal Data Engineer to join and shape the future of our data platform at StarzPlay. This is a high-impact role for someone who thrives...

  • Senior Data Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan beBeeData Full time 15,000,000 - 20,000,000

    Transform your data engineering skills into a leadership role with this challenging opportunity. As a Senior Data Engineer, you will be responsible for designing and implementing scalable data pipelines using modern data engineering tools and best practices.Key Responsibilities:Design and Optimize Data Pipelines: Develop end-to-end data pipelines and...

  • Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan Teradata Full time

    Our CompanyAt Teradata, we believe that people thrive when empowered with better information. That's why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers' customers—to make better, more confident decisions. The...

  • Big Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Adept Tech Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Adept Tech SolutionsGPU whisperer | Teaching silicon to see and thinkType: Full-time (Onsite)Working Hours: 9:00 AM - 5:30 PMExperience Level: 1-2 yearsAbout the RoleWe're seeking a Big Data Engineer to build sophisticated data processing pipelines that combine...

  • Associate Software Engineer- Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Devsinc Full time

    We are looking for a highly motivated Associate Software Engineer – Data Engineering to join our team. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines. In this role, you will work with experienced engineers to develop,...

  • Data Scientist/Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan SwipBox Full time

    Job Summary: We are looking for a skilled Data Engineer/Data Scientist with strong Python programming and analytical skills, who can work across the data pipeline from ingestion and processing to modelling and reporting. The ideal candidate has experience handling large-scale (big) datasets, building predictive models, working with live and runtime data...

  • Data Scientist/ ML Engineer

    1 day ago

    Islamabad, Islamabad, Pakistan LMK Resources Ltd. Full time

    Job Summary:The Data Scientist / ML Engineer will support the development of machine learning models and data pipelines. The role focuses on data analysis, feature engineering, and scalable processing using modern data platforms.Responsibilities:Perform data analysis and build machine learning models using Python, Spark, and PySpark.Develop and maintain...

  • Data Engineer Position Available

    1 day ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 4,000,000 - 8,000,000

    Data Engineering Role:">We are seeking a motivated individual to fill our Data Engineer position.This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines.

  • Principal Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Cloudpso Full time

    Join to apply for the Principal Data Engineer role at CloudpsoJob timings: Mon - Fri 6 PM - 3 AM Pakistan timeJob Location: Islamabad I-9/3 (Onsite)Experience: Over 5 yearsResponsibilities:Able to work on complex data-intensive projects.Good understanding of Python, Spark best practices, and commonly used modules based on work experience, creating...