Data Engineering Lead

6 days ago


Lahore, Punjab, Pakistan Arbisoft Full time

About Us

Arbisoft is a dynamic and innovative company that thrives on delivering cutting-edge solutions. We're seeking a highly motivated Senior Data Engineer to join our team.

Job Description

The ideal candidate will have hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Python and SQL.
  • Implement ETL processes to clean, enrich, and transfer data across systems and cloud environments.
  • Collaborate with data scientists, analysts, and stakeholders to ensure data quality and availability.
  • Integrate AWS services (e.g., S3, Redshift, Glue, Lambda) into data workflows.
  • Optimize database performance and query efficiency.
  • Monitor and resolve data pipeline issues promptly.
  • Ensure data security, integrity, and quality.
  • Document technical processes and procedures.

Required Skills & Experience:

  • Proficiency in Python for data processing and scripting.
  • Strong SQL skills for data extraction, transformation, and manipulation.
  • Experience with ETL processes and working with large datasets.
  • Familiarity with AWS services such as S3, Redshift, Glue, Lambda, or similar cloud platforms.
  • Basic understanding of data warehousing concepts and best practices.
  • Effective communication and collaboration skills.
  • Strong problem-solving mindset and attention to detail.

Preferred Qualifications:

  • Hands-on experience with AWS data services (S3, Redshift, Glue, Lambda).
  • Familiarity with workflow orchestration tools like Apache Airflow.
  • Exposure to data modeling and database design.
  • Knowledge of big data technologies (e.g., Apache Spark, Hadoop).
  • Experience with version control systems like Git.
  • Proficiency in AWS SageMaker for machine learning workflows.
  • Experience working with Jupyter notebooks for data analysis and visualization.

  • Data Architect Lead

    2 weeks ago


    Lahore, Punjab, Pakistan Data Pilot Full time

    Data Pilot is a cutting-edge data product development and consulting services company that empowers businesses to unlock the full potential of their data assets. As an Associate Data Architect, you will play a pivotal role in designing and implementing scalable, efficient data architectures that support advanced data engineering and analytics projects.Key...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Unlocking Business Potential through Cutting-Edge Data Engineering and AnalyticsData Pilot is dedicated to empowering businesses with the data-driven insights they need to drive growth and success. As an Associate Data Architect, you will play a critical role in designing and implementing innovative data architectures that support advanced data engineering...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Empowering Businesses with Real-Time Insights through Advanced Data ArchitecturesData Pilot is committed to helping organizations unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen. As an Associate Data Architect, you will play a crucial role in designing and implementing scalable,...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Data Pilot: Unlocking Business Value through Scalable Data ArchitecturesAt Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're committed to helping businesses adapt and thrive in today's fast-paced environment by transforming raw data into actionable insights at lightning speed. As an Associate Data Architect, you will be instrumental in enabling our clients to make informed decisions based on real-time and batch analytics.About the Role:Data Architecture...


  • Lahore, Punjab, Pakistan Data Wise Full time

    About the Position:Data Wise is looking for an experienced quality assurance engineer lead to join our dynamic team. The ideal candidate will have a solid background in software testing, with expertise in automation and quality engineering.Responsibilities:Collaborate with cross-functional teams to identify testing requirements, risks, and...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Associate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Transforming Data into Business Insights through Innovative SolutionsAs an Associate Data Architect at Data Pilot, you will have the opportunity to work on cutting-edge data engineering and analytics projects that drive business growth and success. Our team is passionate about harnessing the power of data to deliver exceptional results and drive business...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    We're seeking a seasoned professional with a strong background in data engineering and architecture to join our team as an Associate Data Architect. In this role, you will have the opportunity to work on cutting-edge data projects, collaborate with a talented team of engineers and scientists, and drive innovation within the company.About the...

  • Data Engineer Lead

    5 days ago


    Lahore, Punjab, Pakistan Devsinc Full time

    Job OverviewDevsinc is a cutting-edge technology company seeking an experienced Data Engineer to lead the development of our data infrastructure. As a key member of our team, you will be responsible for designing, implementing, and maintaining efficient data pipelines that enable seamless data flow from various sources to storage systems.ResponsibilitiesData...


  • Lahore, Punjab, Pakistan Data Wise Full time

    About the Team:Data Wise is looking for a software quality engineering manager to lead our quality assurance team. The ideal candidate will have a solid background in software testing, with expertise in automation and quality engineering.Responsibilities:Develop and implement automated test frameworks and scripts using Selenium and Playwright.Mentor and...


  • Lahore, Punjab, Pakistan Systems Limited Full time

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our growing team at Systems Limited. The ideal candidate will have expertise in designing, building, and maintaining scalable data pipelines using PySpark for ETL/ELT processing.The selected candidate will work closely with data scientists, analysts, and business teams to understand...

  • Lead Engineer

    6 days ago


    Lahore, Punjab, Pakistan Descon Engineering Limited Full time

    Lead Engineer Descon Engineering Limited, Pakistan Responsibilities:Responsible for monitoring progress and quality of the design work as per project requirements.Monitors and ensures progress and quality of the design work carried out in-house or sub-contracted as per project requirements.Ensures the provision of all necessary inputs for proposal...

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Strategic Systems International Full time

    JOB TITLE: Data EngineerDEPARTMENT: Software DevelopmentREPORTS To: Team Lead / Project ManagerPURPOSE:The Data Engineer will be responsible for supporting data engineering and cloud-related tasks, ensuring efficient data processing and troubleshooting in production environments. This role is ideal for individuals with a strong problem-solving mindset, a...


  • Lahore, Punjab, Pakistan Devsinc Full time

    We are seeking a talented Data Architecture Specialist to join our data engineering team and drive business growth through innovative data solutions. As a key member of our team, you will be responsible for designing, developing, and maintaining cutting-edge data processing systems and data pipelines.About the Role:Design and Develop Data Architectures:...


  • Lahore, Punjab, Pakistan HR POD Careers Full time

    Job Overview:HR POD Careers is looking for a highly experienced Power BI Solutions Architect to lead the design and implementation of data analytics solutions. The ideal candidate will have a strong background in backend engineering and experience with Power BI architecture, data modeling, and DAX.About the Role:Develop and implement data analytics solutions...

  • Data Engineer

    1 week ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Senior Data Engineer:Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache...

  • Data Engineer

    3 weeks ago


    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data...

  • Data Engineer

    4 weeks ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache Airflow to automate,...