Python Data Engineer

7 hours ago


Lahore, Punjab, Pakistan Techscale Full time

About The Role

We are seeking a skilled Python Data Engineer (Databricks Specialist) to join our dynamic team. This role will play a key part in designing, developing, and optimizing data pipelines and analytics workflows using Python and Databricks.

Key Responsibilities

  1. Develop, maintain, and optimize ETL/ELT data pipelines using Python and Databricks.
  2. Implement data ingestion and transformation pipelines from various data sources (APIs, databases, etc.).
  3. Optimize data storage and retrieval processes for performance and cost-efficiency.
  4. Write and optimize Spark jobs using PySpark or Scala (if needed).
  5. Manage Databricks clusters, including performance tuning and cost optimization.
  6. Collaborate with data scientists and analysts to prepare data for analysis and machine learning models.
  7. Develop monitoring solutions for data quality, pipeline performance, and system reliability.
  8. Implement data governance, security, and compliance best practices.
  9. Automate deployment and scaling of data infrastructure using CI/CD pipelines.

Skills And Qualifications

  1. Must be a data expert with strong Python programming skills (3+ years) and hands-on experience with Databricks (clusters, jobs, Delta Lake).
  2. Must be proficient in Apache Spark/PySpark, SQL databases (PostgreSQL, Snowflake, BigQuery), and data lake/warehouse concepts.
  3. Experience with RESTful APIs, performance tuning, CI/CD workflows, and cloud platforms (Azure/AWS/GCP) is essential.
  4. Bonus points for Scala, MLflow, Airflow/Prefect, Kafka, and containerization (Docker/Kubernetes).
#J-18808-Ljbffr

  • Lahore, Punjab, Pakistan Data Pilot Full time

    Associate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...


  • Lahore, Punjab, Pakistan Techscale Full time

    Data Engineer OpportunityWe are looking for a talented Data Engineer to join our team at Techscale. As a Data Engineer, you will design, develop, and optimize data pipelines and analytics workflows using Python and Databricks.ResponsibilitiesDesign and implement data ingestion and transformation pipelines from various data sources.Optimize data storage and...


  • Lahore, Punjab, Pakistan Devsinc Full time

    We are looking for an experienced Senior Python Engineer to join our team at Devsinc. As a key member of our development team, you will be responsible for designing, building, and maintaining scalable and secure applications using Python and related technologies.About the RoleThis is a full-time position that requires a deep understanding of software...


  • Lahore, Punjab, Pakistan Devsarch Full time

    Devsarch is a technology-driven software company specializing in AI, automation, backend engineering, and real-time data processing. We work with diverse data sources—ranging from documents, structured databases, APIs, logs, and real-time data streams—to build scalable AI-driven applications. We are looking for a Python Engineer with expertise in...


  • Lahore, Punjab, Pakistan Hoboetech Full time

    Hoboetech is a leading technology company that specializes in providing innovative software solutions to clients around the world. We are seeking a highly skilled Senior Python Developer to join our team.Job OverviewThe successful candidate will have a strong background in Python programming, experience with Django framework, and excellent problem-solving...

  • Big Data Engineer

    1 week ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...


  • Lahore, Punjab, Pakistan Burq Full time

    About BurqBurq is a fast-growing technology company that aims to simplify the delivery process for businesses. We have built a large network of delivery partners and made it easy for companies to integrate our services into their operations.Job OverviewWe are looking for an experienced Data Engineering Specialist to join our team. As a key member of our data...


  • Lahore, Punjab, Pakistan Techscale Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team at Techscale. This role will play a key part in designing, developing, and optimizing data pipelines and analytics workflows using Python and Databricks.Key ResponsibilitiesDevelop, maintain, and optimize ETL/ELT data pipelines using Python and Databricks.Implement data ingestion and...


  • Lahore, Punjab, Pakistan Prime System Solutions Full time

    Job DescriptionAt Prime System Solutions, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines using Azure Data Factory, Data Lake, and other Microsoft tools.The ideal candidate will have 5+ years of experience as a Data...

  • Software Engineer

    7 days ago


    Lahore, Punjab, Pakistan Hoboetech Full time

    Company Overview:About HoboetechHoboetech is a cutting-edge technology firm dedicated to delivering innovative solutions. Our team of experts shares a passion for pushing the boundaries of what's possible with software development.We are committed to fostering a collaborative and dynamic work environment where creativity, experimentation, and learning...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    We are seeking a motivated Data Engineer to join our dynamic team. The ideal candidate has hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure. It's an excellent opportunity for someone passionate...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    At Arbisoft, we are looking for a skilled Data Engineer to design, develop, and maintain scalable data pipelines using Python and SQL.Data Pipeline ResponsibilitiesCreate efficient ETL processes to clean, enrich, and transfer data across systems and cloud environments.Collaborate with data scientists, analysts, and stakeholders to ensure data quality and...

  • Azure Data Engineer

    7 days ago


    Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Azure Data EngineerAVANCEON is hiring an Azure Data Engineer for their Lahore office. You will work with a team to develop user-friendly software from start to finish in a fast-moving and collaborative environment.Must-Have Checklist:Practical Experience With:Azure Data FactoryAzure FunctionsData Lake Gen2 and DatabricksSkills in:Python, SQL, Scala, or...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    Job DetailsNorthBay Solutions LLC is seeking a highly skilled Senior Big Data Engineer to join our team.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop complex ETL jobs and pipelines in...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    About the RoleNorthBay Solutions LLC is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts.This role involves designing and developing large-scale ETL pipelines in AWS-based environments, as well as collaborating with the team to develop cutting-edge Big Data and Cloud technologies.Key Responsibilities:Design and develop complex...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    At Avanceon Limited, we are seeking a highly skilled Data Engineer Specialist to join our team.The ideal candidate will have a strong background in cloud-based data engineering and experience with big data querying. Key responsibilities include designing and developing code, scripts, and data pipelines that leverage structured, semi-structured, and...


  • Lahore, Punjab, Pakistan Confiz Full time

    We are seeking a highly skilled data engineer to expand and optimize our big data pipelines using Azure services.About You:You have a strong understanding of data engineering concepts, including data warehousing, publishing, and visualization.You have experience in designing, prototyping, implementing, and optimizing data ingestion pipelines.You have...

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Data Engineer role at Avanceon Middle East & South Asia.About Us?Avanceon is a multinational corporation which specializes in automation, control systems integration, energy management solutions, and support services. With offices in Dubai, Qatar, Saudi Arabia, and Pakistan, it has established a significant market presence. Over its...

  • Data Engineer

    1 week ago


    Lahore, Punjab, Pakistan Devsinc Full time

    Design, implement, and maintain data pipelines to ensure seamless flow of data from various sources to storage systemsWork with large, complex datasets to ensure high performance, availability, and scalability of data systemsCollaborate with data scientists, analysts, and other engineering teams to deliver insights and business value from structured and...