
Python Data Engineer
3 weeks ago
About The Role
We are seeking a skilled Python Data Engineer (Databricks Specialist) to join our dynamic team. This role will play a key part in designing, developing, and optimizing data pipelines and analytics workflows using Python and Databricks.
Key Responsibilities
- Develop, maintain, and optimize ETL/ELT data pipelines using Python and Databricks.
- Implement data ingestion and transformation pipelines from various data sources (APIs, databases, etc.).
- Optimize data storage and retrieval processes for performance and cost-efficiency.
- Write and optimize Spark jobs using PySpark or Scala (if needed).
- Manage Databricks clusters, including performance tuning and cost optimization.
- Collaborate with data scientists and analysts to prepare data for analysis and machine learning models.
- Develop monitoring solutions for data quality, pipeline performance, and system reliability.
- Implement data governance, security, and compliance best practices.
- Automate deployment and scaling of data infrastructure using CI/CD pipelines.
Skills And Qualifications
- Must be a data expert with strong Python programming skills (3+ years) and hands-on experience with Databricks (clusters, jobs, Delta Lake).
- Must be proficient in Apache Spark/PySpark, SQL databases (PostgreSQL, Snowflake, BigQuery), and data lake/warehouse concepts.
- Experience with RESTful APIs, performance tuning, CI/CD workflows, and cloud platforms (Azure/AWS/GCP) is essential.
- Bonus points for Scala, MLflow, Airflow/Prefect, Kafka, and containerization (Docker/Kubernetes).
-
Associate Data Architect
4 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeAt Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...
-
Python Data Specialist
2 weeks ago
Lahore, Punjab, Pakistan Agilekode Full timeJob DescriptionIn this role, you will be responsible for designing and implementing Python scripts for web scraping and data mining projects. You will use popular libraries like BeautifulSoup, Scrapy, and Selenium for efficient data extraction. Additionally, you will perform data processing and transformation using tools such as Pandas and NumPy.
-
Python Software Engineer Wanted
1 week ago
Lahore, Punjab, Pakistan Hoboetech Full timeHoboetech is seeking an experienced Python developer to join our team.Job OverviewThe successful candidate will have a solid background in Python programming and be proficient in using the Django framework. They should also have knowledge of machine learning and Google Cloud Platform.Key ResponsibilitiesThe ideal candidate will be responsible for:Writing...
-
Associate Software Engineer- Python
2 weeks ago
Lahore, Punjab, Pakistan Devsinc Full timeWe are seeking a highly motivated Associate Software Engineer – Python to join our development team. This role is ideal for recent graduates or early-career professionals who have a passion for Python programming and software development. As an Associate Software Engineer, you will work alongside experienced developers to design, develop, and maintain...
-
Data Engineer Lead
6 days ago
Lahore, Punjab, Pakistan NorthBay Solutions Full timeWe are looking for an experienced Senior Data Architect to join our team at NorthBay Solutions. As a key member of our data engineering group, you will be responsible for designing and developing cutting-edge big data technologies to build critical, highly complex distributed systems from scratch.About the Role:The Ideal Candidate Will Have: 4 to 6+ years of...
-
Data Engineer
11 hours ago
Lahore, Punjab, Pakistan PRG Pakistan Full timeWe are seeking a skilled Data Engineer with AI/ML expertise to design, build, and optimize scalable data pipelines that power machine learning models and AI-driven applications. You will work closely with data scientists, analysts, and software engineers to ensure efficient data ingestion, transformation, and storage—enabling real-time analytics and AI...
-
Senior Python Engineer
2 weeks ago
Lahore, Punjab, Pakistan The Recourses Full timeAbout The RoleWe are looking for an experienced Senior Python Engineer to join our team. As a Senior Python Engineer, you will be responsible for leading the development of our AI-powered chatbot integration.Key Responsibilities:Lead the development of our AI-powered chatbot integration.Collaborate with designers to ensure seamless integration with Figma...
-
Senior Python Software Engineer
2 weeks ago
Lahore, Punjab, Pakistan Techleadz Full timeWe are Techleadz, a rapidly growing company that's expanding our team. We're looking for an experienced Senior Python Software Engineer to oversee and develop multiple applications.Key Responsibilities:Manage and maintain large-scale Python projects using the Django framework.Design and implement efficient database architectures using ORM libraries.Integrate...
-
Senior Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan Arbisoft Full timeWe are seeking a motivated Data Engineer to join our dynamic team. The ideal candidate has hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure. It's an excellent opportunity for someone passionate...
-
Senior Python Engineer
2 hours ago
Lahore, Punjab, Pakistan beBee Careers Full timeJob Description">The Python Backend Developer role involves developing, maintaining, and optimizing Python scripts for backend processes, data handling, and automation. The ideal candidate will have strong expertise in Flask and FastAPI, with a focus on handling large datasets in SQL databases.">About the Job">This is a great opportunity to work on...
-
Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Crypthon Technologies Full timeWe're looking for a Data Engineer who thrives on building scalable data solutions, designing robust pipelines, and transforming complex data into actionable insights.Responsibilities:Build and maintain data pipelines and architectureCollaborate with teams to define data requirementsOptimize systems for performance and scalabilityWork with big data tools and...
-
Expert Software Engineer
1 week ago
Lahore, Punjab, Pakistan Stone age SIA Full timeStone age SIA is seeking an Expert Software Engineer (Python) to lead our software development efforts. As a key member of our team, you will be responsible for designing, developing, and maintaining high-quality software applications using Python and related technologies.Key Responsibilities:Lead the design, development, and maintenance of software...
-
Data Insights Engineer
6 days ago
Lahore, Punjab, Pakistan Ayraxs Full timeCompany OverviewAyraxs is a cutting-edge technology company that leverages machine learning and artificial intelligence to revolutionize the way we interact with products and services. Our mission is to empower businesses to make data-driven decisions and improve customer experiences through personalized recommendations and predictive analytics.As a Senior...
-
Data Engineer/Infrastructure Engineer
6 days ago
Lahore, Punjab, Pakistan Arbisoft Full timeSoftware Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for an experienced AI Platform / Infrastructure Engineer to join our team. The ideal candidate will have 5+ years of relevant experience (excluding internships, prototypes, or personal projects) in building and deploying solutions with a strong understanding of DevOps culture and...
-
Cloud Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full timeAvanceon Middle East & South Asia is seeking an experienced Cloud Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data storage solutions using cloud-based technologies.Key Responsibilities:Design and develop code, scripts, and data pipelines that leverage structured,...
-
Big Data Engineer
1 week ago
Lahore, Punjab, Pakistan Gtradecenter Full timeInvoZone is a fast-growing company that offers a range of services to clients worldwide. As a Big Data Engineer, you will play a key role in developing innovative business solutions using Apache Spark.ResponsibilitiesDevelop and implement big data solutions using Apache SparkWork with cross-functional teams to identify business needsDesign and implement data...
-
Data Engineering Leader
6 days ago
Lahore, Punjab, Pakistan NorthBay Solutions Full timeAt NorthBay Solutions LLC, we are seeking an experienced Data Engineering Leader to join our team. As a key member of our organization, you will be responsible for designing and developing cutting-edge Big Data technologies to build critical, highly complex distributed systems from scratch.Key Responsibilities:Design and develop using Big Data...
-
Azure Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full timeAzure Data EngineerAVANCEON is hiring an Azure Data Engineer for their Lahore office. You will work with a team to develop user-friendly software from start to finish in a fast-moving and collaborative environment.Must-Have Checklist:Practical Experience With:Azure Data FactoryAzure FunctionsData Lake Gen2 and DatabricksSkills in:Python, SQL, Scala, or...
-
Big Data Engineering Manager
6 days ago
Lahore, Punjab, Pakistan NorthBay Solutions Full timeNorthBay Solutions is seeking an experienced Big Data Engineering Manager to manage our big data engineering efforts. The ideal candidate will have 4 to 6+ years of experience in data engineering with a focus on big data technologies.About the Position:Main Responsibilities: Lead our data engineering efforts, design and develop large-scale ETL pipelines in...
-
Data Engineering Leader
2 weeks ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeWe are seeking an experienced Data Engineering Leader to join our team at NorthBay Solutions LLC. As a Senior Big Data Engineer, you will have the opportunity to design and develop cutting-edge Big Data technologies, build critical distributed systems from scratch, and lead complex ETL jobs and pipelines.About the Role:Design and develop using Big Data...