
Data Engineer
1 week ago
Senior Data Engineer:
Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.
Responsibilities:
- Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.
- Use Apache Airflow to automate, schedule, and monitor complex data workflows, ensuring reliable and timely data processing.
- Leverage Databricks for building and deploying production-grade data pipelines, running data processing jobs, and collaborating on data projects with data scientists and analysts.
- Develop and optimize data pipelines and storage solutions on cloud platforms such as AWS, Azure, or Google Cloud. Experience with S3, Redshift, Azure Data Lake, BigQuery, or similar services is a plus.
- Monitor and optimize the performance of data pipelines, troubleshoot bottlenecks, and apply best practices for efficient data processing and storage.
- Work closely with data scientists, analysts, and business teams to understand data requirements and ensure data infrastructure supports business objectives.
- Implement data validation, quality checks, and error handling mechanisms to ensure high-quality and accurate data for analytics and decision-making.
- Lead junior data engineers, providing technical guidance and mentorship. Promote best practices in data engineering, testing, and automation.
- Maintain clear and comprehensive documentation of data pipelines, architecture, and processes. Provide regular updates on the progress of data engineering tasks.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
- 8+ years of experience in Data Engineering, with a proven track record of designing, implementing, and optimizing data pipelines.
- Expertise in PySpark for large-scale data processing and transformation.
- Extensive experience with Apache Airflow for managing and orchestrating complex data workflows.
- Strong hands-on experience with Databricks, including building notebooks, clusters, and end-to-end pipelines.
- Proficiency in SQL and working knowledge of relational databases (e.g., PostgreSQL, MySQL, Redshift, etc.).
- Cloud platform experience (AWS, Azure, GCP), with proficiency in cloud-based data storage and computing services like S3, BigQuery, Azure Data Lake, or Redshift.
- Knowledge of data warehousing concepts and experience with modern data warehouses (e.g., Snowflake, Redshift, BigQuery).
- Strong experience with ETL/ELT processes and data pipeline orchestration.
- Familiarity with version control systems such as Git.
- Experience working in Agile development teams, following Scrum or Kanban methodologies.
Location: Lahore, Karachi, Islamabad, Multan, and Faisalabad
#J-18808-Ljbffr-
Cloud Data Engineering Expert
1 week ago
Lahore, Punjab, Pakistan Data Pilot Full timeUnlocking Business Potential through Cutting-Edge Data Engineering and AnalyticsData Pilot is dedicated to empowering businesses with the data-driven insights they need to drive growth and success. As an Associate Data Architect, you will play a critical role in designing and implementing innovative data architectures that support advanced data engineering...
-
Big Data Engineer and Architect
1 week ago
Lahore, Punjab, Pakistan Data Pilot Full timeEmpowering Businesses with Real-Time Insights through Advanced Data ArchitecturesData Pilot is committed to helping organizations unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen. As an Associate Data Architect, you will play a crucial role in designing and implementing scalable,...
-
Senior Data Engineering Professional
2 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeAt Data Pilot, we're committed to helping businesses adapt and thrive in today's fast-paced environment by transforming raw data into actionable insights at lightning speed. As an Associate Data Architect, you will be instrumental in enabling our clients to make informed decisions based on real-time and batch analytics.About the Role:Data Architecture...
-
Associate Data Architect
4 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeAssociate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...
-
Data Architect Lead
2 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeData Pilot is a cutting-edge data product development and consulting services company that empowers businesses to unlock the full potential of their data assets. As an Associate Data Architect, you will play a pivotal role in designing and implementing scalable, efficient data architectures that support advanced data engineering and analytics projects.Key...
-
Associate Data Architect
3 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeAt Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...
-
Scalable Data Architecture Specialist
1 week ago
Lahore, Punjab, Pakistan Data Pilot Full timeTransforming Data into Business Insights through Innovative SolutionsAs an Associate Data Architect at Data Pilot, you will have the opportunity to work on cutting-edge data engineering and analytics projects that drive business growth and success. Our team is passionate about harnessing the power of data to deliver exceptional results and drive business...
-
Cloud Data Infrastructure Specialist
2 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeWe're seeking a seasoned professional with a strong background in data engineering and architecture to join our team as an Associate Data Architect. In this role, you will have the opportunity to work on cutting-edge data projects, collaborate with a talented team of engineers and scientists, and drive innovation within the company.About the...
-
Data Architect Innovation Lead
1 week ago
Lahore, Punjab, Pakistan Data Pilot Full timeData Pilot: Unlocking Business Value through Scalable Data ArchitecturesAt Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value...
-
Software Quality Engineering Manager
2 days ago
Lahore, Punjab, Pakistan Data Wise Full timeAbout the Team:Data Wise is looking for a software quality engineering manager to lead our quality assurance team. The ideal candidate will have a solid background in software testing, with expertise in automation and quality engineering.Responsibilities:Develop and implement automated test frameworks and scripts using Selenium and Playwright.Mentor and...
-
Quality Assurance Engineer Lead
2 days ago
Lahore, Punjab, Pakistan Data Wise Full timeAbout the Position:Data Wise is looking for an experienced quality assurance engineer lead to join our dynamic team. The ideal candidate will have a solid background in software testing, with expertise in automation and quality engineering.Responsibilities:Collaborate with cross-functional teams to identify testing requirements, risks, and...
-
Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan Systems Limited Full timeSystems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache Airflow to automate,...
-
Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Strategic Systems International Full timeJOB TITLE: Data EngineerDEPARTMENT: Software DevelopmentREPORTS To: Team Lead / Project ManagerPURPOSE:The Data Engineer will be responsible for supporting data engineering and cloud-related tasks, ensuring efficient data processing and troubleshooting in production environments. This role is ideal for individuals with a strong problem-solving mindset, a...
-
Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan Avanceon Limited Full timeJoin to apply for the Data Engineer role at Avanceon Middle East & South Asia.About Us?Avanceon is a multinational corporation which specializes in automation, control systems integration, energy management solutions, and support services. With offices in Dubai, Qatar, Saudi Arabia, and Pakistan, it has established a significant market presence. Over its...
-
Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Tkxel Full timeTkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data...
-
QA Engineer
2 days ago
Lahore, Punjab, Pakistan Data Wise Full timeJob Description:We are seeking a highly skilled test and quality assurance engineer to join our dynamic team. The ideal candidate will possess extensive experience in software testing and development. The QA testing engineer will play a crucial role in enhancing our software quality and performance by applying advanced testing strategies and will collaborate...
-
Data Engineer
5 days ago
Lahore, Punjab, Pakistan Prime System Solutions Full timeEducation Requirements, Skills, and KnowledgeGood problem solving and decision-making skills; ability to understand and analyze complex issuesSelf-motivated, detail orientated, highly organized and able to handle a variety of tasks and responsibilities in an efficient manner with a high level of qualityExceptional analytical and conceptual thinking...
-
Advanced Analytics Solutions Expert
2 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeData Pilot is a leader in data product development and consulting services, empowering businesses to unlock the full potential of their data assets. As an Associate Data Architect, you will be part of a dynamic team that designs and implements scalable, efficient data architectures to support advanced data engineering and analytics projects.About the...
-
Data Engineer
3 weeks ago
Lahore, Punjab, Pakistan Digifloat Full timeJob descriptionDigifloat is looking for a passionate, motivated, eager to learn data enthusiast.Responsibilities:Turn raw data into trustworthy analytical datasets, that decrease time to market towards insights and reduce the cost of data consumption.Manage these datasets (and the related data pipelines) as a product with all the responsibilities that come...
-
Senior Data Engineer
6 days ago
Lahore, Punjab, Pakistan Devsinc Full timeDevsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...