Cloud Data Engineering Leader

2 days ago


Lahore, Punjab, Pakistan Confiz Full time

We are looking for a seasoned data engineer to join our team at Confiz, where you will be responsible for expanding and optimizing our big data pipelines. Collaborative problem-solving, sophisticated design, and the creation of quality products are essential in this role.

Key Responsibilities
  1. We require a skilled data engineer who can work alongside our Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines, ensuring seamless data sharing across various business systems.
  2. You will build ETL/ELT Ingestion pipelines and analytics solutions using cloud and on-premises technologies.
  3. The successful candidate will ensure that the design, code, and procedural aspects of the solution meet production-ready standards, focusing on operational, security, and compliance requirements.
  4. As part of our team, you will participate in day-to-day project and production delivery status meetings, providing technical support for faster issue resolution.
Requirements
  • A Bachelor's degree from an accredited college/university or equivalent work experience is required.
  • The ideal candidate will have 5+ years of experience performing data engineering, warehousing, publishing, and visualization throughout the full data lifecycle.
  • At least two (2) years of experience as an Azure Data Engineer or in a similar role in a technology or IT consulting environment is necessary.
  • We seek candidates with 3 years of experience in data profiling, cataloguing, and mapping to enable the design and build of technical data flows.
  • Experience defining ELT/ETL architecture and process design is also essential.
  • The successful candidate will have 2 years of experience performing end-to-end implementation of data warehousing analytics solutions built on MS or Azure platforms.
  • A minimum of 2 years of experience working with Azure is required.
  • Candidates should have experience creating data pipelines using ETL tools like Airflow, ADF.
  • Experienced individuals in distributing computing technologies like Apache Spark, Databricks are also preferred.
  • Stream-processing systems like Spark Streaming, Eventhub are also relevant to this role.
  • Proficiency in one of the object-oriented and functional languages: Python, Java, Scala, etc., is necessary.
  • Experience writing effective and maintainable unit and integration tests for ingestion pipelines is required.
  • Using static analysis and code quality tools is also expected.
  • Familiarity with code version control repositories like Git is necessary.
  • Security best practices including encryption of sensitive data, encryption at rest, and encryption in flight are critical.
  • Building CI/CD pipelines & DevOps orchestration tool like Jenkins is also essential.
  • Familiarity with Data Lakehouse, Delta Lake, Apache Hudi is beneficial.


  • Lahore, Punjab, Pakistan Prime System Solutions Full time

    Welcome to Prime System Solutions, where we are dedicated to delivering exceptional data solutions to our clients. We are currently seeking a highly skilled Cloud Data Engineer Lead to join our team.About the Role:The Cloud Data Engineer Lead will be responsible for leading the design and implementation of scalable and reliable data pipelines using Azure...


  • Lahore, Punjab, Pakistan TecBrix Cloud LLC Full time

    Job DescriptionWe are seeking a highly skilled Cloud DevOps Engineer to join our team at TecBrix Cloud LLC.The ideal candidate will have a strong understanding of cloud computing concepts, automation technologies, and configuration management tools.Responsibilities include designing and implementing DevOps solutions on AWS, working with development, QA, and...

  • Cloud Data Architect

    18 hours ago


    Lahore, Punjab, Pakistan tkxel Full time

    Data Engineer Job Summary:We are seeking a Cloud Data Architect to join our team at tkxel. As a key member of our team, you will design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory. You will also transform and integrate large datasets from multiple sources to support analytical and business intelligence requirements.Key...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Azure Data Engineer is a key role at Avanceon Middle East & South Asia. We are looking for an experienced professional to lead the development of data solutions from scratch.The ideal candidate will have hands-on experience with Azure Data Factory, Azure Functions, and Databricks.Responsibilities:Design and implement ETL pipelinesDevelop cloud-based data...


  • Lahore, Punjab, Pakistan HR Force International Full time

    Preferred SkillsExperience with managing hybrid environments across cloud platforms.Advanced knowledge of network security and VPN setups for data centres.Certifications include RHCE, AWS Certified DevOps Engineer, or Kubernetes Certified Administrator (CKA).


  • Lahore, Punjab, Pakistan Luminogics (SMC-Private) Limited Full time

    Luminogics is a leading technology innovation company based in Lahore, driving advancements in Modern Application Development, SAAS, E-Commerce, and Data-Centric Solutions. We are seeking an experienced Machine Learning Engineer Leader to join our team and lead the development of custom large language models (LLMs) tailored to our specific business...


  • Lahore, Punjab, Pakistan UnitFactor Full time

    Job Summary:We are looking for a highly skilled Senior DevOps Engineer Leader to join our team. The successful candidate will be responsible for driving technical excellence, mentoring a team of junior engineers, and ensuring seamless delivery of high-quality software products. This role requires expertise in cloud platforms, software architecture, and agile...


  • Lahore, Punjab, Pakistan Confiz Full time

    Confiz is seeking a skilled data engineer to expand and optimize our big data pipelines. You will work closely with Big Data Solution Architects to design, implement, and optimize data ingestion pipelines, ensuring seamless data sharing across various business systems.Job DescriptionDesign, prototype, implement, and optimize data ingestion pipelines so that...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Job DescriptionAs a Big Data Engineer at Avanceon Middle East & South Asia, you will play a critical role in designing and implementing cloud-based data solutions that drive business growth and innovation. Your expertise in big data processing, cloud computing, and team leadership will enable you to make a significant impact on our organization.Key...

  • DevOps Engineer

    4 hours ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering at ArbisoftWe are a software engineering company that delivers cutting-edge solutions to our clients. As an AI Platform/Infrastructure Engineer, you will play a crucial role in building and deploying cloud-based solutions.Key ResponsibilitiesYour key responsibilities will include:Designing, building, and deploying cloud-based solutions...


  • Lahore, Punjab, Pakistan CreditNinja - KMD Partners, LLC Full time

    Job SummaryWe are seeking a highly experienced and dynamic Vice President of Engineering to lead and inspire our engineering teams. The ideal candidate will bring substantial experience in engineering leadership, strong people management capabilities, and the ability to contribute strategically to our company's growth and success.This role requires a leader...


  • Lahore, Punjab, Pakistan Digifloat Full time

    About DigifloatA Brief OverviewDigifloat is a company that values innovation and data-driven decision making. We are dedicated to providing high-quality data solutions that meet the needs of our clients.In this role, you will work closely with our data analysts and engineers to design and implement data products that drive business outcomes.Job...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Key ResponsibilitiesData Ingestion and Processing: Design and develop scalable data ingestion pipelines and stream processing architectures to handle large volumes of structured, semi-structured, and unstructured data.Cloud Computing Expertise: Leverage your expertise in Azure/AWS to provision and manage cloud-based data storage services, including Hadoop...

  • Cloud Engineer

    4 hours ago


    Lahore, Punjab, Pakistan Pukat Digital Full time

    Job DescriptionWe are seeking a highly skilled Cloud Engineer to join our team at Pukat Digital. The ideal candidate will have experience in designing, implementing, and managing end-to-end automation pipelines for software development, deployment, and machine learning model lifecycle.Key Responsibilities:Design and implement CI/CD pipelines for traditional...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    Arbisoft seeks a skilled Data Engineer to design and maintain scalable data pipelines using Python and SQL. The ideal candidate has hands-on experience with ETL processes, AWS data services, and big data technologies.Key Responsibilities:Create efficient data workflows by integrating AWS services (e.g., S3, Redshift, Glue, Lambda).Collaborate with data...


  • Lahore, Punjab, Pakistan Programmers Force Full time

    Job DescriptionWe are seeking a skilled Cloud Infrastructure Engineer to oversee the development and maintenance of our cloud-based infrastructure. This individual will be responsible for designing, implementing, and managing scalable and secure cloud environments.The ideal candidate will have expertise in cloud computing platforms (AWS, Azure, Google...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    Job OverviewTkxel LLC is a leading software development company located in Virginia, committed to developing innovative software solutions for top enterprises worldwide. We are seeking an experienced Senior Data Engineer to design, develop, and deploy data solutions that power business insights.Responsibilities:Develop and maintain large-scale data pipelines...

  • Cloud Data Architect

    18 hours ago


    Lahore, Punjab, Pakistan Tkxel Full time

    Job DescriptionWe are searching for a skilled Data Engineer with expertise in PySpark and Azure Data Factory to join our team. The ideal candidate will have a strong background in data engineering and a minimum of 5 years of professional experience.The successful candidate will be responsible for designing, developing, and maintaining large-scale data...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    Company OverviewArbisoft is a software engineering company based in Lahore, Islamabad, and Karachi. We are looking for an experienced AI Platform/Infrastructure Engineer to join our team.Job DescriptionWe require an engineer with 5+ years of relevant experience in building and deploying solutions with a strong understanding of DevOps culture and...


  • Lahore, Punjab, Pakistan Techlio PVT Full time

    We are seeking a Cloud Native Engineer to join our team at Techlio PVT. As a senior developer, you will be responsible for designing and developing scalable web applications using cloud-native technologies.Key Responsibilities:Design and develop cloud-native applications using the MERN stack.Collaborate with cross-functional teams to ensure seamless...