Senior Data Engineer for Cloud Infrastructure

2 days ago


Lahore, Punjab, Pakistan Confiz Full time

Confiz is seeking a skilled data engineer to expand and optimize our big data pipelines. You will work closely with Big Data Solution Architects to design, implement, and optimize data ingestion pipelines, ensuring seamless data sharing across various business systems.

Job Description
  1. Design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.
  2. Build ETL/ELT Ingestion pipelines and analytics solutions using cloud and on-premises technologies.
  3. Ensure the design, code, and procedural aspects of solution are production ready, in terms of operational, security and compliance standards.
  4. Participate in day-to-day project and production delivery status meetings, and provide technical support for faster resolution of issues.
Requirements
  • A Bachelor's degree from an accredited college/university or equivalent work experience.
  • 5+ years of experience performing data engineering, warehousing, publishing and visualization throughout the full data lifecycle.
  • At least two (2) years of experience as an Azure Data Engineer, or in a similar role in a technology or IT consulting environment.
  • 3 years of experience in Data profiling, cataloguing and mapping to enable the design and build of technical data flows.
  • 3 years of experience defining ELT/ETL architecture and process design.
  • 2 years of experience performing end-to-end implementation of data warehousing analytics solutions built on MS or Azure platforms.
  • 2 years of experience working with Azure.
  • Experience in creating data pipelines using ETL tools like Airflow, ADF.
  • Experienced in distributing computing technologies like Apache Spark, Databricks.
  • Experienced with stream-processing systems like Spark Streaming, Eventhub.
  • Proficient in one of the object-oriented and functional languages: Python, Java, Scala, etc.
  • Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
  • Experience of using static analysis and code quality tools.
  • Experience in using code version control repositories like Git.
  • Experienced in security best practices including encryption of sensitive data, encryption at rest and encryption in flight.
  • Experience of building CI/CD pipelines & DevOps orchestration tool like Jenkins.
  • Familiarity with Data Lakehouse, Delta Lake, Apache Hudi.


  • Lahore, Punjab, Pakistan Prime System Solutions Full time

    Welcome to Prime System Solutions, where we are dedicated to delivering exceptional data solutions to our clients. We are currently seeking a highly skilled Cloud Data Engineer Lead to join our team.About the Role:The Cloud Data Engineer Lead will be responsible for leading the design and implementation of scalable and reliable data pipelines using Azure...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    Company OverviewArbisoft is a software engineering company based in Lahore, Islamabad, and Karachi. We are looking for an experienced AI Platform/Infrastructure Engineer to join our team.Job DescriptionWe require an engineer with 5+ years of relevant experience in building and deploying solutions with a strong understanding of DevOps culture and...


  • Lahore, Punjab, Pakistan Programmers Force Full time

    Job DescriptionWe are seeking a skilled Cloud Infrastructure Engineer to oversee the development and maintenance of our cloud-based infrastructure. This individual will be responsible for designing, implementing, and managing scalable and secure cloud environments.The ideal candidate will have expertise in cloud computing platforms (AWS, Azure, Google...


  • Lahore, Punjab, Pakistan Algo+ USA Full time

    About Algo+ USAAlgo+ USA is a forward-thinking company that empowers innovation through cutting-edge technology. Our team of experts collaborates to deliver top-notch solutions, and we are seeking a highly skilled Cloud Infrastructure Engineer to join our dynamic group.


  • Lahore, Punjab, Pakistan TecBrix Cloud LLC Full time

    Job DescriptionWe are seeking a highly skilled Cloud DevOps Engineer to join our team at TecBrix Cloud LLC.The ideal candidate will have a strong understanding of cloud computing concepts, automation technologies, and configuration management tools.Responsibilities include designing and implementing DevOps solutions on AWS, working with development, QA, and...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    NorthBay Solutions is a cutting-edge technology company seeking a highly skilled Senior DevOps Engineer proficient in AWS and Terraform. As a key member of our infrastructure team, you will be responsible for designing and implementing scalable, reliable, and secure cloud infrastructure solutions using Terraform on the AWS platform.Key responsibilities...


  • Lahore, Punjab, Pakistan Origen Full time

    Job TitleDevOps SpecialistCompany OverviewOrigen is a leading technology company that seeks a skilled DevOps Engineer to join our team.We are committed to delivering high-quality solutions and strive for excellence in everything we do.Job SummaryThis is a unique opportunity for an experienced DevOps Engineer to leverage their expertise in streamlining...


  • Lahore, Punjab, Pakistan HR Force Int Full time

    Job DescriptionOverviewAt HR Force Int, we are seeking an experienced Cloud Infrastructure Architect to lead our team in designing and implementing cutting-edge cloud infrastructure solutions. As a key member of our IT department, you will be responsible for developing and maintaining our cloud-based infrastructure, ensuring high levels of scalability,...


  • Lahore, Punjab, Pakistan Avanceon MEA Full time

    Job DescriptionAvanceon Middle East & South Asia is seeking a seasoned Azure DevOps Engineer to drive the design, deployment, and management of our cloud infrastructure. This is an exciting opportunity to shape scalable, secure, and high-performance cloud solutions in a collaborative environment.Main Responsibilities:Design and implement Azure cloud...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    Job OverviewTkxel LLC is a leading software development company located in Virginia, committed to developing innovative software solutions for top enterprises worldwide. We are seeking an experienced Senior Data Engineer to design, develop, and deploy data solutions that power business insights.Responsibilities:Develop and maintain large-scale data pipelines...


  • Lahore, Punjab, Pakistan Bilytica Full time

    Bilytica is looking for a highly motivated Cloud Infrastructure Manager to lead our cloud infrastructure strategy. This individual will be responsible for designing, implementing, and maintaining scalable and secure cloud environments.ResponsibilitiesCloud Infrastructure Strategy: Develop and implement a cloud-first strategy that aligns with business...


  • Lahore, Punjab, Pakistan Prime System Solutions Full time

    Job DescriptionWe are seeking a skilled DevOps Engineer to join our Network Operations Team at Prime System Solutions. The ideal candidate will have a strong background in DevOps, system administration, and network infrastructure.This role plays a critical part in ensuring the stability, security, and scalability of our infrastructure to support our growing...


  • Lahore, Punjab, Pakistan CreditNinja - KMD Partners, LLC Full time

    Job Overview:CreditNinja - KMD Partners, LLC is seeking a highly skilled Senior AI Engineer to lead the development of efficient, scalable, and reliable deployment of AI models and applications.Key Responsibilities:Design and develop advanced AI systems using Python programming language.Collaborate closely with DevOps teams to automate deployment processes...

  • AI Platform Engineer

    4 hours ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    About UsArbisoft is a software engineering company based in Pakistan. We deliver cutting-edge solutions to our clients across various industries.Job DescriptionWe are looking for an experienced AI Platform/Infrastructure Engineer to join our team. The ideal candidate will have 5+ years of relevant experience in building and deploying solutions with a strong...

  • DevOps Engineer

    4 hours ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering at ArbisoftWe are a software engineering company that delivers cutting-edge solutions to our clients. As an AI Platform/Infrastructure Engineer, you will play a crucial role in building and deploying cloud-based solutions.Key ResponsibilitiesYour key responsibilities will include:Designing, building, and deploying cloud-based solutions...


  • Lahore, Punjab, Pakistan Systems Limited Full time

    About the Company:Systems Limited is a technology-driven company that helps businesses thrive in the digital world. We are seeking an experienced Cloud Solutions Architect to join our team and contribute to the design and delivery of cutting-edge cloud solutions using Google Cloud Platform (GCP).The successful candidate will have a solid understanding of...


  • Lahore, Punjab, Pakistan TecBrix Cloud LLC Full time

    About the TeamTecBrix Cloud LLC is seeking a skilled Infrastructure as Code Professional to join our team.This role involves designing and implementing DevOps solutions on AWS, ensuring seamless collaboration between development, QA, and operations teams.Key responsibilities include automating the build, test, and deploy process, deciding on and putting into...


  • Lahore, Punjab, Pakistan Jerrax Full time

    Jerrax is looking for an Infrastructure and Deployments Engineer to join its Engineering team. The ideal candidate will have a solid background in cloud technologies, automation, and CI/CD practices.About the RoleConfigure and maintain cloud infrastructure (AWS, GCP, Azure).Automate infrastructure provisioning, CI/CD pipelines, and deployment...

  • Cloud Data Architect

    18 hours ago


    Lahore, Punjab, Pakistan tkxel Full time

    Data Engineer Job Summary:We are seeking a Cloud Data Architect to join our team at tkxel. As a key member of our team, you will design, develop, and maintain scalable data pipelines using PySpark and Azure Data Factory. You will also transform and integrate large datasets from multiple sources to support analytical and business intelligence requirements.Key...


  • Lahore, Punjab, Pakistan Consforc LLC. Full time

    About Consforc LLC.We are seeking a highly skilled DevOps Engineer to join our team. The ideal candidate will work on building and integrating platforms using Amazon Web Services (AWS), containers, and serverless applications while ensuring system reliability, security, and performance.Job SummaryThe role involves designing, developing, and maintaining...