Azure Big Data Solutions Engineer

5 days ago


Lahore, Punjab, Pakistan Confiz Full time

Big Data Engineer Role

As a data engineer at Confiz, you will play a crucial role in designing and implementing big data pipelines that enable seamless data sharing across our systems.

Key Responsibilities:

  • Collaborate with solution architects to ensure data pipeline effectiveness.
  • Develop ETL/ELT ingestion pipelines using cloud and on-premises technologies.
  • Ensure production readiness of solution design, code, and procedural aspects.
  • Provide technical support for prompt issue resolution.

Requirements:

  • Bachelor's degree from an accredited institution or equivalent work experience.
  • 5+ years of experience in data engineering, warehousing, publishing, and visualization.
  • At least two years of experience as an Azure Data Engineer or in a similar technology consulting environment.
  • 3 years of experience in data profiling, cataloguing, and mapping for technical data flows.
  • 3 years of experience defining ELT/ETL architecture and process design.
  • 2 years of experience implementing end-to-end data warehousing analytics solutions on MS or Azure platforms.
  • 2 years of experience working with Azure services.
  • Experience in creating data pipelines with ETL tools like Airflow and ADF.
  • Familiarity with distributed computing technologies like Apache Spark and Databricks.
  • Proficient in object-oriented and functional programming languages.
  • Experience in writing unit and integration tests for ingestion pipelines.
  • Knowledge of static analysis and code quality tools.
  • Experience in using Git version control repositories.
  • Experienced in security best practices including data encryption at rest and in flight.
  • Experience in building CI/CD pipelines with DevOps orchestration tools like Jenkins.
  • Familiarity with Data Lakehouse, Delta Lake, and Apache Hudi technologies.


  • Lahore, Punjab, Pakistan Big Data Inc Full time

    Overview:Big Data Inc is a cutting-edge technology company that offers innovative solutions for big data processing and analysis. We are currently seeking an experienced Full Stack Java Developer to join our team in Lahore, Pakistan.About the Role:The incumbent will be responsible for designing, testing, and implementing large-scale enterprise applications...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Empowering Businesses with Real-Time Insights through Advanced Data ArchitecturesData Pilot is committed to helping organizations unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen. As an Associate Data Architect, you will play a crucial role in designing and implementing scalable,...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    NorthBay Solutions LLC is hiring a skilled Cloud Architect for Big Data Solutions. As a Senior Big Data Engineer, you will be responsible for designing and developing cloud-based Big Data solutions using AWS services such as EMR, Glue, Lambda, and Athena.About the Role:Design and develop cloud-based Big Data solutions using AWS services.Develop and manage...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are seeking an experienced Big Data Engineering Expert to join our team at NorthBay Solutions LLC. As a Senior Big Data Engineer, you will have the opportunity to design and develop cutting-edge Big Data technologies, build critical distributed systems from scratch, and lead complex ETL jobs and pipelines.About the Role:Design and develop using Big Data...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel LLC is committed to developing innovative software solutions for leading enterprises worldwide. As a forward-thinking organization, we seek a seasoned data architect to drive the success of our enterprise data platform.Key Responsibilities:Leverage your expertise in big data and cloud solutions on AWS and Azure to design and implement scalable, secure,...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    About the JobWe are looking for a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions. The ideal candidate will have extensive experience working with big data technologies and a passion for innovation.In this role, you will be responsible for designing and developing complex big data solutions using a variety of technologies,...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and...


  • Lahore, Punjab, Pakistan Systems Limited Full time

    Senior Data Architect Position:Sytems Limited is looking for an experienced senior data architect with expertise in Azure data services, ETL pipelines, big data processing, and data governance. The ideal candidate will have a strong understanding of the telecom industry and experience working with large datasets.Responsibilities:Design and implement data...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    **About the Role:**We are seeking a highly skilled Senior Big Data Engineer to join our team at Avanceon Middle East & South Asia. As a Senior Big Data Engineer, you will be responsible for developing and implementing big data solutions using cloud-based technologies.Responsibilities:Big Data Solutions: Develop and implement big data solutions using...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    About Avanceon LimitedAvanceon Limited is a leading provider of innovative technology solutions.Job Description:Senior Big Data Engineer Role SummaryWe are seeking an experienced Senior Big Data Engineer to join our team in the Middle East & South Asia region. As a key member of our data engineering team, you will be responsible for designing, developing,...


  • Lahore, Punjab, Pakistan Confiz Full time

    We are looking for an experienced data engineer responsible for expanding and optimizing our big data pipelines. You will be working alongside other engineers and developers working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products is...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Avanceon Middle East & South Asia is seeking an experienced Big Data Implementation Specialist to join our team. In this role, you will be responsible for designing and implementing big data solutions using cloud-based technologies.Key Responsibilities:Implement big data solutions using cloud-based technologies such as Azure Data FactoryManage data ingestion...

  • Big Data Engineer

    3 days ago


    Lahore, Punjab, Pakistan Gtradecenter Full time

    InvoZone is a fast-growing company that offers a range of services to clients worldwide. As a Big Data Engineer, you will play a key role in developing innovative business solutions using Apache Spark.ResponsibilitiesDevelop and implement big data solutions using Apache SparkWork with cross-functional teams to identify business needsDesign and implement data...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are seeking an experienced Senior Big Data Engineer to join our team at NorthBay Solutions. In this role, you will be responsible for designing and developing complex big data solutions using a variety of technologies, including Hadoop, Spark, and NoSQL databases.Your primary responsibilities will include:Designing and developing ETL jobs and pipelines...

  • Big Data Specialist

    7 days ago


    Lahore, Punjab, Pakistan Devsinc Full time

    About the RoleThe successful candidate will have proven experience (3+ years) as a Data Engineer or similar role in data management, processing, and analytics. They will possess experience with data modeling, ETL frameworks, and big data tools like Apache Hadoop, Spark, Kafka, etc.They will also demonstrate proficiency in programming languages such as...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan Tkxel Full time

    We are looking for an experienced Data Engineer to join our team at Tkxel. As a key member of our data engineering team, you will design, develop, and optimize our client data infrastructure using cloud-based technologies like Azure and AWS.The ideal candidate will have 5+ years of experience as a Data Engineer, with strong expertise in cloud-based data...

  • Big Data Engineer

    3 weeks ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...