Senior Data Engineer/Ben

2 weeks ago


Lahore, Punjab, Pakistan Tkxel Full time
Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job Description

This is a remote position.

  • Data Pipeline Development: Builds understanding of the data needs of the client and designs, constructs, installs, tests, and maintains highly scalable data management systems using Microsoft Fabric suite (Azure Data Factory, Azure Synapse Analytics, etc.) and other relevant technologies that can efficiently and effectively meet those needs.
  • Perform data availability assessment and implement robust processes to ensure the timely identification, collection, and validation of relevant data sets required for the client.
  • ETL Processes: Develops ETL processes to extract data from various sources, transform the data according to business rules, and load it into a centralized data repository, ensuring data accuracy and availability.
  • Data Lake: Implements and manages data storage solutions using Azure OneLake and ensures optimal data storage architecture for ease of access and analysis.
  • Data Integration: Integrates data from various business systems into a unified data platform, enabling a consolidated view of information across the organization.
  • Data Quality and Governance: Ensures data accuracy and quality by implementing data governance and quality control measures, including data validation and cleansing.
  • Performance Optimisation: Monitors, tunes, and reports on the performance of data pipelines and databases to ensure they meet the functional and performance requirements.
  • Security and Compliance: Implements security measures to protect data integrity and compliance with data protection regulations and company policies.
Requirements

Skills:

  • Azure Data Lake or Apache Delta Lake.
  • Apache Spark or Databricks.
  • Knowledge of implementing Apache Spark using pyspark.
#J-18808-Ljbffr

  • Lahore, Punjab, Pakistan Data Pilot Full time

    Associate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...


  • Lahore, Punjab, Pakistan kisaangroup Full time

    Expert Talent Sourcer | Building Strong Candidate Relationships | Data-Driven Recruitment Strategies | Emotional IntelligenceWaseela is a catalyst for change, empowering rural communities to drive Pakistan's economy forward. Through data-driven, research-backed projects, we address critical challenges in our rural economy and unlock opportunities for...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    About the RoleNorthBay Solutions LLC is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts.This role involves designing and developing large-scale ETL pipelines in AWS-based environments, as well as collaborating with the team to develop cutting-edge Big Data and Cloud technologies.Key Responsibilities:Design and develop complex...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache Airflow to automate,...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    About UsTkxel LLC is a renowned software development company located in Reston, Virginia. We specialize in delivering cutting-edge software solutions that cater to the diverse needs of leading enterprises worldwide.Job SummaryWe are seeking an accomplished Senior Data Engineer to join our talented team. As a critical component of our data infrastructure...

  • Senior Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking an experienced Data Engineer to design, develop, and optimize our client data...

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Data Engineer role at Avanceon Middle East & South Asia.About Us?Avanceon is a multinational corporation which specializes in automation, control systems integration, energy management solutions, and support services. With offices in Dubai, Qatar, Saudi Arabia, and Pakistan, it has established a significant market presence. Over its...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    About the JobWe are looking for a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions. The ideal candidate will have extensive experience working with big data technologies and a passion for innovation.In this role, you will be responsible for designing and developing complex big data solutions using a variety of technologies,...

  • Data Engineer

    6 days ago


    Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Company OverviewAvanceon Middle East & South Asia is a leading provider of technology solutions, committed to delivering exceptional services to our clients. Our team of experts works tirelessly to stay ahead of the curve in the ever-evolving world of data storage and processing.Job DescriptionAs a Senior Big Data Engineer at Avanceon Middle East & South...

  • Data Engineer

    1 week ago


    Lahore, Punjab, Pakistan Devsinc Full time

    Design, implement, and maintain data pipelines to ensure seamless flow of data from various sources to storage systemsWork with large, complex datasets to ensure high performance, availability, and scalability of data systemsCollaborate with data scientists, analysts, and other engineering teams to deliver insights and business value from structured and...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    We are seeking a motivated Data Engineer to join our dynamic team. The ideal candidate has hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure. It's an excellent opportunity for someone passionate...


  • Lahore, Punjab, Pakistan Tkxel Full time

    Data Engineer Role:We are seeking a seasoned Data Engineer with expertise in PySpark and Azure Data Factory to drive the development of our data infrastructure. As a key contributor, you will design, develop, and maintain scalable data pipelines to support business growth and innovation.Responsibilities:Develop efficient data workflows using PySpark and...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    Job DetailsNorthBay Solutions LLC is seeking a highly skilled Senior Big Data Engineer to join our team.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop complex ETL jobs and pipelines in...


  • Lahore, Punjab, Pakistan kisaangroup Full time

    About UsKisaan Group is a catalyst for change, empowering rural communities to drive Pakistan's economy forward.We address critical challenges in our rural economy and unlock opportunities for sustainable growth through data-driven, research-backed projects.Our focus is on creating a lasting impact at the grassroots level, building resilient communities and...


  • Lahore, Punjab, Pakistan kisaangroup Full time

    About Our CompanyKisaan Group aims to create a lasting impact at the grassroots level, building resilient communities and fostering a prosperous Pakistan through data-driven initiatives.We empower rural communities in Pakistan by addressing critical challenges in our rural economy and unlocking opportunities for sustainable growth.We focus on developing...


  • Lahore, Punjab, Pakistan LeapSofts Full time

    Our CompanyWelcome to LeapSofts, a tech company specializing in cutting-edge AI, web, and software development solutions. Our team is dedicated to delivering tailor-made strategies for businesses to thrive in the digital landscape.What you'll doAs a Data Architect in Marketing Technology, you will play a pivotal role in designing and implementing scalable...