Senior Data Engineer

3 weeks ago

Lahore, Punjab, Pakistan Tkxel LLC Full time
Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job Description

We are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in building and optimizing large-scale data pipelines, architecting cloud-based data solutions, and managing complex data environments using cloud technologies. You will work closely with cross-functional teams to design, develop, and deploy data solutions that power business insights.

Key Responsibilities:

  • Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena. Leverage AWS Step Functions to automate complex workflows.
  • Data Warehousing: Architect and manage data warehouses using cloud technologies, while integrating with S3, RDS, and DynamoDB for both structured (SQL) and unstructured (NoSQL) data needs.
  • Big Data Processing: Utilize PySpark on AWS EMR for distributed data processing, ensuring the effective transformation of raw data into business insights.
  • Database Management: Manage both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB) databases, ensuring data is efficiently stored, retrieved, and queried.
  • Real-Time Data Processing: Implement and maintain real-time streaming data solutions using AWS Kinesis or Kafka for low-latency data processing.
  • Cloud Monitoring & Automation: Use AWS CLI and CloudWatch to monitor, automate, and optimize data pipelines and ensure efficient use of cloud resources.
  • Data Governance & Security: Ensure adherence to best practices for data security, governance, and compliance, including data encryption and access controls.
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to align data infrastructure with business objectives.
  • Documentation: Maintain detailed documentation of data models, data pipeline processes, and system architectures.
Requirements
  • 5+ years of experience as a Data Engineer, with a strong emphasis on cloud-based data warehousing and ETL pipelines.
  • Proficiency with AWS services including EMR, Athena, Glue, Step Functions, ElasticSearch, RDS, Redshift, DynamoDB, and S3.
  • Advanced SQL skills and experience with relational databases like PostgreSQL, MySQL as well as NoSQL databases such as MongoDB and DynamoDB.
  • Hands-on experience in Python for data processing and automation, with knowledge of AWS CLI.
  • Strong proficiency with PySpark for distributed data processing and transformation.
  • Experience with AWS CloudWatch for monitoring and optimizing data workflows.
  • Data warehouse architecture experience, including optimizing query performance in large-scale environments.
  • Strong understanding of data governance, security, and compliance best practices.
  • Bachelor's degree in Computer Science, Engineering, or a related field.

Nice to have:

  • Familiarity with real-time data streaming solutions such as Apache Kafka or AWS Kinesis.
#J-18808-Ljbffr

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan nexaquanta Full time

    1 day ago Be among the first 25 applicantsDirect message the job poster from NexaQuantaTechnical and Non-Technical Recruiter | Payroll Executive | HR Operations | Talent Acquisition | HR Generalist | Sr. HR Officer | Employees Relation…Role DescriptionWe are looking for a highly motivated and skilled Data Engineer with around 4 years of experience to join...

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan S4Digital Full time

    We're actively hiring for AWS Senior Data Engineer - Lahore.Client Company Introduction:Our client company specializes in Data, AI, and Cloud Engineering.Duties/Responsibilities:Extract data from multiple sources.Perform data cleaning, cleansing, and transformation.Build data systems and pipelines.Conduct complex data analysis and report on results.Load data...

  • Senior Data Engineer

    3 days ago

    Lahore, Punjab, Pakistan Seanode Full time

    We're looking for a Senior Data Engineer with strong experience in building, scaling, and optimizing large-scale data pipelines to support high-performance AI systems. You'll be responsible for designing and maintaining data infrastructure that ingests, transforms, and serves data at terabyte-scale (10TB+ per source) across multiple domains.You will work...

  • Senior Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan Devsinc Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Devsinc, LLC Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Senior ETL Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan NorthBay - Pakistan Full time

    3 weeks ago Be among the first 25 applicantsJob Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from DOT LABSHuman Resources Executive @Dot Labs | Talent Acquisition | Technical Recruitment | Performance Management | Training & Development | Employee…At Dot Labs, we are seeking a talented Associate Data Engineer to join our growing team.Forward your resume to...

  • Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan HR POD Careers Full time

    Data Engineer (Onsite, Lahore, Remittance Salary)Join to apply for the Data Engineer (Onsite, Lahore, Remittance Salary) role at HR POD CareersData Engineer (Onsite, Lahore, Remittance Salary)1 day ago Be among the first 25 applicantsJoin to apply for the Data Engineer (Onsite, Lahore, Remittance Salary) role at HR POD CareersGet AI-powered advice on this...

  • Senior Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan Stallions Full time

    About the Role:We are seeking a Senior Data Engineer with hands-on expertise in Microsoft Dynamics 365 Finance & Operations (F&O) and Azure Data Engineering tools to lead complex data migration and integration initiatives. This role requires a technically strong, solutions-oriented professional who can design robust ETL pipelines, manage end-to-end data...

  • Sr. Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Mavericks Labs Full time

    2 days ago Be among the first 25 applicantsJob Title: Sr. Data EngineerLocation: Green Forts 2, Lahore (On-site)Experience Level: 5+ years of experienceTime: 5pm-2amThe Role:As part of our continued expansion, we are seeking a Senior Data Engineer — a hands-on technical leader responsible for designing, developing, and maintaining enterprise-grade data...