Senior Data Engineer

1 week ago

Lahore, Punjab, Pakistan Tkxel LLC Full time
Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job Description

We are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in building and optimizing large-scale data pipelines, architecting cloud-based data solutions, and managing complex data environments using cloud technologies. You will work closely with cross-functional teams to design, develop, and deploy data solutions that power business insights.

Key Responsibilities:

  • Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena. Leverage AWS Step Functions to automate complex workflows.
  • Data Warehousing: Architect and manage data warehouses using cloud technologies, while integrating with S3, RDS, and DynamoDB for both structured (SQL) and unstructured (NoSQL) data needs.
  • Big Data Processing: Utilize PySpark on AWS EMR for distributed data processing, ensuring the effective transformation of raw data into business insights.
  • Database Management: Manage both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB) databases, ensuring data is efficiently stored, retrieved, and queried.
  • Real-Time Data Processing: Implement and maintain real-time streaming data solutions using AWS Kinesis or Kafka for low-latency data processing.
  • Cloud Monitoring & Automation: Use AWS CLI and CloudWatch to monitor, automate, and optimize data pipelines and ensure efficient use of cloud resources.
  • Data Governance & Security: Ensure adherence to best practices for data security, governance, and compliance, including data encryption and access controls.
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to align data infrastructure with business objectives.
  • Documentation: Maintain detailed documentation of data models, data pipeline processes, and system architectures.
Requirements
  • 5+ years of experience as a Data Engineer, with a strong emphasis on cloud-based data warehousing and ETL pipelines.
  • Proficiency with AWS services including EMR, Athena, Glue, Step Functions, ElasticSearch, RDS, Redshift, DynamoDB, and S3.
  • Advanced SQL skills and experience with relational databases like PostgreSQL, MySQL as well as NoSQL databases such as MongoDB and DynamoDB.
  • Hands-on experience in Python for data processing and automation, with knowledge of AWS CLI.
  • Strong proficiency with PySpark for distributed data processing and transformation.
  • Experience with AWS CloudWatch for monitoring and optimizing data workflows.
  • Data warehouse architecture experience, including optimizing query performance in large-scale environments.
  • Strong understanding of data governance, security, and compliance best practices.
  • Bachelor's degree in Computer Science, Engineering, or a related field.

Nice to have:

  • Familiarity with real-time data streaming solutions such as Apache Kafka or AWS Kinesis.
#J-18808-Ljbffr

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Arbisoft Full time

    Join to apply for the Senior Data Engineer role at Arbisoft2 days ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at ArbisoftGet AI-powered advice on this job and more exclusive features.Direct message the job poster from ArbisoftAssistant Manager Talent Management @ Arbisoft | MBA in HR ManagementArbisoft is looking for...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan nexaquanta Full time

    1 day ago Be among the first 25 applicantsDirect message the job poster from NexaQuantaTechnical and Non-Technical Recruiter | Payroll Executive | HR Operations | Talent Acquisition | HR Generalist | Sr. HR Officer | Employees Relation…Role DescriptionWe are looking for a highly motivated and skilled Data Engineer with around 4 years of experience to join...

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Joblogic Service Management Software Full time

    2 days ago Be among the first 25 applicantsWe are looking for an experienced Senior Data Engineer to join our growing team. The ideal candidate will have over 7 years of experience in Data Engineering with strong expertise in designing, developing, and maintaining data pipelines using Azure and AWS technologies, modern data Lakehouse architecture, Apache...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Business Solutions & Services (BSS) Full time

    We are looking for a highly experienced Senior Data Engineer with over 10 years of hands-on experience in data engineering, data architecture, and enterprise analytics solutions. In this role, you will be responsible for the design and implementation of scalable, secure, and high-performance data platforms using Microsoft Fabric technologies including...

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from Mavericks United35k+ | HR Lead @ Mavericks | Talent Acquisition Specialist | Tech & Non-Tech Recruitment | People Managment | Employer & Employee Branding | HR Ops |…The Role:Mavericks United is looking for a highly skilled Data Engineer to join our on-site team. This role is...

  • Senior Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan Devsinc, LLC Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Senior Data Scientist

    4 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a seasoned Senior Big Data Engineer to lead our efforts in designing and developing innovative Big Data solutions.The ideal candidate will have extensive experience in data engineering, with a strong background in Big Data technologies. They will be responsible for designing, developing, and deploying complex ETL pipelines, as well as...

  • Senior Big Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...

  • Senior Cloud Data Engineer

    4 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Title: Senior Data EngineerThis role requires an experienced and highly skilled Senior Data Engineer to join our team. The ideal candidate will have a strong background in designing, developing, and deploying large-scale data solutions, and working closely with cross-functional teams to power business insights.Key Responsibilities:Design and implement...

  • Artificial Intelligence Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Base Camp Data Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Base Camp Data Solutions.Talent Acquisition Specialist at Base Camp Data SolutionsWe're hiring: Senior / Lead AI EngineersLocations: Karachi | Islamabad | Lahore | HyderabadExperience: 5–6+ YearsExpertise: Artificial Intelligence, Computer Vision, or NLPAre you...