Senior Data Engineer

3 weeks ago

Lahore, Punjab, Pakistan Tkxel LLC Full time
Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job Description

We are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in building and optimizing large-scale data pipelines, architecting cloud-based data solutions, and managing complex data environments using cloud technologies. You will work closely with cross-functional teams to design, develop, and deploy data solutions that power business insights.

Key Responsibilities:

  • Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena. Leverage AWS Step Functions to automate complex workflows.
  • Data Warehousing: Architect and manage data warehouses using cloud technologies, while integrating with S3, RDS, and DynamoDB for both structured (SQL) and unstructured (NoSQL) data needs.
  • Big Data Processing: Utilize PySpark on AWS EMR for distributed data processing, ensuring the effective transformation of raw data into business insights.
  • Database Management: Manage both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB) databases, ensuring data is efficiently stored, retrieved, and queried.
  • Real-Time Data Processing: Implement and maintain real-time streaming data solutions using AWS Kinesis or Kafka for low-latency data processing.
  • Cloud Monitoring & Automation: Use AWS CLI and CloudWatch to monitor, automate, and optimize data pipelines and ensure efficient use of cloud resources.
  • Data Governance & Security: Ensure adherence to best practices for data security, governance, and compliance, including data encryption and access controls.
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to align data infrastructure with business objectives.
  • Documentation: Maintain detailed documentation of data models, data pipeline processes, and system architectures.
Requirements
  • 5+ years of experience as a Data Engineer, with a strong emphasis on cloud-based data warehousing and ETL pipelines.
  • Proficiency with AWS services including EMR, Athena, Glue, Step Functions, ElasticSearch, RDS, Redshift, DynamoDB, and S3.
  • Advanced SQL skills and experience with relational databases like PostgreSQL, MySQL as well as NoSQL databases such as MongoDB and DynamoDB.
  • Hands-on experience in Python for data processing and automation, with knowledge of AWS CLI.
  • Strong proficiency with PySpark for distributed data processing and transformation.
  • Experience with AWS CloudWatch for monitoring and optimizing data workflows.
  • Data warehouse architecture experience, including optimizing query performance in large-scale environments.
  • Strong understanding of data governance, security, and compliance best practices.
  • Bachelor's degree in Computer Science, Engineering, or a related field.

Nice to have:

  • Familiarity with real-time data streaming solutions such as Apache Kafka or AWS Kinesis.
#J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Job Description: Senior Data Engineer at TkxelWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data Factory to join our team. The ideal candidate will have a minimum of 5 years of professional experience in data engineering and a strong understanding of data processing, transformation, and integration. Knowledge of...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Stallions Tech Full time

    Stallions Tech is looking for a Senior Data Engineer to join their dynamic team. This role focuses on designing and optimizing scalable data pipelines, ensuring data quality, and managing modern data infrastructure. If you're passionate about data engineering and innovation, this opportunity is for youKey Responsibilities:Design, develop, and maintain robust...

  • Senior Data Engineer

    4 days ago

    Lahore, Punjab, Pakistan Joblogic Service Management Software Full time

    2 days ago Be among the first 25 applicantsWe are looking for an experienced Senior Data Engineer to join our growing team. The ideal candidate will have over 7 years of experience in Data Engineering with strong expertise in designing, developing, and maintaining data pipelines using Azure and AWS technologies, modern data Lakehouse architecture, Apache...

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan FINCA Impact Finance Full time

    Senior Data Engineer FINCA Impact Finance , Pakistan The Senior Data Engineer takes an active part in development and support tasks related to Enterprise Data Warehouse (EDW), Data Lake, and BI/analytical solutions, which integrate data from 20 countries and provide support for decision-making. As a member of the EDW Development Team, the Senior Data...

  • Senior Data Engineer Role

    19 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Senior Data Engineer RoleWe are seeking a highly experienced Senior Data Engineer to lead the development and optimization of data pipelines and databases.The ideal candidate will have a deep understanding of data architecture and engineering principles, as well as hands-on experience in designing, developing, and maintaining data processing systems.Leading...

  • Senior Cloud Data Engineer

    22 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Senior Data EngineerA senior data engineer with expertise in building large-scale data pipelines and architecting cloud-based data solutions is sought after by a leading software development company. The ideal candidate will have experience designing, developing, and deploying data solutions that power business insights.Key Responsibilities:Data Pipeline...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    Job Title: Senior Data EngineerGet AI-powered advice on this job and more exclusive features.At Dot Labs, we are seeking a talented Senior Data Engineer to join our growing team.Forward your resume to: careers@dotlabs.aiLocation: DHA Phase 2Timing: 10:00 AM - 7:00 PM (Onsite)Job DescriptionAs a Senior Data Engineer, you will collaborate closely with data...

  • Senior Data Systems Engineer

    22 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are looking for a highly skilled Senior Data Engineer to join our team. The successful candidate will be responsible for designing and implementing data architectures that meet business needs.Responsibilities:Develop and maintain data pipelines to support business intelligence and analytics.Collaborate with cross-functional teams to ensure data quality...

  • Senior Data Engineering Professional

    2 weeks ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    About the RoleThis is a mid-senior level position that requires a strong background in data engineering, with a focus on designing and implementing scalable data pipelines using PySpark and Azure Data Factory.Main ResponsibilitiesDevelop and implement data pipelines to support business intelligence and analytical requirements.Collaborate with...

  • Senior Big Data Engineer

    6 days ago

    Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...