Senior Data Engineer

2 days ago

Lahore, Punjab, Pakistan Tkxel LLC Full time
Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job Description

We are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in building and optimizing large-scale data pipelines, architecting cloud-based data solutions, and managing complex data environments using cloud technologies. You will work closely with cross-functional teams to design, develop, and deploy data solutions that power business insights.

Key Responsibilities:

  • Data Pipeline Development: Design, build, and maintain scalable ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena. Leverage AWS Step Functions to automate complex workflows.
  • Data Warehousing: Architect and manage data warehouses using cloud technologies, while integrating with S3, RDS, and DynamoDB for both structured (SQL) and unstructured (NoSQL) data needs.
  • Big Data Processing: Utilize PySpark on AWS EMR for distributed data processing, ensuring the effective transformation of raw data into business insights.
  • Database Management: Manage both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., DynamoDB, MongoDB) databases, ensuring data is efficiently stored, retrieved, and queried.
  • Real-Time Data Processing: Implement and maintain real-time streaming data solutions using AWS Kinesis or Kafka for low-latency data processing.
  • Cloud Monitoring & Automation: Use AWS CLI and CloudWatch to monitor, automate, and optimize data pipelines and ensure efficient use of cloud resources.
  • Data Governance & Security: Ensure adherence to best practices for data security, governance, and compliance, including data encryption and access controls.
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to align data infrastructure with business objectives.
  • Documentation: Maintain detailed documentation of data models, data pipeline processes, and system architectures.
Requirements
  • 5+ years of experience as a Data Engineer, with a strong emphasis on cloud-based data warehousing and ETL pipelines.
  • Proficiency with AWS services including EMR, Athena, Glue, Step Functions, ElasticSearch, RDS, Redshift, DynamoDB, and S3.
  • Advanced SQL skills and experience with relational databases like PostgreSQL, MySQL as well as NoSQL databases such as MongoDB and DynamoDB.
  • Hands-on experience in Python for data processing and automation, with knowledge of AWS CLI.
  • Strong proficiency with PySpark for distributed data processing and transformation.
  • Experience with AWS CloudWatch for monitoring and optimizing data workflows.
  • Data warehouse architecture experience, including optimizing query performance in large-scale environments.
  • Strong understanding of data governance, security, and compliance best practices.
  • Bachelor's degree in Computer Science, Engineering, or a related field.

Nice to have:

  • Familiarity with real-time data streaming solutions such as Apache Kafka or AWS Kinesis.
#J-18808-Ljbffr

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Digifloat Full time

    Direct message the job poster from DigifloatHiring Data Engineers | Head hunter | Talent Acquisition | Recruitment Consultant | HR ProfessionalWe are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have extensive experience in building data pipelines, managing data...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    Direct message the job poster from Mavericks UnitedHR Executive l Technical Recruiter I Talent Acquisition SpecialistThe ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and find the...

  • Senior Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan nexaquanta Full time

    1 day ago Be among the first 25 applicantsDirect message the job poster from NexaQuantaTechnical and Non-Technical Recruiter | Payroll Executive | HR Operations | Talent Acquisition | HR Generalist | Sr. HR Officer | Employees Relation…Role DescriptionWe are looking for a highly motivated and skilled Data Engineer with around 4 years of experience to join...

  • Senior Data Engineer

    5 days ago

    Lahore, Punjab, Pakistan S4Digital Full time

    We're actively hiring for AWS Senior Data Engineer - Lahore.Client Company Introduction:Our client company specializes in Data, AI, and Cloud Engineering.Duties/Responsibilities:Extract data from multiple sources.Perform data cleaning, cleansing, and transformation.Build data systems and pipelines.Conduct complex data analysis and report on results.Load data...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from Mavericks United35k+ | HR Lead @ Mavericks | Talent Acquisition Specialist | Tech & Non-Tech Recruitment | People Managment | Employer & Employee Branding | HR Ops |…The Role:Mavericks United is looking for a highly skilled Data Engineer to join our on-site team. This role is...

  • Senior Data Engineer

    2 days ago

    Lahore, Punjab, Pakistan Devsinc, LLC Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan NETSOL Technologies Inc. Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from NETSOL Technologies Inc.Manager Talent Acquisition@ NETSOL Technologies Inc. | International RecruitmentKey Responsibilities:Design and implement ETL/ELT pipelines, data lakes, and data warehouses to support client-specific use cases.Lead the development of Proof of Concepts (POCs)...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Manafa Technologies Full time

    Join to apply for the Senior Data Engineer (8+ Years) role at Manafa Technologies.About Us:At Manafa Technologies, we are dedicated to revolutionizing the fintech landscape by empowering small and medium-sized enterprises (SMEs) across Saudi Arabia. Our vision is to be the most accessible lending partner for SMEs, always just one click away from fulfilling...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    At Dot Labs, we are seeking a talented Associate Data Engineer to join our growing team.Forward your resume tocareers@dotlabs.aiLocation: DHA Phase 2Timing: 11:00 AM -8:00 PM (Onsite)As an Associate Data Engineer, you will be responsible for designing and implementing data pipelines, maintaining our data infrastructure, and optimizing data storage and...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan BridgeLinx Technologies Full time

    Direct message the job poster from BridgeLinx TechnologiesWe, at BridgeLinx, are looking to hire a data engineer to accelerate our data infrastructure development process. We are a small team driven by our common love for data and helping people to adopt data-driven decision-making. As a data engineer, you would be responsible for creating and maintaining...