Data Engineer

4 weeks ago

Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

Role Summary

As a Big Data engineer you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and implement data Lake solutions for company-wide applications and manage large sets of structured, semi structured and unstructured data. You will work in a modern cloud-based data lakehousing environment alongside a team of diverse, intense, and interesting co-workers.

Job Responsibilities

  • Performing analysis of large data stores and derive insights using Big Data querying
  • Design and develop code, scripts, and data pipelines that leverage structured, semi-structured and unstructured data
  • Should be able to manage Data ingestion pipelines and stream processing
  • Perform computations using Azure functions
  • Responsible for the documentation, design, and development of Hadoop applications
  • Perform day-to-day tasks to accuracy with and minimal directions while meeting deadlines

Qualification & Skillset

  • Bachelor/master's degree in computer science
  • At least 2-5 years of relevant working experience with Cloud Computation
  • Hands-on experience on Azure/AWS
  • Experience working with Apache Spark, Apache Hive, Apache HBase
  • Hands-on experience on:
    • Azure/AWS Architectures
    • SQL, Scala, Node.js, JS, Java
    • Python with Pandas, NumPy, TensorFlow
    • ETL

Preferred Requirement

  • Implementing Lambda Architecture with stream processing and batch processing
  • Implement security standards and practices in the Architecture of Cloud Solution
  • Training/Certification on Data Lake HDFS
  • Training/Certification on Azure Data Lake Gen 2
  • Training/Certification on Data Bricks
  • Experience with Azure Data Explorer and Kusto query language would be a plus.
  • Experience with Azure Data Factory would be a plus.
#J-18808-Ljbffr

  • QA Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Data Wise Full time

    Job Description:We are seeking a highly skilled test and quality assurance engineer to join our dynamic team. The ideal candidate will possess extensive experience in software testing and development. The QA testing engineer will play a crucial role in enhancing our software quality and performance by applying advanced testing strategies and will collaborate...

  • Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from DOT LABSHuman Resources Executive @Dot Labs | Talent Acquisition | Technical Recruitment | Performance Management | Training & Development | Employee…At Dot Labs, we are seeking a talented Associate Data Engineer to join our growing team.Forward your resume to...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Game District Full time

    We are seeking a skilled Data Engineer with 5 years of experience to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have hands-on experience with data warehousing, ETL processes, and big data technologies, enabling efficient data flow and analytics support across the organization.Key Responsibilities: ...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan NETSOL Technologies Inc. Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from NETSOL Technologies Inc.Manager Talent Acquisition@ NETSOL Technologies Inc. | International RecruitmentKey Responsibilities:Design and implement ETL/ELT pipelines, data lakes, and data warehouses to support client-specific use cases.Lead the development of Proof of Concepts (POCs)...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan PRG Pakistan Full time

    We are seeking a skilled Data Engineer with AI/ML expertise to design, build, and optimize scalable data pipelines that power machine learning models and AI-driven applications. You will work closely with data scientists, analysts, and software engineers to ensure efficient data ingestion, transformation, and storage—enabling real-time analytics and AI...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Vodworks Full time

    Join to apply for the Data Engineer role at Vodworks.Job SummaryWe are seeking a skilled and proactive Data Engineer to join our data infrastructure team. This role is ideal for someone with strong hands-on experience in DBT and Amazon Redshift, with working knowledge of modern BI tools such as Holistics BI and Metabase. You will be responsible for building,...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan HR POD Careers Full time

    Requirements:Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.3 to 4 years of experience working as a Data Engineer in a production environment.Hands-on experience with AWS Redshift, AWS Data Lake, and Snowflake. Strong SQL skills and understanding of database concepts.Experience in building and maintaining data...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Systems Limited Full time

    We are looking for a highly skilled Data Engineer with hands-on experience in Azure Data Factory, Databricks, and Payspark to join our data team. You will be responsible for designing and maintaining robust data pipelines that support scalable and secure data processing in a modern cloud environment.Responsibilities:Develop and maintain end-to-end data...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Axiom World Full time

    Location: Onsite – LahoreWorking Hours: 3:00 PM – 12:00 AMJob Type: Full-Time | PermanentJob Summary:We are seeking a skilled and motivated Data Engineer with 2+ years of experience to join our growing team. The ideal candidate will have hands-on experience in building, maintaining, and optimizing data pipelines and architectures. If you are passionate...