Data Engineer

6 days ago

Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

Role Summary

As a Big Data engineer you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and implement data Lake solutions for company-wide applications and manage large sets of structured, semi structured and unstructured data. You will work in a modern cloud-based data lakehousing environment alongside a team of diverse, intense, and interesting co-workers.

Job Responsibilities

  • Performing analysis of large data stores and derive insights using Big Data querying
  • Design and develop code, scripts, and data pipelines that leverage structured, semi-structured and unstructured data
  • Should be able to manage Data ingestion pipelines and stream processing
  • Perform computations using Azure functions
  • Responsible for the documentation, design, and development of Hadoop applications
  • Perform day-to-day tasks to accuracy with and minimal directions while meeting deadlines

Qualification & Skillset

  • Bachelor/master's degree in computer science
  • At least 2-5 years of relevant working experience with Cloud Computation
  • Hands-on experience on Azure/AWS
  • Experience working with Apache Spark, Apache Hive, Apache HBase
  • Hands-on experience on:
    • Azure/AWS Architectures
    • SQL, Scala, Node.js, JS, Java
    • Python with Pandas, NumPy, TensorFlow
    • ETL

Preferred Requirement

  • Implementing Lambda Architecture with stream processing and batch processing
  • Implement security standards and practices in the Architecture of Cloud Solution
  • Training/Certification on Data Lake HDFS
  • Training/Certification on Azure Data Lake Gen 2
  • Training/Certification on Data Bricks
  • Experience with Azure Data Explorer and Kusto query language would be a plus.
  • Experience with Azure Data Factory would be a plus.
#J-18808-Ljbffr

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    At Dot Labs, we are seeking a talented Associate Data Engineer to join our growing team.Forward your resume tocareers@dotlabs.aiLocation: DHA Phase 2Timing: 11:00 AM -8:00 PM (Onsite)As an Associate Data Engineer, you will be responsible for designing and implementing data pipelines, maintaining our data infrastructure, and optimizing data storage and...

  • Data Engineer

    2 days ago

    Lahore, Punjab, Pakistan NETSOL Technologies Inc. Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from NETSOL Technologies Inc.Manager Talent Acquisition@ NETSOL Technologies Inc. | International RecruitmentKey Responsibilities:Design and implement ETL/ELT pipelines, data lakes, and data warehouses to support client-specific use cases.Lead the development of Proof of Concepts (POCs)...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Data Engineer role at Avanceon Middle East & South Asia.About Us?Avanceon is a multinational corporation which specializes in automation, control systems integration, energy management solutions, and support services. With offices in Dubai, Qatar, Saudi Arabia, and Pakistan, it has established a significant market presence. Over its...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    About Us?Octopus Digital is leading the charge in Industry 4.0 across Pakistan and the Middle East, revolutionizing industries with smart factory solutions, AI, big data, and IoT. Our cloud-native, AI-powered platforms deliver actionable insights, making complex data accessible for all professionals. We help businesses digitize manufacturing, supply chain,...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Loxvo Technologies Full time

    Direct message the job poster from Loxvo TechnologiesJob Description:We are seeking a highly capable Data Engineer to drive our data infrastructure as we build AI-powered systems such as chatbots and automated report generators. This role is centered on solving data-centric challenges, from transforming and migrating data to ensuring consistency, integrity,...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan TenX Full time

    Join to apply for the Data Engineer role at TenX.Get AI-powered advice on this job and more exclusive features.Senior Talent Acquisition Executive @ TenX | 360° HR Resource | Scouting Talent | C-level Recruitment | Your hiring PartnerJOB SUMMARY:Data Engineers are responsible for designing and creating the data warehouse and all related extraction,...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan BridgeLinx Technologies Full time

    Direct message the job poster from BridgeLinx TechnologiesWe, at BridgeLinx, are looking to hire a data engineer to accelerate our data infrastructure development process. We are a small team driven by our common love for data and helping people to adopt data-driven decision-making. As a data engineer, you would be responsible for creating and maintaining...

  • Data Engineer

    5 days ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data...

  • Data Engineer

    5 days ago

    Lahore, Punjab, Pakistan HR POD Careers Full time

    Requirements:Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.3 to 4 years of experience working as a Data Engineer in a production environment.Hands-on experience with AWS Redshift, AWS Data Lake, and Snowflake. Strong SQL skills and understanding of database concepts.Experience in building and maintaining data...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Loxvo Technologies Full time

    2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Loxvo TechnologiesJob Description:We are seeking a highly capable Data Engineer to drive our data infrastructure as we build AI-powered systems such as chatbots and automated report generators. This role is centered on...