Senior Big Data Developer

4 days ago


Lahore, Punjab, Pakistan beBee Careers Full time

In this role, you will play a crucial part in building scalable data solutions that can handle petabytes of data. Your expertise in big data processing using Spark, Hudi/DeltaLake/Iceberg, Data Catalog, Data Lineage, Glue, and EMR will enable you to design and implement efficient data pipelines.

Responsibilities:
  • Big Data Engineering: Design, develop, and maintain robust big data solutions using industry-leading tools and technologies.
  • Cloud Computing: Develop and deploy data solutions in cloud environments, leveraging services like AWS Lambda, S3, and ECS.
  • CI/CD and IaC: Implement Continuous Integration and Continuous Deployment (CICD) pipelines using GitHub Actions or Jenkins and manage infrastructure as code using Terraform.

With 5+ years of industry experience in data engineering, you will have a solid understanding of big data processing, cloud computing, and CI/CD automation. Your hands-on experience with container orchestration and Infrastructure as Code best practices will be invaluable in this role.

Requirements:
  • 5+ years of industry experience in data engineering.
  • Strong coding ability in Python or Java.
  • Hands-on experience with cloud-based data solutions and container orchestration.
  • Proficiency in CI/CD automation and Infrastructure as Code best practices.


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Advanced Data Systems DeveloperWe are seeking an experienced Senior Big Data Engineer with a solid background in designing, developing, and managing complex data systems. The ideal candidate will have experience of over 4 to 6+ years specifically in Big Data technologies and a passion for working with large datasets.Key ResponsibilitiesDesign and develop...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    As a Senior Big Data Engineer, you will play a crucial role in designing and developing data solutions that cater to the needs of our organization. Your responsibilities will include analyzing large data stores to derive meaningful insights using Big Data querying.Key ResponsibilitiesDesign and develop code, scripts, and data pipelines that leverage...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Our ideal candidate is a highly skilled Big Data engineer with a passion for designing and developing innovative data solutions. As a key member of our team, you will be responsible for leading the development of data pipelines and implementing data storage solutions.ResponsibilitiesLead the development of data pipelines that leverage structured,...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Enterprise Data Architecture OpportunityThe ideal candidate will have a deep understanding of cloud-based big data ecosystems (AWS & Azure), real-time data processing, and enterprise data governance. They will lead the roadmap and enhancements for the enterprise Big Data Platform, ensuring scalability, reliability, and cost efficiency.

  • Big Data Specialist

    4 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Responsibilities:Data Analysis: Performing analysis of large data stores and derive insights using Big Data querying.Design and Development: Design and develop code, scripts, and data pipelines that leverage structured, semi-structured and unstructured data.Data Ingestion and Stream Processing: Manage Data ingestion pipelines and stream...

  • Big Data Engineer

    3 weeks ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...

  • Big Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer to join our team and help us achieve our goals.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines using tools like Airbyte, Airflow, and dbt, focusing on Snowflake integration.Manage and optimize data warehousing solutions with Snowflake for security, organization, and accessibility.Develop...