Big Data Engineer

3 weeks ago


Lahore, Punjab, Pakistan Arbisoft Full time

Software Engineering - Arbisoft, Lahore, Islamabad, Karachi

We are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in production environments.

Key Responsibilities:
  • Design, develop, and maintain robust data pipelines and platforms.
  • Build and deploy solutions in cloud environments, either as Cloud Native (Serverless) using S3, Lambda, AWS Batch, ECS, or as Cloud Agnostic using Kubernetes services.
  • Implement CI/CD pipelines with GitHub Actions or Jenkins.
  • Manage Infrastructure as Code with tools like Terraform.
  • Optimize data processing workflows to handle large-scale datasets efficiently.
Preferred Expertise in One or More Areas:
  • Big Data: Experience with processing petabytes of data using Spark, Hudi/DeltaLake/Iceberg, Data Catalog, Data Lineage, Glue, EMR.
  • Graph Databases: Experience in ingesting and consuming data in GraphDBs such as Neo4J, AWS Neptune, or JanusGraph.
What We're Looking For:
  • 5+ years of industry experience in data engineering (excluding internships, prototypes, and personal projects).
  • Strong coding ability in Python or Java.
  • Hands-on experience with cloud-based data solutions and container orchestration.
  • Proficiency in CI/CD automation and Infrastructure as Code best practices.
#J-18808-Ljbffr
  • Big Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer to join our team and help us achieve our goals.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines using tools like Airbyte, Airflow, and dbt, focusing on Snowflake integration.Manage and optimize data warehousing solutions with Snowflake for security, organization, and accessibility.Develop...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data.Job...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    In this role, you will play a crucial part in building scalable data solutions that can handle petabytes of data. Your expertise in big data processing using Spark, Hudi/DeltaLake/Iceberg, Data Catalog, Data Lineage, Glue, and EMR will enable you to design and implement efficient data pipelines.Responsibilities:Big Data Engineering: Design, develop, and...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Advanced Data Systems DeveloperWe are seeking an experienced Senior Big Data Engineer with a solid background in designing, developing, and managing complex data systems. The ideal candidate will have experience of over 4 to 6+ years specifically in Big Data technologies and a passion for working with large datasets.Key ResponsibilitiesDesign and develop...


  • Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Enterprise Data Architecture OpportunityThe ideal candidate will have a deep understanding of cloud-based big data ecosystems (AWS & Azure), real-time data processing, and enterprise data governance. They will lead the roadmap and enhancements for the enterprise Big Data Platform, ensuring scalability, reliability, and cost efficiency.

  • Data Engineer

    3 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Data Engineer RoleWe are looking for an experienced data engineer to expand and optimize big data pipelines. The successful candidate will work alongside other engineers and developers, collaborating on different layers of the data warehouse.Responsibilities:Create and maintain ETL/ELT ingestion pipelines and analytics solutions using cloud...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    As a Senior Big Data Engineer, you will play a crucial role in designing and developing data solutions that cater to the needs of our organization. Your responsibilities will include analyzing large data stores to derive meaningful insights using Big Data querying.Key ResponsibilitiesDesign and develop code, scripts, and data pipelines that leverage...