Big Data Systems Developer

4 days ago


Lahore, Punjab, Pakistan beBee Careers Full time
Advanced Data Systems Developer

We are seeking an experienced Senior Big Data Engineer with a solid background in designing, developing, and managing complex data systems. The ideal candidate will have experience of over 4 to 6+ years specifically in Big Data technologies and a passion for working with large datasets.

Key Responsibilities
  • Design and develop advanced data systems using Big Data technologies.
  • Develop and manage complex ETL jobs and pipelines, integrating data from multiple sources.
  • Act as a team member, consulting other teammates on new system developments and providing guidance on best practices.
  • Deploy data models into production environments, configuring data attributes and managing computing resources.
Requirements
  • Experience working with distributed storage systems (e.g., HDFS, S3) and knowledge of containerization technologies.
  • Strong software development and programming skills with a focus on data using Python, PySpark, and/or Scala.
  • Hands-on experience with various core services, such as BigQuery, Cloud Composer, Cloud Storage.


  • Lahore, Punjab, Pakistan beBee Careers Full time

    In this role, you will play a crucial part in building scalable data solutions that can handle petabytes of data. Your expertise in big data processing using Spark, Hudi/DeltaLake/Iceberg, Data Catalog, Data Lineage, Glue, and EMR will enable you to design and implement efficient data pipelines.Responsibilities:Big Data Engineering: Design, develop, and...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Enterprise Data Architecture OpportunityThe ideal candidate will have a deep understanding of cloud-based big data ecosystems (AWS & Azure), real-time data processing, and enterprise data governance. They will lead the roadmap and enhancements for the enterprise Big Data Platform, ensuring scalability, reliability, and cost efficiency.

  • Big Data Specialist

    4 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Responsibilities:Data Analysis: Performing analysis of large data stores and derive insights using Big Data querying.Design and Development: Design and develop code, scripts, and data pipelines that leverage structured, semi-structured and unstructured data.Data Ingestion and Stream Processing: Manage Data ingestion pipelines and stream...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    As a Senior Big Data Engineer, you will play a crucial role in designing and developing data solutions that cater to the needs of our organization. Your responsibilities will include analyzing large data stores to derive meaningful insights using Big Data querying.Key ResponsibilitiesDesign and develop code, scripts, and data pipelines that leverage...

  • Big Data Engineer

    3 weeks ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...

  • Big Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer to join our team and help us achieve our goals.Key ResponsibilitiesDesign, build, and maintain scalable data pipelines using tools like Airbyte, Airflow, and dbt, focusing on Snowflake integration.Manage and optimize data warehousing solutions with Snowflake for security, organization, and accessibility.Develop...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Big Data ArchitectOur organization requires a Big Data Architect to design, implement, and maintain large-scale data processing systems and databases.The successful candidate will have extensive experience in data architecture and engineering principles, as well as expertise in big data technologies such as Apache Hadoop and Spark.Key Areas of...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Our ideal candidate is a highly skilled Big Data engineer with a passion for designing and developing innovative data solutions. As a key member of our team, you will be responsible for leading the development of data pipelines and implementing data storage solutions.ResponsibilitiesLead the development of data pipelines that leverage structured,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data.Job...