Large Scale Data Solutions Designer

7 days ago


Hyderabad City Taluka, Pakistan beBee Careers Full time
Job Requirements

We are looking for a highly skilled Senior Data Engineer to join our team and lead the development of large-scale data systems, real-time streaming solutions, and cloud-based data platforms.

  • Main Responsibilities:
  • Lead the design and development of scalable, high-performance data architectures on AWS.
  • Design and build complex data pipelines using Apache Spark (Scala & PySpark), Kafka Streams (Java), and cloud-native technologies.
  • Develop and optimize real-time data streaming applications using Kafka Streams in Java.
  • Manage Snowflake for cloud data warehousing, ensuring seamless data integration, query optimization, and advanced analytics.
  • Implement Apache Iceberg in Data Lakes for managing large-scale datasets with ACID compliance, schema evolution, and versioning.
Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 5+ years of experience in Data Engineering or a related field, with a proven track record of designing, implementing, and maintaining large-scale distributed data systems.
  • Proficiency in Apache Spark (Scala & PySpark) for distributed data processing and real-time analytics.
  • Hands-on experience with Kafka Streams using Java for real-time data streaming applications.


  • Hyderabad City Taluka, Pakistan BigID Full time

    About BigIDAt BigID, we're committed to creating innovative solutions for data security, compliance, privacy, and AI data management. Our vision is to help customers achieve compliance, build customer trust, make better decisions, and get more value from their data.We're a global team passionate about innovation and next-gen technology. Some of our notable...


  • Faisalabad City Tehsil, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a senior Python developer to lead our web scraping efforts and develop large-scale projects that require expertise in web scraping techniques and technologies.Responsibilities:Lead the design and implementation of web scraping solutions using Selenium, Beautiful Soup, and Scrapy.Develop and maintain complex web scraping solutions...


  • Quetta City Tehsil, Pakistan beBee Careers Full time

    We are looking for a Large Scale Project Coordinator to join our team. The ideal candidate will have experience coordinating large-scale projects and be able to manage multiple stakeholders to ensure project delivery.Job Description:Coordinate large-scale building projectsManage multiple stakeholders to ensure project deliveryDevelop and implement project...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking an experienced and skilled Data Engineer to design, build, and maintain scalable data solutions that support critical business needs.The role involves working with distributed data platforms, cloud infrastructure, and modern data engineering tools to enable efficient data processing, storage, and analytics.About the RoleDesign,...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the JobWe are looking for a highly skilled Senior Data Engineer to lead the development of large-scale data systems, real-time streaming solutions, and cloud-based data platforms.Key Responsibilities:Lead the design and development of scalable, high-performance data architectures on AWS.Design and build complex data pipelines using Apache Spark (Scala...

  • Data Engineering Lead

    9 hours ago


    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering LeadWe are seeking a Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for leading the design, development, and implementation of large-scale data processing systems.Key Responsibilities:Lead a team of data engineers to design, develop, and implement large-scale data processing...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering ExpertiseWe are seeking a highly experienced Senior Data Engineer with expertise in designing, implementing, and optimizing large-scale data systems, real-time streaming solutions, and cloud-based data platforms.Main Responsibilities:Design and develop scalable, high-performance data architectures on AWS, leveraging services like S3, EMR,...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking a highly experienced Senior Data Engineer to lead the design, implementation, and optimization of large-scale data systems, real-time streaming solutions, and cloud-based data platforms.Main Responsibilities:Design and develop scalable, high-performance data architectures on AWS, leveraging services like S3, EMR, Glue, Redshift,...

  • Data Architect

    7 days ago


    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.About the RoleThis role will involve working with a fast-paced team to create a data technology stack that can be used to deliver end-user insights used for developing...


  • Hyderabad City Taluka, Pakistan FANATICS INC Full time

    Job Overview:We are looking for a Senior Data Engineer with a deep understanding of Apache Spark (Scala & PySpark), Kafka Streams (Java), AWS services, Snowflake, Apache Iceberg, Tableau, and Data Lake architectures. As a senior member of our team, you will be responsible for leading the design, implementation, and optimization of large-scale data systems,...