Big Data System Developer

7 days ago

Islamabad, Islamabad, Pakistan beBeeData Full time

Job Summary: We are seeking a skilled Data Engineer to lead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark, Python, and Talend.

This role involves designing and implementing data pipelines, ensuring security, monitoring system performance, and collaborating with cross-functional teams to deliver high-performance data solutions.

  • Main Responsibilities:
  • Design, develop, and optimize a Big Data Platform leveraging Kafka, Flink, Spark, and Talend.
  • Architect and implement real-time and batch data processing pipelines.
  • Ensure secure data access and governance using Apache Ranger.
  • Monitor and optimize system performance with Prometheus.
  • Develop and maintain ETL workflows and data ingestion pipelines.
  • Write efficient and scalable SQL queries for data transformation and analysis.
  • Collaborate with Data Scientists, Analysts, and DevOps teams to align data infrastructure with business goals.
  • Implement data security, compliance, and access control policies.
  • Troubleshoot and resolve issues related to data processing, storage, and system performance.
Required Skills & Qualifications:
  • 5+ years of experience in Big Data Engineering.
  • Hands-on expertise in Kafka, Flink, Spark, Python, and Talend.
  • Strong proficiency in SQL, with experience in query optimization and performance tuning.
  • Familiarity with Apache Ranger for data security and access control.
  • Familiarity with Prometheus for monitoring and performance optimization.
  • Deep understanding of distributed computing, data partitioning, and pipeline orchestration.
  • Experience with cloud-based big data solutions (AWS, Azure, or GCP) is a plus.
  • Strong problem-solving and analytical skills.
  • Excellent communication and leadership abilities.
Benefits:

The successful candidate will have opportunities to work on challenging projects, collaborate with a talented team, and contribute to the growth of our organization.

We offer competitive salaries, comprehensive benefits, and a dynamic work environment.

  • Big Data Developer

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are looking for a skilled Data Engineer to join our team. The ideal candidate will have experience in data engineering and a passion for Big Data.You will have the opportunity to participate in exciting and challenging projects, work with our exceptional team of Technology professionals, and contribute to the growth and development of our global,...

  • Big Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan Datamatics Technologies Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Datamatics TechnologiesJob Title: Big Data EngineerJob Summary:We are looking for a highly skilled Big Data Engineer to spearhead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark, Python,...

  • Big Data Software Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Scientist - Big DataWe are looking for a talented Data Scientist with expertise in big data engineering to join our team.The successful candidate will be responsible for designing, developing, and implementing data processing systems using big data technologies. This includes building robust and efficient solutions for managing and analyzing vast...

  • Big Data Engineer

    2 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time

    We are seeking an experienced Data Engineer to join our team.The ideal candidate will have a strong background in data engineering, particularly in big data environments on Azure's cloud platform.Job DescriptionThis is a mid-senior level full-time position that requires a bachelor's degree in computer science or a related field and 3-6 years of...

  • Senior Big Data Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...

  • Big Data Product Owner

    2 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    We are undertaking a Data Transformation and as data becomes fundamental to what we are doing, the ability to have the right data in the right place at the right time, that is accurate and consistent is essential.This role will play a really important central role within this evolving landscape, working alongside the Technology Team and the Product Owner to...

  • Senior Data Architect

    7 days ago

    Islamabad, Islamabad, Pakistan beBeeData Full time

    We are seeking a seasoned Big Data Engineer to spearhead the development of a scalable data platform.Job SummaryThe ideal candidate will have extensive experience with Kafka, Flink, Spark, Python, and Talend, along with expertise in Apache Ranger, Prometheus, and strong SQL skills.This role involves designing and implementing data pipelines, ensuring...

  • Senior Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan TenX Full time

    Join to apply for the Senior Data Engineer role at TenXSenior Talent Acquisition Executive @ TenX | 360° HR Resource | Scouting Talent | C-level Recruitment | Your hiring PartnerJOB SUMMARY:Data Engineers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. They should be able...

  • Data Engineer in Test

    2 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Join to apply for the Data Engineer in Test role at Confiz.We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.ResponsibilitiesWrite PySpark and SQL scripts to validate data pipelines, transformations, and integrations.Design and run tests for data validation,...

  • Senior ETL Data Architect

    2 days ago

    Islamabad, Islamabad, Pakistan beBeeData Full time

    About the JobJob Title: Senior ETL Data EngineerWe are seeking an experienced Senior ETL Data Engineer to design and develop robust data pipelines using modern Big Data technologies. This is a challenging opportunity for a talented individual who enjoys working with complex data systems and has hands-on expertise in ETL frameworks, distributed data...