Senior Big Data Architect

6 days ago

Islamabad, Islamabad, Pakistan beBee Careers Full time

We are seeking a skilled Big Data Engineer to lead the development of a scalable data platform.

Job Description

This is a highly technical role that involves designing and implementing data pipelines, ensuring security, monitoring system performance, and collaborating with cross-functional teams to deliver high-performance data solutions.

  1. Design, develop, and optimize a Big Data Platform leveraging Kafka, Flink, Spark, and Talend.
  2. Architect and implement real-time and batch data processing pipelines.
  3. Ensure secure data access and governance using Apache Ranger.
  4. Monitor and optimize system performance with Prometheus.
  5. Develop and maintain ETL workflows and data ingestion pipelines.
  6. Write efficient and scalable SQL queries for data transformation and analysis.
  7. Collaborate with Data Scientists, Analysts, and DevOps teams to align data infrastructure with business goals.
  8. Implement data security, compliance, and access control policies.
  9. Troubleshoot and resolve issues related to data processing, storage, and system performance.
Requirements
  • 5+ years of experience in Big Data Engineering.
  • Hands-on expertise in Kafka, Flink, Spark, Python, and Talend.
  • Strong proficiency in SQL, with experience in query optimization and performance tuning.
  • Familiarity with Apache Ranger for data security and access control.
  • Familiarity with Prometheus for monitoring and performance optimization.
  • Deep understanding of distributed computing, data partitioning, and pipeline orchestration.
  • Experience with cloud-based big data solutions (AWS, Azure, or GCP) is a plus.
  • Strong problem-solving and analytical skills.
  • Excellent communication and leadership abilities.
Preferred Qualifications
  • Experience with Docker, Kubernetes, and containerized big data deployments.
  • Knowledge of workflow orchestration tools like Airflow.
  • Hands-on experience with NoSQL databases (e.g., Cassandra, HBase).
Job Details

Mid-Senior level position, Full-time employment, Engineering and Information Technology industry.

  • Data Architect

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to spearhead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark, Python, and Talend, along with expertise in Apache Ranger, Prometheus, and strong SQL skills.Main Responsibilities:Design, develop, and...

  • Senior Big Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Big Data ArchitectWe are seeking an experienced Data Architect to join our team of analytics experts. This individual will be responsible for designing and optimizing data and data pipeline architecture, as well as enhancing data flow and collection for cross-functional teams.Main ResponsibilitiesCreate and maintain optimal data pipeline architecture that...

  • Sr Big Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Datamatics Technologies Full time

    Direct message the job poster from Datamatics TechnologiesTalent Acquisition Lead | Global Technical Recruitment | Technical Recruitment | EMEA & MENAJob Summary:We are looking for a highly skilled Big Data Engineer to spearhead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark,...

  • Senior Big Data Solutions Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are seeking a seasoned Data Architect to join our team of analytics experts. The successful candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams.Key ResponsibilitiesCreate and maintain optimal data pipeline architecture to ensure...

  • Data Infrastructure Architect

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Big Data EngineerAbout the RoleWe are seeking a highly skilled Big Data Engineer to lead the development of a scalable Big Data Platform. This individual will have extensive experience with Kafka, Flink, Spark, Python, and Talend, along with expertise in Apache Ranger, Prometheus, and strong SQL skills.Main ResponsibilitiesData Platform Development: Design,...

  • Big Data Engineering Expert

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    A Senior Big Data Engineer is required to design and develop complex ETL jobs and pipelines using Big Data technologies. The ideal candidate will have over 4 years of experience in Data Engineering, with expertise in designing and developing large-scale ETL pipelines using tools such as Python, Hadoop, Spark, and Hive.Requirements:Strong software development...

  • Senior Data Architect

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Architecture Position SummaryWe are seeking an experienced Data Architect to lead the development and implementation of our organization's data strategy. The successful candidate will have a deep understanding of data architecture principles and be able to design and implement scalable, secure, and reliable data systems that meet the needs of our...

  • Data Architect Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Architect Engineer - Cloud Data SolutionsWe are seeking a highly skilled Data Architect Engineer to design and develop large-scale cloud data solutions. The ideal candidate will have a strong background in Python, SQL, PySpark, Azure, Databricks, and DevOps.About the RoleThis is a remote contract position responsible for designing, building, and...

  • Big Data Systems Developer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job OverviewAs a Big Data Engineer, you will play a key role in designing, developing, and implementing large-scale data processing systems. Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing vast amounts of data.

  • Senior IT Director

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    As a Sr. Executive IT, you will be responsible for designing and developing ETL pipelines, investigating unusual patterns, and fixing data quality issues. You will also provide operational support and lead data engineering initiatives as a technical lead for big data platform projects.Eligibility Criteria:Bachelor's degree or above in Computer...