Data Infrastructure Architect

2 days ago

Islamabad, Islamabad, Pakistan beBee Careers Full time

Big Data Engineer

About the Role

We are seeking a highly skilled Big Data Engineer to lead the development of a scalable Big Data Platform. This individual will have extensive experience with Kafka, Flink, Spark, Python, and Talend, along with expertise in Apache Ranger, Prometheus, and strong SQL skills.

Main Responsibilities
  • Data Platform Development: Design, develop, and optimize a Big Data Platform leveraging Kafka, Flink, Spark, and Talend.
  • Data Pipelines Architecture: Architect and implement real-time and batch data processing pipelines.
  • Data Security: Ensure secure data access and governance using Apache Ranger.
  • System Performance Monitoring: Monitor and optimize system performance with Prometheus.
  • ETL Workflows: Develop and maintain ETL workflows and data ingestion pipelines.
  • SQL Query Optimization: Write efficient and scalable SQL queries for data transformation and analysis.
  • Cross-Functional Collaboration: Collaborate with Data Scientists, Analysts, and DevOps teams to align data infrastructure with business goals.
  • Data Compliance: Implement data security, compliance, and access control policies.
  • Troubleshooting: Troubleshoot and resolve issues related to data processing, storage, and system performance.
Requirements
  • Big Data Engineering Experience: 5+ years of experience in Big Data Engineering.
  • Technical Expertise: Hands-on expertise in Kafka, Flink, Spark, Python, and Talend.
  • SQL Skills: Strong proficiency in SQL, with experience in query optimization and performance tuning.
  • Data Security Knowledge: Familiarity with Apache Ranger for data security and access control.
  • Prometheus Expertise: Familiarity with Prometheus for monitoring and performance optimization.
  • Distributed Computing Understanding: Deep understanding of distributed computing, data partitioning, and pipeline orchestration.
  • Cloud-Based Solutions: Experience with cloud-based big data solutions (AWS, Azure, or GCP) is a plus.
  • Soft Skills: Strong problem-solving and analytical skills, excellent communication and leadership abilities.
Seniority Level

Mid-Senior level

Employment Type

Full-time

Job Function

Engineering and Information Technology

Industry

IT Services and IT Consulting

  • Cloud Infrastructure Architect

    4 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    As a key member of our team, you will be responsible for architecting, implementing, and managing cloud infrastructure on AWS to support our data-driven operations. Your expertise in designing scalable, secure, and resilient systems will enable us to deliver seamless technology experiences.Key Responsibilities:Architect and maintain cloud infrastructure on...

  • Data Infrastructure Specialist

    5 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Engineering LeadJob Overview:A key position within our organization, the Data Engineering Lead will oversee the development and maintenance of our data infrastructure. This role requires expertise in designing, building, and scaling data pipelines as well as managing technical data products for client reporting.Key Responsibilities:- Lead and mentor a...

  • Big Data Architect

    3 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Join to apply for the Big Data Architect role at ConfizWe are looking for a savvy Data Architect to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams.ResponsibilitiesCreate and maintain optimal...

  • Cloud Infrastructure Architect

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    **Sr. Cloud Solutions Designer**ResponsibilitiesCloud Platforms:In-depth knowledge and hands-on experience with Microsoft Azure services, including compute, storage, networking, databases, and security.Familiarity with Google Cloud Platform services such as Compute Engine, Cloud Storage, VPC, BigQuery, and Kubernetes Engine.Familiarity with Amazon Web...

  • Cloud Solutions Architect

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    **Cloud Infrastructure Architect Role**Job OverviewWe are seeking a highly skilled Cloud Infrastructure Architect to spearhead the design and implementation of cloud-native solutions.This role requires expertise in Microsoft Azure, Google Cloud Platform, and Amazon Web Services, as well as strong familiarity with CPG/FMCG business and data.The successful...

  • Data Architect Engineer

    2 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Architect Engineer - Cloud Data SolutionsWe are seeking a highly skilled Data Architect Engineer to design and develop large-scale cloud data solutions. The ideal candidate will have a strong background in Python, SQL, PySpark, Azure, Databricks, and DevOps.About the RoleThis is a remote contract position responsible for designing, building, and...

  • Data Solutions Architect

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Cloud Data ArchitectWe are seeking an experienced professional to design and implement a scalable cloud-based data solution for managing large volumes of data. This role involves working with various stakeholders to gather requirements, build robust data pipelines, and ensure seamless integration with financial planning and analysis processes.Key...

  • Azure Data Architect

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Azure Data ArchitectThis role requires a professional to architect and implement data solutions using Azure services.Responsibilities:Design and implement data warehouses using Azure Synapse Analytics.Develop data pipelines and workflows using Azure Data Factory.Implement data security and governance using Azure Active Directory and Azure Policy.Collaborate...

  • Data Architect

    3 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Join to apply for the Data Architect role at Confiz.We seek an experienced Data Architect with 8+ years of experience to design and implement scalable, secure data solutions. Must have expertise in Azure, data modeling, governance, and integration, with strong strategic and leadership skills.ResponsibilitiesDesign and implement scalable, secure, and...

  • Data Architect Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job OverviewWe are seeking an experienced Data Architect to design and implement a scalable data solution for managing large volumes of data from SAP ERP systems. This role allows the candidate to work in a hybrid environment with flexibility to work remotely and on-site as needed.