Senior Big Data Engineer

2 days ago

Islamabad, Islamabad, Pakistan beBee Careers Full time
Big Data Architect

We are seeking an experienced Data Architect to join our team of analytics experts. This individual will be responsible for designing and optimizing data and data pipeline architecture, as well as enhancing data flow and collection for cross-functional teams.

Main Responsibilities
  • Create and maintain optimal data pipeline architecture that aligns with business requirements.
  • Assemble large, complex data sets that meet the needs of various stakeholders.
  • Identify opportunities for process improvements: automate manual processes, optimize data delivery, redesign infrastructure for scalability.
  • Build robust infrastructure for data extraction, transformation, and loading using SQL and cloud 'big data' technologies.
  • Develop analytics tools to provide valuable insights into customer acquisition, operational efficiency, and key performance metrics.
  • Collaborate with stakeholders to address technical issues related to data and support data infrastructure needs.
Key Requirements
  • Minimum 10+ years of experience in design & development, with at least 6 years in big data technologies.
  • Proficient in object-oriented or functional languages such as Python, Java, Scala.
  • Experience with big data tools like Spark, Kafka.
  • Experience with relational SQL and NoSQL databases.
  • Experience with data pipeline and workflow management tools like Airflow.
  • Experience with cloud data analytic services (GCP/Azure/AWS).
  • Experience with stream-processing systems like Spark-Streaming, Flink.
  • Knowledge of data quality assurance and unit testing in big data pipelines.
  • Strong SQL analytical skills and experience with various databases.
  • Experience in building and optimizing big data pipelines and architectures.
  • Ability to perform root cause analysis and identify process improvements.
  • Knowledge of security practices in data computing, including encryption.
  • Strong analytical skills working with unstructured datasets.
  • Experience manipulating large datasets and supporting cross-functional teams.

  • Senior Big Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...

  • Big Data Engineering Expert

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    A Senior Big Data Engineer is required to design and develop complex ETL jobs and pipelines using Big Data technologies. The ideal candidate will have over 4 years of experience in Data Engineering, with expertise in designing and developing large-scale ETL pipelines using tools such as Python, Hadoop, Spark, and Hive.Requirements:Strong software development...

  • Sr Big Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan Datamatics Technologies Full time

    Direct message the job poster from Datamatics TechnologiesTalent Acquisition Lead | Global Technical Recruitment | Technical Recruitment | EMEA & MENAJob Summary:We are looking for a highly skilled Big Data Engineer to spearhead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark,...

  • Senior Big Data Tester

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Senior Big Data TesterWe are seeking an experienced Senior Big Data Tester to join our team. In this role, you will be responsible for designing and executing tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory. You will collaborate with development teams to assess changes in data workflows and...

  • Big Data Architect

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job TitleA Big Data Engineer plays a crucial role in designing, developing, and implementing large-scale data processing systems.

  • Senior IT Director

    5 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    As a Sr. Executive IT, you will be responsible for designing and developing ETL pipelines, investigating unusual patterns, and fixing data quality issues. You will also provide operational support and lead data engineering initiatives as a technical lead for big data platform projects.Eligibility Criteria:Bachelor's degree or above in Computer...

  • Data Architect

    23 minutes ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to spearhead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark, Python, and Talend, along with expertise in Apache Ranger, Prometheus, and strong SQL skills.Main Responsibilities:Design, develop, and...

  • Big Data Systems Developer

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job OverviewAs a Big Data Engineer, you will play a key role in designing, developing, and implementing large-scale data processing systems. Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing vast amounts of data.

  • Big Data Architect

    3 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Join to apply for the Big Data Architect role at ConfizWe are looking for a savvy Data Architect to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams.ResponsibilitiesCreate and maintain optimal...

  • Senior Data Architect

    6 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are seeking an experienced Senior Big Data Engineer with a strong passion for data engineering and a solid background in Big Data technologies. The ideal candidate will have more than 4 years of experience specifically in Data Engineering, with expertise in designing and developing large-scale ETL pipelines using tools such as Python, Hadoop, Spark, and...