Big Data Engineering Manager

3 days ago

Karachi, Sindh, Pakistan beBee Careers Full time
We are seeking a highly skilled Senior Big Data Specialist/Analyst to lead our innovative team. This role emphasizes the design, build, and maintenance of complex data pipelines, integrating data from multiple microservices, and creating actionable dashboards for senior management.

The ideal candidate will have expertise in AIOps processes and procedures, open-source technologies, and cloud-based LLMs and AI models for automation, optimization, and real-time insights. They will also be able to leverage data visualization tools like Tableau or Power BI to create visually engaging dashboards.

Key Responsibilities:
  1. Data Pipeline Management: Design, build, and maintain automated data pipelines to collect, process, and analyze data from various microservices.
  2. Dashboard Creation and Maintenance: Develop visually engaging dashboards using data visualization tools like Tableau or Power BI.
  3. Data Integration and Consolidation: Aggregate, integrate, and cleanse data from distributed systems and microservices into centralized repositories.
  4. Data Analysis and Reporting: Analyze large datasets to uncover trends, patterns, and actionable insights using AI and machine learning models.

Qualifications and Skills:

Mandatory Qualifications:

  1. Diploma in AIOps (RQF Level 6) or BSc/MSc in Data Science, Computer Science, or a related field.
  2. Minimum 5+ years of experience in Big Data engineering, data analysis, or similar roles.

Technical Expertise:

  1. Proficiency in Big Data frameworks such as Hadoop, Spark, Kafka, or Flink.
  2. Experience with data pipeline tools integrated with AIOps monitoring and orchestration.
  3. Advanced SQL and familiarity with NoSQL databases.
  4. Hands-on experience with data visualization tools like Tableau or Power BI.

What We Offer:
  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge technologies, AIOps, and AI-driven projects.
  • Collaborative and supportive team environment.
  • Professional development and growth opportunities.
  • Relocation opportunities based on senior management discretion.

  • Big Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    This role requires a Bachelor's degree in Computer Science, Engineering, or a related field, with a Master's degree preferred.We are seeking an experienced Senior Data Engineer to lead our team and design data solutions that meet business needs.Key ResponsibilitiesDevelop and maintain scalable data pipelines and ETL processes for improved performance and...

  • Big Data Pipeline Developer

    6 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    About the RoleWe are looking for a Big Data Pipeline Developer to join our team. As a Big Data Pipeline Developer, you will design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.Key ResponsibilitiesDesign and implement data storage solutions, including data lakes, data warehouses, and...

  • Big Data Developer

    6 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Big Data DevelopmentWe are looking for a skilled Big Data Developer to join our team. The ideal candidate will have experience in working with large datasets, designing data pipelines, and collaborating with stakeholders.Key Responsibilities:Assemble complex data sets using various tools and technologies.Develop analytics tools to provide insights into key...

  • Big Data Strategist and Analytics Leader

    7 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Job Summary:We are seeking a highly skilled Senior Big Data Specialist/Analyst to lead our innovative team.This role is crucial for managing complex data pipelines, integrating data from multiple microservices, and creating actionable dashboards for senior management.The position emphasizes leveraging AIOps processes and procedures, open-source technologies,...

  • Lead Azure Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Minhas Technologies Full time

    Freelance IT Recruiter | Talent Acquisition Partner | People ServicesJob Description:We are looking for a highly skilled Python Core Engineer with expertise in Azure Data Engineering. The ideal candidate should have:Strong Python core engineering experience (not just development).Hands-on experience with Azure data engineering tools and services.Proficiency...

  • Data Engineer Lead

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Bachelor's degree in Computer Science, Engineering, or a related field is preferred for this role.We are seeking an experienced Senior Data Engineer with 7 years of experience to architect data solutions.ResponsibilitiesDesign and develop scalable data pipelines and ETL processes for improved performance and efficiency.Collaborate with cross-functional teams...

  • Data Engineering Specialist

    6 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.Key ResponsibilitiesDesign and implement real-time data streaming and batch processing solutions to support diverse business needsBuild and...

  • Senior Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...

  • Senior Data Infrastructure Engineer

    6 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Job DescriptionThe Senior Data Infrastructure Engineer will be responsible for designing, developing, and maintaining large-scale data systems and pipelines to meet the needs of our organization.Main ResponsibilitiesDevelop and maintain scalable data pipelines using ETL/ELT processesImplement data quality checks, validation processes, and monitoring...

  • Data Engineer

    6 days ago

    Karachi, Sindh, Pakistan Office Field Full time

    Job Title: Data EngineerOffice Field is looking for a Data Engineer to join our growing team. Get AI-powered advice on this job and access more exclusive features.Responsibilities:Create and maintain optimal data pipeline architecture.Assemble large, complex data sets that meet business requirements.Evaluate data flows and prepare ETL processing based on...