Senior Big Data Specialist/Analyst

Position Overview:

We are seeking a highly skilled and experienced Senior Big Data Specialist/Analyst to join our innovative team. This role is crucial for managing complex data pipelines, integrating data from multiple microservices, and creating actionable dashboards for senior management. The position emphasizes leveraging AIOps processes and procedures, open-source technologies, and cloud-based LLMs and AI models for automation, optimization, and real-time insights.

Candidates with a Diploma in AIOps (RQF Level 6) from Al Nafi, particularly those with Merit or Distinction and who have completed all Al Razzaq program requirements, will be exempted from the 5+ years of experience requirement and given high priority. This role also offers opportunities for relocation to overseas locations such as the UK or Canada, at the discretion of senior management.

Key Responsibilities:

1. Data Pipeline Management:
   Design, build, and maintain robust, automated AIOps-driven data pipelines to collect, process, and analyze data from various microservices.
   Ensure data integrity, accuracy, and timeliness using one-source tools and proactive monitoring.
   Leverage AIOps capabilities for self-healing pipelines, issue detection, and performance optimization.
2. Dashboard Creation and Maintenance:
   Develop visually engaging, AI-enhanced dashboards using Tableau, Power BI, or Looker.
   Integrate dashboards with LLMs and AI models for predictive analytics and real-time insights.
   Regularly update dashboards to reflect the latest business metrics, KPIs, and trends for senior management decision-making.
3. Data Integration and Consolidation:
   Aggregate, integrate, and cleanse data from distributed systems and microservices into centralized repositories.
   Implement ETL/ELT processes using AIOps automation tools to standardize data for analysis and visualization.
   Utilize real-time data streaming technologies like Kafka or Flink to enable continuous updates and advanced scalability.
4. Data Analysis and Reporting:
   Analyze large datasets to uncover trends, patterns, and actionable insights using AI and machine learning models.
   Collaborate with cross-functional teams to translate business needs into technical solutions.
   Provide predictive and prescriptive analytics using AIOps-enhanced frameworks.
5. Technical Leadership:
   Stay updated on the latest Big Data technologies, AIOps frameworks, and best practices.
   Mentor junior team members on Big Data analytics, AIOps, and AI-driven tools.
   Contribute to strategic planning for cloud-native, AI-driven data infrastructure initiatives.

Qualifications and Skills:

Mandatory Qualifications:

1. Diploma in AIOps (RQF Level 6) or BSc/MSc in Data Science, Computer Science, or a related field.
2. Diploma in AIOps from Al Nafi, with Merit or Distinction, and completion of all Al Razzak program requirements will be given high priority and exempted from the 5+ years of experience requirement.
3. For non-AIOps diploma holders: Minimum of 5+ years of experience in Big Data engineering, data analysis, or similar roles.

Technical Expertise:

1. Proficiency in Big Data frameworks such as Hadoop, Spark, Kafka, or Flink.
2. Experience with data pipeline tools (e.g., Apache Airflow, AWS Glue) integrated with AIOps monitoring and orchestration.
3. Advanced SQL and familiarity with NoSQL databases.
4. Hands-on experience with data visualization tools like Tableau, Power BI, or Looker.
5. Strong programming skills in Python, Scala, or Java, with experience in AI and ML model integration.
6. Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.

Preferred Qualifications:

1. Expertise in integrating data from microservices architectures using AIOps tools.
2. Strong knowledge of open-source technologies for data analytics and cloud solutions.
3. Knowledge of machine learning, predictive analytics, and AI models for decision support.
4. Experience with one-source tools to ensure seamless data integration and consistency.

Soft Skills:

1. Strong analytical, problem-solving, and organizational abilities.
2. Effective communication for presenting technical insights to non-technical stakeholders.

What We Offer:

1. Competitive salary and benefits package.
2. Opportunity to work on cutting-edge technologies, AIOps, and AI-driven projects.
3. Collaborative and supportive team environment.
4. Professional development and growth opportunities.
5. Relocation opportunities to the UK or Canada based on senior management discretion.

To Apply: alnafi.com/career

Seniority level: Mid-Senior level

Employment type: Full-time

Job function: Information Technology

Industries: E-Learning Providers