Principal AI Evaluation Engineer

3 days ago

Hyderābād, Sindh, Pakistan Backbase Full time $150,000 - $200,000 per year


About Backbase

As a a Principal AI Evaluation Engineeryou will be leading the evaluation efforts in our AI-powered SDLC team. You will own the evaluation strategy for AI assistants and agentic workflows, ensuring they are reliable, observable, and safeguarded with strong guardrails. Beyond hands-on work, you will mentor engineers, lead triage and reporting, and make evaluation a cornerstone of release decisions.

Meet the job

  • Define and lead the evaluation strategy and roadmap for AI-powered SDLC core product

  • Build and oversee evaluation pipelines and guardrails.

  • Build and maintain evaluation datasets (synthetic and real project data) to benchmark AI behavior.

  • Analyze evaluation results, identify gaps, and produce clear, actionable reports for engineering and product stakeholders.

  • Build a culture of innovation and excellence, encouraging continuous improvement and adoption of best practices in AI evaluation and deployment.

  • Collaborate with cross-functional teams to integrate evaluation insights into development.

How about you?

  • Strong understanding of software engineering principles and the software development lifecycle (SDLC).

  • Hands-on experience with test design, test management, observability, and data analysis.

  • Proficiency in Python (or another scripting language) for automating evaluations.

  • Familiarity with AI Agent evaluation methods (faithfulness, answer relevancy, contextual accuracy, tool correctness).

  • Excellent analytical and problem-solving skills.

  • Strong communication and collaboration abilities, able to work with cross-functional teams and stakeholders.

  • Demonstrated ability to mentor engineering talent, fostering collaboration and technical excellence.

  • (Nice to have) Experience with evaluation frameworks, RAG systems, or agentic workflows.

  • Principal AI Application Security Engineer

    3 days ago

    Hyderābād, Sindh, Pakistan Backbase Full time 1,200,000 - 2,400,000 per year

    Principal AI Application Security EngineerThe job in short: keep millions of users and their banking data safe and secure.No day at Backbase is the same, and even more so for our security engineers. We all know that security and banking need to go hand in hand and with hackers and tech evolving by the day, you'll need to stay on your toes and ahead of the...

  • Principal AI Application Security Engineer

    3 days ago

    Hyderābād, Sindh, Pakistan Backbase Full time $120,000 - $200,000 per year

    keep millions of users and their banking data safe and secure.No day at Backbase is the same, and even more so for our security engineers. We all know that security and banking need to go hand in hand and with hackers and tech evolving by the day, you'll need to stay on your toes and ahead of the game.Your core responsibility is to ensure the delivery of...

  • Sr Principal Engineer

    1 day ago

    Hyderābād, Sindh, Pakistan c7ea811c-20a1-4f6f-9406-8e1274bec18a Full time $120,000 - $180,000 per year

    At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.Everything we do centers around...

  • Engineering Manager-AI/ML

    2 weeks ago

    Hyderābād, Sindh, Pakistan Egen Solutions Inc Full time 1,200,000 - 2,400,000 per year

    Job Description :We are seeking a highly motivated and experienced ML Manager/Lead Data Scientist to join our growing ML/GenAI team.You will play a key role in designing, developing and productionalizing ML/GenAI applications by evaluating models, training and/or fine tuning them. As a lead, you require a deep understanding of both machine learning...

  • Engineering Manager-AI/ML

    3 days ago

    Hyderābād, Sindh, Pakistan Egen Full time 900,000 - 1,200,000 per year

    Job Description :  We are seeking a highly motivated and experienced ML Manager/Lead Data Scientist to join our growing ML/GenAI team. You will play a key role in designing, developing and productionalizing ML/GenAI applications by evaluating models, training and/or fine tuning them. As a lead, you require a deep understanding of both machine learning...

  • ai/ml

    1 week ago

    Hyderābād, Sindh, Pakistan Tata Consultancy Services (TCS) Full time $100,000 - $150,000 per year

    4+ years of experience in AI/MLPython, FastAPI, Cloud (/GCP), Langchain, LangGraph/CrewAI , Docker/Kubernetes, Classic ML/deep learning/Gen AI technologies, LLMs, NLP, Multi-agent frameworks, Evaluation metrics and Analysis of LLM, ADK, MCP etcHands-on experience in delivering production-grade AI/ML projectsExperience with deploying AI/ML models in...

  • Staff AI/ML Engineer

    3 days ago

    Hyderābād, Sindh, Pakistan Genesys Full time 2,000,000 - 2,500,000 per year

    locationsHyderabad (Flexible)time typeFull timeposted onPosted Todayjob requisition idJR108538Genesys empowers organizations of all sizes to improve loyalty and business outcomes by creating the best experiences for their customers and employees. Through Genesys Cloud, the AI-powered Experience Orchestration platform, organizations can accelerate growth by...

  • Engineering Manager

    3 days ago

    Hyderābād, Sindh, Pakistan Backbase Full time 1,200,000 - 2,400,000 per year

    The Job in shortWe are seeking an experienced Software Engineering Manager to lead high-performing, cross-functional development teams. This role combines technical expertise, delivery excellence, and people leadership to ensure teams build robust, scalable software aligned with business objectives.As an AI-native leader, you will be pivotal in driving AI...

  • Principal Consultant

    3 days ago

    Hyderābād, Sindh, Pakistan TTEC Digital Full time 1,200,000 - 2,400,000 per year

    TTEC Digital is seeking a Principal Consultant AWS to join our team. We are just as passionate about the relentless pursuit of Customer Success by providing ideal solutions to solving our client's business problems by driving customer experience outcomes with our enhanced technical capabilities as you are. What You'll Be Doing: As a Principal AWS...

  • Senior Software Engineer, AI/ML

    3 days ago

    Hyderābād, Sindh, Pakistan ValGenesis Full time $120,000 - $180,000 per year

    About ValGenesis  ValGenesis is a leading digital validation platform provider for life sciences companies. ValGenesis suite of products are used by 30 of the top 50 global pharmaceutical and biotech companies to achieve digital transformation, total compliance and manufacturing excellence/intelligence across their product lifecycle.    Learn more about...