Expert Inference Architect

3 days ago

Hyderabad City Taluka, Pakistan beBeeInference Full time $180,000 - $300,000
Cloud Computing Professional

Transform Your Career in Cloud Computing

Are you looking for a challenging opportunity to drive innovation and simplicity in cloud computing? Do you thrive in fast-paced environments and have a passion for making a difference?

About the Role:

  • Design and implement distributed inference platforms for optimized model serving.
  • Optimize runtime and infrastructure layers for best model performance.
  • Develop novel techniques for serving custom models and scale the platform globally.
  • Contribute to open source inference engines to improve their performance on DigitalOcean cloud.
  • Build tooling and observability for system health monitoring and auto-tuning capabilities.
  • Develop benchmarking frameworks for model serving performance testing.
  • Mentor engineers on inference systems, GPU infrastructure, and distributed inference best practices.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field.
  • Experience building distributed systems with Kubernetes, gRPC, Go, Python.
  • Experience with GPU programming using CUDA, ROCm.
  • Knowledge of L3-L7 network protocols, block storage, object storage.
  • Proven track record defining and achieving performance KPIs (latency, throughput, cost).

Preferred Qualifications:

  • Experience with one or more inference engines: vLLM, SGLang, Modular.
  • Familiarity with one or more distributed inference serving frameworks - llm-d, NVIDIA dynamo, Ray Serve.
  • Knowledge of distributed inference optimization techniques - tensor/data parallelism, KV cache optimizations, smart routing.
  • Familiarity with common LLM architectures and inference optimization techniques.
  • Experience with GPU Interconnect technologies like NVlink, XGMI, RoCE.
  • Open source contributions to inference libraries, frameworks, model kernels.

  • Expert Solutions Architect

    3 days ago

    Hyderabad City Taluka, Pakistan beBeeArchitecture Full time $100,000 - $120,000

    Strategic IT ArchitectThis pivotal role will play a transformative part in the Enterprise Service Management function, focusing on architecting and optimizing IT Operations Management (ITOM), IT Asset Management (ITAM), and foundational data structures within the ServiceNow platform.The successful candidate will have deep expertise in ServiceNow's ITOM and...

  • Commercetools Architect

    5 days ago

    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    Join to apply for the Commercetools Architect role at GSPANN Technologies, Inc2 months ago Be among the first 25 applicantsJoin to apply for the Commercetools Architect role at GSPANN Technologies, IncGet AI-powered advice on this job and more exclusive features.Commercetools, Elastic Path, Node, TypeScript, React, Cloud Technologies (Azure/AWS/GCP),...

  • Expert AI Solutions Architect Wanted

    6 days ago

    Hyderabad City Taluka, Pakistan beBeeAI Full time $180,000 - $220,000

    Job DescriptionThe Senior Staff, AI Solutions Architect will occupy a vital position focusing on architecting and realizing value of the comprehensive AI feature set within ServiceNow. Based in Hyderabad, this role reports directly to the Sr. Dir, Platform Architecture.As a pivotal figure in the AI Solutions team, the Senior Staff, AI Solutions Architect...

  • Senior Enterprise IT Service Management Architect

    3 days ago

    Hyderabad City Taluka, Pakistan beBeeSolution Full time $100,000 - $170,000

    Enterprise IT Service Management ArchitectWelcome to a role that will have you shape the strategic vision and technical roadmap for IT Service Management (ITSM) products on the Enterprise Service Management (ESM) Platform. As Staff Solution Architect, you will play a pivotal role in this process.This position requires strong expertise in ServiceNow,...

  • Staff, Solution Architect ITSM

    1 week ago

    Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Your New RoleYour role title: Staff, Solution Architect ITSM will play a vital role in shaping the strategic vision and technical roadmap for IT Service Management (ITSM) products on the Enterprise Service Management (ESM) Platform (ServiceNow). This role will be based in Hyderabad and report...

  • Data Architect

    1 week ago

    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    OverviewData Architect, ETL, Data Engineer, Python, SQLGSPANN is hiring a Data Architect for their data platform. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.Location: Gurugram / Hyderabad / PuneRole Type: Full TimePublished On: 26 September 2024Experience: 8+ YearsRole and...

  • Big Data Solutions Expert

    3 days ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 6,000,000 - 8,000,000

    Job Title: Data ArchitectWe are seeking a seasoned Data Architect to design, build, and optimize scalable data pipelines and architectures.Key Responsibilities:Design and implement data models and integrate data from multiple sources.Develop robust ETL/ELT pipelines and ensure seamless data flow.Leverage backend engineering skills to support API integrations...

  • Advanced AI Solutions Architect

    3 days ago

    Hyderabad City Taluka, Pakistan beBeeArtificial Full time $120,000 - $180,000

    Job Description: The role of a Senior AI Solutions Engineer involves designing, developing, and deploying advanced artificial intelligence solutions that exhibit autonomous, proactive, and adaptive behaviors. This position requires a deep understanding of AI/ML technologies, integration, automation experience and solution architecture, combined with strong...

  • Oracle Cloud Architect

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBeeTechnical Full time

    Senior Oracle Cloud Technical Lead Job DescriptionWe are seeking a seasoned Senior Oracle Cloud Technical Lead to join our dynamic team. This role is designed for a certified Oracle Technical professional who is proficient in architecting, designing, implementing, and developing various Oracle SaaS, PaaS, and IaaS solutions.About the RoleThis position...

  • Expert Product Information Systems Architect

    3 days ago

    Hyderabad City Taluka, Pakistan beBeeProductInformationManagement Full time $125,000 - $175,000

    Job DescriptionWe are seeking a Product Information Management (PIM) Architect with strong technical skills and leadership abilities to lead our product information management initiatives. The ideal candidate will have extensive experience in designing and implementing efficient product information systems.Key Responsibilities:Collaborate with clients to...