Advanced Cloud Inference Specialist

1 day ago

Bahawalpur City Tehsil, Pakistan beBeeInference Full time $120,000 - $183,990
Software Engineer Position

This is a software engineer position at a cloud computing company. The ideal candidate will have experience building distributed systems with Kubernetes, gRPC, golang, and python.

Key Responsibilities:
  • Design and implement a distributed inference platform for serving large language models.
  • Optimize the runtime and infrastructure layers of the inference stack for best model performance.
  • Build native cross-platform inference support across NVIDIA and AMD GPUs for a variety of model architectures.
  • Contribute to open-source inference engines to make them perform better on the cloud.
  • Build tooling and observability to monitor system health and build auto-tuning capabilities.
  • Build benchmarking frameworks to test model-serving performance to guide system and infrastructure tuning efforts.
  • Mentor engineers on inference systems, GPU infrastructure, and distributed inference best practices.
Requirements:
  • Bachelor's or Master's in Computer Science, Electrical Engineering, or a related field.
  • Experience building distributed systems with Kubernetes, gRPC, golang, and python.
  • Experience with GPU programming with CUDA, ROCm.
  • Experience with L3-L7 network protocols, block storage, object storage.
  • Experience with building multi-tenant systems - identity management, tenant isolation etc.
  • Proven track record defining and achieving performance KPIs (latency, throughput, cost).
Preferred Qualifications:
  • Experience with one or more inference engines: vLLM, SGLang, Modular etc.
  • Familiarity with one or more distributed inference serving frameworks - llm-d, NVIDIA dynamo, Ray Serve etc.
  • Knowledge of distributed inference optimization techniques - tensor/data parallelism, KV cache optimizations, smart routing etc.
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization etc).
  • Experience with GPU Interconnect technologies like NVlink, XGMI, RoCE.
  • Open source contributions to inference libraries, frameworks, model kernels etc.

  • Expert Inference Architect

    5 days ago

    Hyderabad City Taluka, Pakistan beBeeInference Full time $180,000 - $300,000

    Cloud Computing ProfessionalTransform Your Career in Cloud ComputingAre you looking for a challenging opportunity to drive innovation and simplicity in cloud computing? Do you thrive in fast-paced environments and have a passion for making a difference?About the Role:Design and implement distributed inference platforms for optimized model serving.Optimize...

  • Cloud Computing Expert

    1 day ago

    Quetta City Tehsil, Pakistan beBeeCloudComputing Full time $150,000 - $200,000

    Job Title: Cloud Computing ExpertDescriptionWe are seeking a skilled professional to drive the design, optimization, and scaling of our inference systems. The ideal candidate will build systems for optimized inference serving of well-known open-source/open-weights models, develop novel techniques for serving custom models, and scale the platform to handle...

  • Advanced Cloud Solutions Specialist

    5 days ago

    Hyderabad City Taluka, Pakistan beBeeCloud Full time 900,000 - 1,200,000

    Job OverviewA challenging and dynamic role that offers a unique opportunity for professional growth.We seek an experienced Senior Consultant Specialist to provide expert guidance and support to clients in the field of cloud technology.Key Responsibilities:Expertise in public cloud IaaS, PaaS and SaaS tools and environments, particularly with Google Cloud...

  • Cloud Infrastructure Specialist

    1 day ago

    Bahawalpur City Tehsil, Pakistan beBeeCloud Full time $133,000

    Cloud Infrastructure SpecialistWe are seeking a skilled Cloud Infrastructure Specialist to join our team. As a key member of our infrastructure team, you will be responsible for ensuring the scalability, security, and uptime of our cloud infrastructure.Key ResponsibilitiesManage Kubernetes clusters, right-size nodes, and streamline upgrades to maintain high...

  • Cloud Automation Specialist

    1 day ago

    Bahawalpur City Tehsil, Pakistan beBeeAutomation Full time 1,200,000 - 1,500,000

    Job Title: Cloud Automation SpecialistThis role involves designing and implementing automation tools to streamline software development, testing, and deployment processes. The ideal candidate will have a strong understanding of cloud infrastructure, DevOps practices, and agile methodologies.Key Responsibilities:Implement CI/CD pipelines to automate testing,...

  • Cloud Infrastructure Specialist

    1 day ago

    Peshawar City Tehsil, Pakistan beBeeCloudInfrastructure Full time $80,000 - $124,000

    Cloud Infrastructure SpecialistWe are seeking an accomplished Cloud Infrastructure Specialist to lead the implementation and management of our cloud-based infrastructure. This pivotal role offers the chance to leverage cutting-edge technologies, champion automation, and enhance infrastructure resilience across diverse cloud environments.This position is...

  • Cloud Platform Specialist

    1 day ago

    Quetta City Tehsil, Pakistan beBeeDevops Full time $80,000 - $120,000

    Cloud Platform SpecialistWe are seeking a highly skilled Cloud Platform Specialist to design, build and maintain automated deployment pipelines. The ideal candidate will have strong experience with cloud platforms, scripting languages, containerization technologies and infrastructure as code tools.

  • Advanced Technical Support Professional

    1 day ago

    Bahawalpur City Tehsil, Pakistan beBeeCloud Full time $60,000 - $80,000

    Deliver exceptional customer experiences via email, live chat, and other support channels.Job RequirementsExperience as a hosting specialist or equivalent role with strong technical acumen.Familiarity with Linux-based servers, virtualization, and control panel software such as cPanel/WHM.Technical awareness and ability to quickly grasp new technologies,...

  • Software Innovation Leader

    1 day ago

    Peshawar City Tehsil, Pakistan beBeeEngineer Full time $150,600 - $178,200

    Senior Software Engineer OpportunityJob Description:As a Senior Software Engineer, you will play a key role in driving the design, optimization, and scaling of our inference systems. You will build systems for optimized inference serving of well-known open-source models, develop novel techniques for serving custom models, and scale the platform to handle...

  • Cloud Infrastructure Specialist

    1 day ago

    Bahawalpur City Tehsil, Pakistan beBeeDevops Full time $80,000 - $160,000

    Cloud Engineer RoleThis position is pivotal in leveraging cutting-edge technologies to champion automation and enhance infrastructure resilience across diverse cloud environments.The ideal candidate will design, implement, and continuously improve Continuous Integration & Deployment (CI/CD) pipelines tailored for multi-cloud and Kubernetes-centric...