Cloud Software Architect

2 days ago

Saddar Town, Pakistan beBeeSoftware Full time $150,000 - $200,000

Seeking a seasoned software engineer to spearhead the development and optimization of our inference systems. The ideal candidate will have expertise in designing and implementing distributed inference platforms, optimizing runtime and infrastructure layers for optimal model performance, and building native cross-platform inference support across NVIDIA and AMD GPUs.

Key Responsibilities:
  • Design and implement a distributed inference platform for serving large language models
  • Optimize runtime and infrastructure layers of the inference stack for best model performance
  • Build native cross-platform inference support across NVIDIA and AMD GPUs for various model architectures
  • Contribute to open-source inference engines to improve their performance on DigitalOcean cloud
  • Develop tooling and observability to monitor system health and build auto-tuning capabilities
  • Build benchmarking frameworks to test model-serving performance and guide system and infrastructure tuning efforts
  • Mentor engineers on inference systems, GPU infrastructure, and distributed inference best practices
Requirements:
  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or related field
  • Experience in building distributed systems with Kubernetes, gRPC, Go, Python, and GPU programming with CUDA, ROCm
  • Experience with L3-L7 network protocols, block storage, object storage, and multi-tenant systems - identity management and tenant isolation
  • Proven track record defining and achieving performance KPIs (latency, throughput, cost)
Preferred Qualifications:
  • Experience with one or more inference engines: vLLM, SGLang, Modular etc
  • Familiarity with one or more distributed inference serving frameworks - llm-d, NVIDIA dynamo, Ray Serve etc
  • Knowledge of distributed inference optimization techniques - tensor/data parallelism, KV cache optimizations, smart routing etc
  • Familiarity with common LLM architectures and inference optimization techniques (e.g. continuous batching, quantization etc)
  • Experience with GPU Interconnect technologies like NVlink, XGMI, RoCE
  • Open-source contributions to inference libraries, frameworks, model kernels etc
What We Offer:

Opportunity to work with a dynamic team dedicated to revolutionizing cloud computing and AI

Support for career development with reimbursement for relevant conferences, training, and education

Access to LinkedIn Learning's 10,000+ courses to support continued growth and development

  • Cloud Systems Architect

    2 days ago

    Saddar Town, Pakistan beBeeCloud Full time $100,000 - $150,000

    Senior Cloud Infrastructure SpecialistWe are seeking a highly skilled Senior Cloud Infrastructure Specialist to lead the design and implementation of scalable software architecture using Infrastructure as Code. This individual will collaborate with cross-functional teams to develop a highly available and reliable system on the cloud.The ideal candidate for...

  • Cloud Systems Architect

    2 days ago

    Saddar Town, Pakistan beBeeCloud Full time $100,000 - $150,000

    Cloud Infrastructure SpecialistA cloud infrastructure specialist is needed to manage and support our hybrid infrastructure, spanning cloud and on-premises systems. The ideal candidate is a fast learner, able to adapt to various technologies, and passionate about maintaining robust, secure, and high-performing systems.Key Responsibilities:Design, deploy, and...

  • Data Infrastructure Architect

    2 days ago

    Saddar Town, Pakistan beBeeInfrastructure Full time $28,000 - $120,000

    Job DescriptionWe are seeking a skilled Data Infrastructure Architect to join our team. As a key member of our data operations team, you will be responsible for all aspects of data collection and infrastructure management.Design and implement scalable data ingestion pipelines using cloud-based technologies.Develop and maintain complex data processing...

  • Cloud Operations Expert

    2 days ago

    Saddar Town, Pakistan beBeeDevops Full time $120,000 - $150,000

    Cloud Operations ExpertWe are a fast-paced SaaS company looking for a highly skilled Cloud Operations Expert to join our Engineering team. This role is ideal for an individual who has experience in managing and maintaining cloud-based systems, ensuring high availability, security, and performance.Job Description:This is a unique opportunity to work with a...

  • Senior Cloud AI Software Engineer

    2 days ago

    Saddar Town, Pakistan beBeeCloudAI Full time 15,000,000 - 18,000,000

    Job Title: Senior Cloud AI Software EngineerJob Overview:We are seeking a highly skilled software engineer to design, develop, and deploy AI-powered solutions on the cloud platform. The ideal candidate will have experience in machine learning, back-end development, and Large Language Models.Key Responsibilities:Develop robust and scalable applications using...

  • Senior Cloud Data Architect

    2 days ago

    Saddar Town, Pakistan beBeeData Full time $120,000 - $150,000

    About the RoleThis is a senior data engineering position that involves designing, building, testing, optimizing, and maintaining large-scale data infrastructure and code for integration, storage, processing, pipelines, and analytics from ingestion to consumption.We are looking for an experienced professional who can quickly ramp up, contribute right away,...

  • Chief Cloud Infrastructure Architect

    2 days ago

    Saddar Town, Pakistan beBeeCloud Full time $60,000 - $120,000

    Job Title: Principal Cloud Engineer As a key member of our global team, you will design and build secure, highly scalable cloud infrastructure solutions on platforms like Azure, AWS, or GCP. Your expertise will align with our business objectives, driving innovation in the financial services industry.Design and implement secure, multi-tier cloud...

  • Master Software Architect

    2 days ago

    Saddar Town, Pakistan beBeeSoftware Full time 1,000,000 - 1,200,000

    Job OverviewWe are seeking a highly skilled software architect to join our engineering department. This is an exciting opportunity to shape the future of home services in a fast-growing tech startup.This role involves contributing to various projects, including customer-to-supplier dispatching algorithms, real-time order tracking, and development &...

  • Senior Software Architect Position

    2 days ago

    Gulshan-e-Iqbal Town, Pakistan beBeeSystemsArchitect Full time 10,000,000 - 15,000,000

    Key Systems Architect Role:We are seeking a seasoned architect with 5+ years of experience to design, develop, and maintain scalable software solutions for Supply Chain and warehouse management.The ideal candidate will have strong expertise in Java, Spring Boot, and React, along with cloud technologies, and the flexibility to work collaboratively with global...

  • Senior Cloud Data Architect

    2 days ago

    Saddar Town, Pakistan beBeeData Full time $100,000 - $150,000

    About this RoleThis is a remote contract position that requires the design, building, and maintenance of infrastructure for data integration, storage, processing, and analytics (business intelligence, visualization, and advanced analytics). We are looking for a skilled Senior Data Engineer with a strong background in Python, SQL, PySpark, Azure, Databricks,...