Distributed Inference Expert

2 days ago

Karachi, Sindh, Pakistan beBeeInferenceEngineer Full time $150,000 - $187,500

Cloud Computing Professional

Join a dynamic team driving cutting-edge technologies in cloud computing and artificial intelligence. We're seeking an experienced professional to collaborate on the design, optimization, and scaling of our inference systems.

  • Develop distributed inference platforms for large language models
  • Optimize runtime and infrastructure layers for best model performance
  • Build native cross-platform inference support across NVIDIA and AMD GPUs for various model architectures
  • Contribute to open-source inference engines to enhance their performance on the DigitalOcean platform
  • Develop tooling and observability to monitor system health and auto-tuning capabilities
  • Build benchmarking frameworks to test model serving performance and guide system tuning efforts
  • Mentor engineers on inference systems, GPU infrastructure, and distributed inference best practices

To succeed in this role, you should possess a Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field. You'll need experience building distributed systems with Kubernetes, gRPC, Go, and Python, as well as expertise in GPU programming with CUDA and ROCm. Familiarity with L3-L7 network protocols, block storage, object storage, and multi-tenant systems is also essential. A proven track record of defining and achieving performance KPIs is necessary for success.

Preferred qualifications include experience with one or more inference engines, familiarity with distributed inference serving frameworks, knowledge of distributed inference optimization techniques, common LLM architectures, and GPU interconnect technologies. Open-source contributions to inference libraries, frameworks, and model kernels are also desirable.

We prioritize career development, innovating with purpose, caring about your well-being, rewarding our employees, and valuing diversity and inclusion. We offer competitive salaries, bonuses, equity compensation, and a comprehensive benefits package. Join us and become part of a high-performance organization that challenges you to think big and grow with us.

  • AI Expert

    6 days ago

    Karachi, Sindh, Pakistan beBeeLanguage Full time $160,000 - $200,000

    Job DescriptionWe are seeking an experienced Large Language Model Specialist to develop, fine-tune and deploy large-scale language models. The ideal candidate will have a strong background in Natural Language Processing (NLP) and Deep Learning.Key Responsibilities:Develop and fine-tune large-scale language models using GPT, LLaMA, BERT and T5.Optimize model...

  • Distribution Market Growth Expert

    2 weeks ago

    Karachi, Sindh, Pakistan beBeeEnterprise Full time 800,000 - 1,200,000

    **About the Role:**We are seeking an experienced professional to fill a key position in our organization. As an Enterprise Distribution Market Partner Sales Manager, you will be responsible for achieving sales targets and driving business growth through strategic partnerships.Key Responsibilities:Achieve sales targets by developing and executing effective...

  • Leading Steam Generation and Distribution Expert

    2 weeks ago

    Karachi, Sindh, Pakistan beBeeMaintenance Full time 900,000 - 1,200,000

    Steam Generation and Distribution Specialist Job DescriptionChartered in 1983, AKU provides higher education in several disciplines, carries out research pertinent to the countries it exists in, and has campuses in six countries across three continents. As an international institution, AKU operates on core principles of quality, relevance, impact, and...

  • Senior Software Systems Engineer

    2 days ago

    Karachi, Sindh, Pakistan beBeeSoftwareDevelopment Full time $150,000 - $200,000

    Job OverviewWe empower professionals to work safer, more productive, and profitable with tools that streamline their operations.You will lead the effort to build systems enabling AI R&D teams to deliver secure, highly scalable, distributed services as a key member of our team.Key ResponsibilitiesDefine the direction for our team.Prioritize initiatives and...

  • Web Development Expert

    2 weeks ago

    Karachi, Sindh, Pakistan beBeeMERN Full time 900,000 - 1,200,000

    Web Development ExpertWe are seeking a skilled Web Development Expert to join our team. In this role, you will be responsible for developing innovative travel and booking solutions using the MERN stack.About the RoleYou will work closely with our product and design teams to create an engaging and efficient user experience.You will develop interactive and...

  • Senior Research Innovator

    2 days ago

    Karachi, Sindh, Pakistan beBeeResearch Full time $80,000 - $140,000

    Tether Operations Limited is pioneering a global financial revolution with cutting-edge solutions that empower businesses to integrate reserve-backed tokens across blockchains. Our innovative product suite features the world's most trusted stablecoin, USDT, relied upon by hundreds of millions worldwide.About Tether FinanceWe craft a future where innovation...

  • Message Expert

    6 days ago

    Karachi, Sindh, Pakistan beBeeCommunication Full time 750,000 - 1,000,000

    As a strategic messaging expert, you will be responsible for establishing and maintaining relationships with key industry publications and media in the region. Your role will involve supporting and managing external advertising campaigns, developing marketing material, and writing news releases for our organization.Key Responsibilities:Identify and establish...

  • Procurement and Logistics Expert

    6 days ago

    Karachi, Sindh, Pakistan beBeeLogistics Full time 15,000,000 - 25,000,000

    Procurement and Logistics Expert">The Artistic Milliners is seeking a highly experienced Procurement and Logistics Expert to handle the procurement, supplies, and logistics of our textile industry.Job SpecificationMinimum 10 years of related experience in supply chain management required.Develop and implement effective strategies for cost reduction and...

  • Expert Java Developer

    2 weeks ago

    Karachi, Sindh, Pakistan beBeeJava Full time $90,000 - $120,000

    Software Development ExpertNisum, a leading global digital commerce firm, seeks an experienced software development expert to join its team. With over 1,800 professionals across the globe, Nisum enables clients to achieve direct business growth by building advanced technology for seamless customer experiences.Key ResponsibilitiesDesign and develop scalable,...

  • Data Scientist

    1 week ago

    Karachi, Sindh, Pakistan traxccel Full time $104,000 - $130,878 per year

    About TraxccelAt Traxccel, we're transforming the way organizations harness data to drive strategy, optimize operations, and deliver impact. Our advanced analytics and AI-driven platforms empower businesses across industries with cutting-edge insights, and we're looking for an experienced Senior Data Scientist to help us take our data innovation to the next...