GenAI Engineer

**Job Description:**

We are looking for a highly motivated and experienced AI engineer to join our team. As an AI inferencing expert, you will be responsible for developing and commercializing cutting-edge AI technology. Your primary focus will be on pushing performance boundaries with large models and staying up-to-date with the latest advancements in GenAI.

Key Responsibilities:

• Develop and deploy large C/C++ software stacks using best practices.
• Leverage expertise in deploying large LLMs/Transformers and edge-based GenAI deployment.
• Collaborate with a globally diverse team, managing tasks independently.
• Ensure excellent communication and presentation skills.

Requirements:

• Strong grasp of Generative AI models – LLM, LVM, LMMs, and building blocks (self-attention, cross attention, KV caching etc.).
• Floating-point, Fixed-point representations, and Quantization concepts.
• Experience with optimizing algorithms for AI hardware accelerators (like CPU/GPU/NPU).
• Hands-on experience in C/C++ programming, Design Patterns, and OS concepts.
• Excellent analytical and debugging skills.
• Exposure to shell scripts, Python scripts, Linux/Windows systems, and automation scripts/environment.
• Good communication skills, presentation skills, and ability to manage tasks independently.
• Collaboration across a globally diverse team and multiple interests.

Preferred Qualifications:

• Strong understanding of SIMD processor architecture and system design.
• Proficiency in object-oriented software development and familiarity.
• Familiarity with Linux and Windows environment.
• Strong background in kernel development for SIMD architectures.
• Familiarity with frameworks like llama.cpp, MLX, and MLC is a plus.
• Good knowledge of PyTorch, TFLite, and ONNX Runtime is preferred.
• Experience with parallel computing systems and languages like OpenCL and CUDA is a plus.