Lead AI Architect-LLM Development

1 day ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Sign in to access AI-powered advices

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

Continue with Google Continue with Google

We are developing a frontier-level Large Language Model using state-of-the-art architecture and training methodologies. Our ambitious project aims to create models comparable to DeepSeek's innovative designs, incorporating Mixture-of-Experts architecture and advanced training techniques. We're looking for our first key technical hire to lay the foundation for this groundbreaking work.

Position Summary

As our Lead AI Architect, you will be the cornerstone of our large language model development effort. This foundational role will shape our technical strategy, architecture decisions, and team growth as we build models ranging from 7B to 671B parameters. You will have the unique opportunity to establish our technical approach from the ground up, with substantial input into infrastructure, model design, and training methodology.

Primary Responsibilities

• Technical Leadership : Define the overall architecture and technical approach for our LLM development, from base transformer models to large-scale MoE designs
• Infrastructure Design : Architect the distributed training infrastructure required for training models at scale, including parallelism strategies and optimization techniques
• Research Direction : Guide research into model architecture innovations, training methodologies, and efficiency optimizations
• Team Building : Help identify, interview, and hire subsequent technical team members across ML, data, and infrastructure domains
• External Partnerships : Establish relationships with cloud providers, hardware partners, and academic collaborators
• Strategic Planning : Develop detailed technical roadmaps, resource plans, and milestone schedules for the project

Qualifications

• Education : PhD in Machine Learning, Computer Science, or related field (or equivalent experience)
• Core Experience : 5+ years of hands-on experience with large-scale neural networks, particularly transformer-based language models
• Technical Expertise : Deep understanding of:

a). Transformer architectures and their optimization

c). Distributed training systems and parallelism strategies

d). CUDA optimization and GPU acceleration techniques

• Proven Track Record : Demonstrated experience architecting and training models of at least 7B+ parameters
• Practical Knowledge : Familiarity with:

a). PyTorch, JAX, or similar deep learning frameworks

b). Distributed training frameworks (DeepSpeed, Megatron-LM, etc.)

c). Container orchestration and cloud infrastructure

d). High-performance computing and GPU clusters

• Leadership : Experience leading technical teams and communicating complex technical concepts

Preferred Experience

• Prior work on open-source or commercial LLMs
• Experience with training models using 100+ GPUs
• Publications in NLP, particularly related to LLM architecture or training
• Knowledge of FP8 mixed precision training and optimization techniques
• Experience with attention mechanism optimization
• Familiarity with context length extension techniques
• Background in model alignment and safety

What We Offer

• Opportunity to shape a frontier AI project from its inception
• Competitive compensation package with significant equity
• Resources to build cutting-edge infrastructure and assemble a world-class team
• Flexibility to make key technical decisions that will define the project
• Chance to advance to the state-of-the-art in AI research and application

Location

• Lahore (On-site)

How to Apply

Please submit your resume here or inbox me at shahan.rashid@fam-llc.com , a brief cover letter explaining your interest and relevant experience, and links to any published research, GitHub repositories, or previous models you've contributed to significantly.

Seniority level

• Seniority levelMid-Senior level

Employment type

• Employment typeFull-time

Job function

• Job functionDesign, Art/Creative, and Information Technology
• IndustriesHospitals and Health Care

Referrals increase your chances of interviewing at F&A Management LLC by 2x

Get notified about new Lead Architect jobs in Lahore, Punjab, Pakistan.

Senior IT Enterprise Solutions ArchitectFunctional Solution Architect - Microsoft Dynamics 365 F&OPrincipal Technical Consultant (Infrastructure) - Microsoft Dynamics 365Sr. Oracle Cloud Infrastructure Technical Consultant (OCI Specialist)Senior Database Administrator - Data ArchitectSenior Software Engineer - Microsoft Dynamics 365Pre-Sales Solution Specialist -Azure Security PracticePrincipal Software Engineer - Python/Django

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

---