LLM - COBOL Developer

4 days ago

Lahore, Punjab, Pakistan Highbrow Technology Inc Full time

About the Role

Exp : 3+ years

Location : India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico

Duration : 1 month

Commitment Required : Full Time Availability(8 Hrs) and 4 hours overlap with PST time zone

Role Overview:

This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models.

One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models.

For example, for SFT data generation, you might have to put together or be provided a prompt which contains provided code and questions, you will then provide the model responses, and write corresponding COBOL code to solve the questions. A collection of 5k-10k such samples could form the dataset for model fine-tuning.

For RLHF data generation, you might have to put together or be provided a prompt by the customer, ask the model questions, and evaluate the outputs generated by two versions of the LLM model. You'd compare these outputs and provide feedback, which is then used to fine-tune the models. Please note that this role does not require you to build LLMs or fine-tune them.

What does day-to-day look like:

  • Design, develop, and maintain efficient, high-quality COBOL code to train and optimize AI models.
  • Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
  • Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
  • Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
  • Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
  • Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
  • Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
  • Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
  • Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
  • Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
  • Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.

Requirements:

  • Strong experience with COBOL programming language concepts.
  • Industry experience and knowledge of code quality, formatting, and best practices of software development
  • Experience with COBOL's testing ecosystem, including unit, integration, and property-based testing.
  • Familiarity with COBOL frameworks and libraries
  • Knowledge of multi-threading and asynchronous programming in COBOL.
  • Ability to work with architectural patterns and refactor code without introducing regressions.
  • Strong debugging skills, including fixing memory and concurrency issues.
  • 3+ years of overall work experience with 2+ years of relevant experience with COBOL
  • Fluent in conversational and written English communication skills
#J-18808-Ljbffr

  • High-Quality COBOL Code Specialist

    3 days ago

    Lahore, Punjab, Pakistan beBeeCobolDeveloper Full time

    Job DescriptionWe are seeking a skilled COBOL Developer to join our team. As a key member of our organization, you will be responsible for designing, developing, and maintaining efficient, high-quality COBOL code to train and optimize AI models.You will conduct evaluations (Evals) to benchmark model performance and analyze results for continuous...

  • Tableau Developer

    2 weeks ago

    Lahore, Punjab, Pakistan DEVACE - Custom LLM Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from DEVACE - Custom LLM SolutionsBusiness Development Representative | Experienced in Market Research and Analysis| Let's ConnectAt Devace Technologies, we're seeking a skilled Tableau Developer to build dynamic dashboards and data visualizations that drive smarter...

  • Lead AI Architect-LLM Development

    4 weeks ago

    Lahore, Punjab, Pakistan F&A Management LLC Full time

    1 day ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Sign in to access AI-powered advicesContinue with Google Continue with GoogleContinue with Google Continue with GoogleContinue with Google Continue with GoogleContinue with Google Continue with GoogleContinue with Google Continue with GoogleContinue with...

  • Mid/Senior Full Stack NodeJS/ Developer with AI/LLM experience

    4 weeks ago

    Lahore, Punjab, Pakistan Code Upscale Full time

    Mid/Senior Full Stack NodeJS/Nest.js DeveloperMid/Senior Full Stack NodeJS/Nest.js DeveloperDirect message the job poster from Code UpscaleCo-Founder @Code Upscale | AI Transformation Leader | Helping Companies to Adopt Cloud and AIMid/Senior Full Stack Node.js Developer (AI / LLM Focus)Code Upscale delivers custom web and mobile solutions that leverage AI,...

  • Intelligent System Developer

    5 days ago

    Lahore, Punjab, Pakistan beBeeArtificial Full time

    AI Engineer Position OverviewWe're seeking a skilled AI professional with 3 to 6 years of experience in developing intelligent applications using Large Language Models (LLMs). This role focuses on designing and implementing AI Agents for our platform, integrating third-party LLM APIs, and leveraging advanced prompt engineering and RAG techniques.Key...

  • AI Solution Developer

    6 days ago

    Lahore, Punjab, Pakistan beBeeArtificialIntelligence Full time

    We are seeking a seasoned professional to develop and deploy advanced artificial intelligence solutions. The successful candidate will have expertise in Large Language Models (LLMs), including GPT, Bard, and Gemini.This role involves designing, building, and fine-tuning LLMs to solve complex business problems. You will leverage cutting-edge NLP techniques to...

  • AI Model Development Specialist

    2 weeks ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    AI Model Development SpecialistWe are seeking an experienced AI Model Development Specialist to join our team. As a key member of our AI/ML development team, you will be responsible for designing, developing, and optimizing large language models (LLMs) to address business-specific use cases.Responsibilities:Design and Develop AI/ML Models: Utilize your...

  • Artificial Intelligence Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Exper Labs Full time

    Position OverviewWe're looking for a skilled AI Engineer with 3 to 6 years of experience in building intelligent applications powered by Large Language Models (LLMs). This role centers around developing AI Agents for our platform, with a focus on integrating third-party LLM APIs (such as OpenAI, Anthropic, and Google) using advanced prompt engineering and...

  • Azure Backend Developer With Machine Learning Experience

    3 weeks ago

    Lahore, Punjab, Pakistan Bineric AS Full time

    Azure Backend Developer With Machine Learning Experience - REMOTEAre you a skilled and motivated developer with a passion for cutting-edge technology? We are seeking a talented individual to join our team as an Azure AI Developer. In this role, you will play a crucial part in developing innovative solutions utilizing Microsoft Azure's AI capabilities,...

  • AI Engineer

    6 days ago

    Lahore, Punjab, Pakistan Luminogics (SMC-Private) Limited Full time

    Luminogics, established in 2015, is a technology innovation company based in Lahore. Specializing in Modern Application Development, we collaborate with Fortune 150 clients and global enterprises to drive advancements in AI and ML technologies. Our solutions enhance businesses through predictive analytics, intelligent automation, and personalized customer...