MlOps Engineer

3 weeks ago

Karachi, Sindh, Pakistan Cloudlit Full time

We are seeking a skilled and motivated MLOps Engineer to help design, build, and maintain a centralized ML operations pipeline. The ideal candidate will work with a variety of technologies, including MLflow, Kubernetes, Pachyderm, and DVC, to create a robust and scalable system for managing model deployments, training, and experiments. This role will focus on version control for applications, models, and datasets, while improving visibility and control over the entire MLOps lifecycle.

Key Responsibilities:

  • Deployment Management:
  • Develop and maintain a solution to track and manage live applications, including version control for models and datasets in production.
  • Integrate Pachyderm to organize and track versioned layers (Application - Model - Data) for a unified view of deployment components.
  • Implement version lineage tracking from application code through models and datasets to improve troubleshooting and facilitate system enhancements.
  • Training Metrics Management:
  • Capture and store real-time training metrics to optimize model performance and enable dynamic adjustments during training.
  • Use MLflow to log training metrics, facilitating early stopping and performance-based adjustments.
  • Implement version control for datasets used in training to ensure reproducibility and consistency across different runs.
  • Design and implement systems to collect and log the results of inference experiments, including per-data-unit metrics and aggregated performance scores.
  • Use MLflow to store, tag, and retrieve experiment results for further analysis and decision-making.
  • Manage model and dataset versions across experiments using Pachyderm, ensuring consistency and enabling easy backtracking through version histories.
  • Versioning and Integration:
  • Integrate DVC and S3 for model and dataset versioning, ensuring proper tracking and storage of versioned data.
  • Track versions of applications, models, and datasets, ensuring each version is clearly linked and up-to-date.

Qualifications:

  • Proven experience in MLOps, machine learning pipelines, and model deployment.
  • Strong knowledge of MLflow and Pachyderm for model and dataset version control.
  • Hands-on experience with Kubernetes for deployment management and scaling machine learning models.
  • Familiarity with DVC (Data Version Control) and cloud storage solutions like AWS S3.
  • Proficiency in version control practices for machine learning applications, models, and datasets.
  • Ability to work with both machine learning practitioners and software engineers to ensure a smooth workflow.
  • Strong troubleshooting and debugging skills, particularly for distributed systems.
  • Excellent communication skills and the ability to work in a collaborative team environment.

Preferred Qualifications:

  • Experience with cloud platforms (AWS, GCP, or Azure).
  • Familiarity with CI/CD pipelines and automation tools for machine learning workflows.
  • Knowledge of additional tools for model tracking, experiment logging, or data management.

About Cloudlit

Cloudlit is a premier DevOps Consulting Company that offers a wide range of services to meet major IT needs. Our cloud experts support in cloud-native development, deploy robust and reliable software solutions for the business. From infrastructure automation to cloud-based solutions, we help our clients get the most out of their technology investments. Join us on our mission to embrace technology, empower customers, and deliver the future.

Seniority level
  • Entry level
Employment type
  • Part-time
Job function
  • Engineering and Information Technology
  • Industries: IT Services and IT Consulting
#J-18808-Ljbffr

  • MLOps Pipeline Developer

    1 week ago

    Karachi, Sindh, Pakistan Cloudlit Full time

    Cloudlit is seeking an experienced MLOps engineer to join our team and contribute to the development of our cloud-native machine learning platform.About the JobThe successful candidate will be responsible for designing, building, and maintaining a centralized ML operations pipeline using a variety of technologies, including MLflow, Kubernetes, Pachyderm, and...

  • Cloud Native ML Engineer

    1 week ago

    Karachi, Sindh, Pakistan Cloudlit Full time

    We are looking for a highly skilled MLOps engineer to join our team and contribute to the development of our cloud-native machine learning platform.About the PositionThe ideal candidate will have a strong background in MLOps, machine learning pipelines, and model deployment, as well as hands-on experience with Kubernetes, MLflow, Pachyderm, and DVC.This role...

  • LLM Engineer

    4 days ago

    Karachi, Sindh, Pakistan Matech Consulting & Outsourcing Full time

    Job Description:We seek an experienced LLM Engineer to train, fine-tune, and deploy large language models (LLMs).Responsibilities:Develop and fine-tune large-scale LLMs using GPT, LLaMA, BERT, T5, etc.Optimize model performance using quantization, pruning, LoRA, and distillation.Implement retrieval-augmented generation (RAG) and vector search solutions...

  • Computer Vision Engineer

    4 weeks ago

    Karachi, Sindh, Pakistan Ahoy Full time

    We are seeking a dedicated, research-driven professional with a strong foundation in mathematics and algorithmic problem-solving. The ideal candidate will have 3+ years of full-time industry experience (non-freelance) in computer vision and MLOps, with a proven track record of delivering rapid, quality solutions in a collaborative team environment. A...

  • Director of Data Science and Engineering

    2 weeks ago

    Karachi, Sindh, Pakistan Pakistan Single Window Full time

    RequirementsEducation: Bachelor's or master's degree in computer science, Artificial Intelligence, Data Science, or a related field.Experience: 6+ years of experience in AI/ML engineering or data science.Deployed Models: Proven track record of deploying AI/ML models in production.Programming Skills: Strong programming skills in Python, R, or Java.ML...

  • Machine Learning Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Ahoy Full time

    Role OverviewWe are seeking a dedicated, research-driven professional with a strong foundation in mathematics and algorithmic problem-solving. The ideal candidate will have 3+ years of full-time industry experience (non-freelance) in computer vision and MLOps, with a proven track record of delivering rapid, quality solutions in a collaborative team...

  • Large Language Model Engineer

    4 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Job Description:We are seeking an experienced Large Language Model Engineer to develop and deploy cutting-edge natural language processing models.Key Responsibilities:Design, train, and fine-tune large-scale deep learning models using GPT, LLaMA, BERT, T5, etc.Optimize model performance through techniques such as quantization, pruning, LoRA, and...

  • Quality Assurance Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Careem Full time

    About CareemCareem is a pioneering technology company that simplifies and improves the lives of people in the greater Middle East. With its mission to build an awesome organisation that inspires, Careem has created earnings for over 2.5 million Captains, simplified the lives of over 70 million customers, and built a platform for the region's best talent to...

  • Artificial Intelligence Engineer Role

    4 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    A talented AI engineer is needed to work on cutting-edge AI models, developing and deploying scalable solutions that enhance decision-making and optimize large-scale operations.Key Responsibilities:Develop and implement advanced AI models using deep learning and generative AI architectures.Optimize NLP, reinforcement learning, and predictive analytics...

  • Lead AI Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Pakistan Single Window Full time

    Responsibilities:Design, build, and deploy AI/ML models, including Generative AI models, to solve business problems.Design scalable and efficient architectures for AI models, ensuring seamless integration with existing systems and data pipelines.Collaborate with data engineers to implement robust data pipelines for training and serving AI models.Manage the...