Cloud Infrastructure Manager

About the Job:

This Senior DevOps Engineer position requires expertise in designing and managing cloud-based infrastructure for AI/ML applications. The successful candidate will have extensive experience in designing scalable, secure, and highly available cloud infrastructure to support LLM and generative AI model deployment.

The ideal candidate will have strong knowledge of Infrastructure as Code (IaC) solutions, including Terraform, AWS CloudFormation, and similar tools. They will also be responsible for maintaining the organization's overall IT infrastructure, ensuring seamless operation of all enterprise applications, databases, and services.

Key Responsibilities:

• Infrastructure Design and Management:
  • Design, implement, and manage scalable, secure, and highly available cloud infrastructure to support LLM and generative AI model deployment.
  • Maintain the organization's overall IT infrastructure, ensuring seamless operation of all enterprise applications, databases, and services.
  • Develop and maintain Infrastructure as Code (IaC) solutions using tools like Terraform, AWS CloudFormation, or similar, to automate infrastructure provisioning and management across the organization.
• Performance and Scalability:
  • Evaluate and optimize infrastructure supporting AI models and organizational systems for high performance and scalability to handle millions of requests and large-scale data processing.
  • Implement auto-scaling strategies for both AI and organizational environments to ensure resource efficiency and cost-effectiveness.
• Security and Compliance:
  • Establish and enforce security best practices across all organizational infrastructure, ensuring compliance with industry standards and regulations.
  • Implement and maintain robust security protocols, including network security, data encryption, and identity management.
• Automation and CI/CD:
  • Design and implement CI/CD pipelines for AI model deployments and enterprise application updates, ensuring continuous integration and delivery.
  • Automate routine tasks such as software deployments, system updates, and infrastructure monitoring to reduce manual intervention and increase operational efficiency.
• Monitoring and Incident Management:
  • Set up and maintain monitoring, logging, and alerting systems to ensure the health and performance of infrastructure across the organization.
  • Lead incident management and response efforts, diagnosing and resolving issues promptly to minimize downtime and impact on the organization.
• Collaboration and Support:
  • Work closely with AI/ML teams, software developers, and IT staff to understand infrastructure needs and provide technical support.
  • Collaborate with cross-functional teams to ensure smooth integration and operation of AI solutions within the broader organizational infrastructure.
  • Provide mentorship and leadership to junior DevOps engineers and IT staff, fostering a culture of continuous learning and improvement.
• Innovation and Continuous Improvement:
  • Stay current with the latest developments in cloud infrastructure, DevOps practices, and AI/ML technologies.
  • Proactively identify opportunities to improve infrastructure, tools, and processes, driving innovation and efficiency within the organization.

Achieving Success:

The successful candidate will be able to demonstrate expertise in designing and managing cloud-based infrastructure for AI/ML applications, as well as a strong understanding of Infrastructure as Code (IaC) solutions.

They will also be able to work collaboratively with cross-functional teams to ensure smooth integration and operation of AI solutions within the broader organizational infrastructure.

Our ideal candidate will be passionate about delivering cutting-edge technology solutions that drive business success and will be committed to ongoing learning and professional development.