Senior DevOps Engineer – Secure On-Prem, MLOps Focus

Role Overview

• Design and maintain hardened on-prem infrastructure with strong security, reliability, and compliance standards.
• Deploy and operate production-grade Kubernetes clusters.
• Implement IaC using Terraform.
• Enforce container security best practices (image scanning, RBAC, secrets management, encryption).
• Design secure networking architectures (segmentation, firewalls, controlled ingress/egress).
• Build and maintain CI/CD pipelines with integrated security controls (DevSecOps).
• Support MLOps workflows.
• Deploy and optimize LLM inference workloads, including GPU-based environments.
• Implement monitoring, logging, and incident response processes.
• Document infrastructure and ensure auditability.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Strong experience managing secure on-premise environments.
• Must have strong expertise in Infrastructure as Code (Terraform).
• Must have strong expertise in Kubernetes and Docker.
• Experience working with CI/CD pipelines (e.g., GitHub Actions).
• Experience supporting ML/LLM workloads and MLOps practices.
• Strong version control experience with Git.
• Familiarity with monitoring tools, incident management, and troubleshooting practices.
• Understanding of cybersecurity standards and regulatory compliance requirements.

Tech Stack

• Cyber Security
• Docker
• Firewalls
• Kubernetes
• Terraform