Site Reliability Engineer

Veritone is an AI-first company seeking a Site Reliability Engineer. The role involves deploying and maintaining a resilient SaaS application platform, designing scalable infrastructure for AI/ML workloads, and automating monitoring and incident response systems.

Responsibilities:

• Deploy and maintain a resilient, secure, and efficient SaaS application platform to meet established SLAs
• Build and maintain robust CI/CD pipelines and developer platforms to empower engineering teams to release features quickly and safely
• Design and deploy scalable infrastructure specifically optimized for AI/ML workloads, including managing GPU resources and integrating MLOps tools
• Automate, monitoring, management and incident response to achieve an auto-remediation system
• Participate in on-call rotation to ensure stability and uptime for our platforms
• Scale infrastructure to meet rapidly increasing demand
• Independently design and develop tools to aid in operations and automation to AI as well as work jointly with other team members to deliver innovative solutions to complex business and technical challenges
• Provide deployment and operations support for multi-tiered distributed software applications
• Estimate engineering effort, plan implementation, and rollout system changes that meet requirements for functionality, performance, scalability, reliability, and adherence to development goals and principles
• Collaborate in a fast paced environment with multiple teams (software development, release management, build and release, etc...)
• Defining how the behavior of large scale systems can be achieved
• Measuring and achieving reliability through engineering and operations automation
• Monitoring and alert development, documentation and management with the goal of creating an auto-remediation system to bring platform stability
• Adapting security controls to products not typically native to GA releases
• Developing automation methods to extend standard deployment pipelines for bespoke implementations
• Patching, configuration management, policy enforcement, and audit of production systems
• Driving the Disaster Recovery process

Requirements:

• 7+ years of experience in Linux systems and software management
• Expertise with Terraform, Ansible, and cloud platforms like AWS, Azure, and GCP
• Experience with large-scale distributed systems
• Monitoring/alerting systems (Prometheus, Grafana)
• CI/CD pipelines
• Container orchestration (Docker, Kubernetes)
• Programming languages (Go, Java, Python)
• Engineering scalable infrastructure for machine learning workloads
• GPU provisioning and MLOps integrations
• Implementing security controls
• Automating deployments
• Troubleshooting complex systems
• 7+ years of professional Linux and Windows systems and software management experience
• Expertise with Infrastructure-as-Code such as Terraform and Cloud Formation
• Knowledgeable with code languages including: Python, Go, Node.js
• Experience with managing infrastructure within Azure, GCP and AWS
• Expertise in Kubernetes management, upgrades
• Strong script skills for systems and data driven solutions
• Strong GitOps and CICD experience with tools such as Jenkins, ArgoCD, Helm
• Proven ability to lead root-cause analysis (RCA) and blameless post-mortems
• Act as an infrastructure consultant to software engineering teams
• Identify systemic weaknesses across our multi-tiered applications
• Drive a culture of observability
• Comprehensive background in monitoring and alerting systems in auto-remediation systems
• Familiarity with deploying, scaling, and observing AI models, Vector Databases, or LLMs in production environments
• Proven examples of standardizing security controls and configuration management across large-scale infrastructure
• Comfort working within project/task management platforms
• Bachelor's degree in Computer Science or related field
• Experience provisioning and managing GPU infrastructure (e.g., NVIDIA CUDA)
• Have worked in regulated or public sector environments through development and assessment of cloud based solutions
• Experience with the following languages, platforms and tools: Perl, Java, VMWare
• Have concrete examples ready to present for creating auto-remediation systems and infrastructure with agentic solutions