TrueFoundry is a company focused on building foundational infrastructure for production AI systems. They are seeking an Engineering Leader to lead the Core Platform organization, responsible for the architecture and technical direction of their AI Gateway and AI Deploy products, while also building a high-caliber engineering team.
Responsibilities:
- Define and evolve the architecture for distributed, multi-tenant AI systems
- Drive long-term scalability, reliability, and performance strategy
- Ensure AI Gateway and AI Deploy evolve cohesively as a unified platform
- Maintain high technical standards across control plane and compute layers
- Build and lead a high-caliber team of Staff/Principal engineers
- Hire across US and India
- Establish strong design review, architecture review, and incident management processes
- Develop future technical leaders within the organization
- Balance long-term architecture with rapid product iteration
- Identify and mitigate scaling risks early
- Drive operational excellence for enterprise-grade deployments
- Ensure high availability, resilience, and cost efficiency
- Act as senior technical leadership in enterprise discussions when needed
- Oversee escalations for complex deployments
- Translate enterprise requirements into scalable platform primitives
- Partner with the CTO on roadmap prioritization and architecture
- Work closely with Product and Outcome Engineering
- Align infrastructure investments with long-term product strategy