Key skills
JavaScriptTypeScriptAPI developmentAI/ML integrationsCloud infrastructureDistributed systemsOpen source contributionCommunication skillsCollaborationAIMLAnalyticsCachingCommunication
About this role
Vercel is a company that provides developers with tools and cloud infrastructure for building a faster, more personalized web. In this role, you will develop and enhance the AI Gateway platform, ensuring reliable access to various AI models and collaborating with a distributed team to address performance and scalability challenges.
Responsibilities:
- Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability
- Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests
- Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges
- Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools
- Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights
Requirements:
- You have at least 5+ years of relevant experience
- Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
- Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
- Experience contributing to or participating in open source projects
- Excellent communication skills and the ability to work effectively in a collaborative team environment