ML Engineer

LiteLLM is building AI infrastructure and a second product. The ML Engineer will unify LLM API formats and build interoperability features across providers, MCPs, and agents, with a focus on developer experience.

Responsibilities:

• As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec
• This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.)
• System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
• Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
• Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases