AI Engineer

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. The role involves working as a Backend LLM Engineer to unify API formats for LLMs and enhance the developer experience through critical projects.

Responsibilities:

• As the Backend LLM Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec
• This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.)
• You'll work directly with the CEO and CTO on critical projects including:
• System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
• Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
• Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases