Software Engineer - Platform & Application

Boson AI is pioneering the future of enterprise AI with a focus on cutting-edge AI research. The role involves building and operating the core platform behind Boson's model APIs and agentic products, working closely with senior engineers to develop distributed systems and infrastructure.

Responsibilities:

• Contribute to the core platform infrastructure: the API serving layer, state management, policy enforcement, and execution runtime for agentic workflows — starting with well-scoped components and taking on broader ownership as you grow
• Help build and maintain distributed services that back our model API products, including request routing, rate limiting, and multi-tenant isolation, under the guidance of senior engineers
• Build and maintain pieces of our data pipelines (ETL/ELT) for API logs, usage analytics, and billing, with a focus on data correctness and freshness
• Develop and improve internal SDKs and libraries — writing clean, well-tested code with clear contracts that product teams can rely on
• Support our context and memory systems for conversational workloads: retrieval, caching, and integration with vector stores and retrieval pipelines
• Add observability across the platform — structured logging, tracing, and metrics — and help investigate and resolve reliability issues
• Collaborate with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure, learning how the full stack fits together