Key skills
AIMachine LearningLLMLarge Language Models
About this role
NEAR AI is building decentralized and confidential machine learning infrastructure to enable user-owned AI. They are seeking an expert in high-performance LLM serving systems and inference optimization to push the boundaries of how large language models are served.
Responsibilities:
- Architect and maintain production high-traffic LLM serving systems
- Optimize throughput, latency, and cost for leading open-source LLMs