Research Engineer - Geo-Distributed Inference

Pluralis Research develops Protocol Learning systems for training and serving large models in a fully decentralized manner on consumer-grade devices connected over the internet. The Research Engineer will own the geo-distributed inference stack, develop new algorithms for efficient inference over unreliable public networks, and operate the system for reinforcement learning training and future model serving.

Responsibilities:

• Own the inference stack: You build and own it end-to-end. Pipeline-parallel execution, placement and routing, the transport, the serving engine, and failure handling. You set the direction, and you make things happen
• Invent the algorithms: Making inference fast on consumer hardware over the public internet takes methods that don't exist yet. You design them, validate them, and put them in production
• Serve training and users: You keep the rollout pipeline fast and reliable for RL training now, and turn it into the serving layer for our models once they're trained