Key skills
AI
About this role
Simular is seeking an engineer to work on the control layer, translating AI model intent into precise actions on computers. The role involves working on low-level computer control, UI element detection, and contributing to feedback loops for reliable execution across multiple operating systems.
Responsibilities:
- Work on the low-level computer control stack: mouse/keyboard injection, screen capture, coordinate mapping, input simulation
- Implement UI element detection using accessibility APIs (AXUIElement, UI Automation), DOM/a11y trees, and visual grounding
- Help build the abstraction layer that lets our agent operate across OS platforms and application types
- Tackle reliability problems: element targeting under UI changes, window occlusion, resolution scaling, cross-app focus management
- Contribute to feedback loops: how does the agent know its action worked? How does it recover when something unexpected happens?
- Work closely with the model and planning team on the interface between intent and execution