Take end-to-end ownership of design, development, and maintenance of scalable systems for collecting, cataloging, storing, and processing petabytes of vehicle data
Own the development and scaling of robust log data storage solutions using AWS S3, and distributed systems to ensure data integrity and availability
Drive the technical design for assigned features, creating detailed design documents, and actively contributing to broader team design discussions
Implement monitoring, alerting, and operational tooling to ensure high availability and reliability of data pipelines processing thousands of runs daily
Troubleshoot and resolve production issues in data ingestion and storage systems, participating in on-call rotations
Requirements
5+ years of software engineering experience in building large-scale distributed cloud storage systems or data platforms
Proficiency in Python and C++, or similar languages, with emphasis on writing clean, maintainable code
Extensive experience with cloud platforms (AWS preferred), including S3, Aurora, and EC2
Experience contributing to large-scale data ingestion and storage systems handling petabytes of data
Demonstrated ability to take full ownership of project components, driving them from implementation through to production while collaborating effectively with senior leads
Tech Stack
AWS
Cloud
Distributed Systems
EC2
Python
Benefits
paid time off (e.g. sick leave, vacation, bereavement)