interos.aiRemote
Senior Data Engineer
United States of America
Full Time
1 week ago
$120,000 - $160,000 USD
H1B Sponsor Likely
Key skills
Software DevelopmentPythonData PipelinesSQLRelational DatabasesColumnar DatabasesSnowflakeAWSData StreamingEvent-driven SystemsKafkaDatabricksAirflowAgileCommunication
About this role
Interos Inc. is defining the category of supply chain risk intelligence with their pioneering platform that automates the discovery and monitoring of supply chain risks. The Senior Data Engineer will ensure the robustness and efficiency of the data infrastructure and pipelines, delivering maintainable and performant data solutions.
Responsibilities:
- Build and share knowledge of the data flow throughout the Resilience platform
- Optimize the storage, processing, and movement of data, such as tuning data models or refactoring data software. Develop, document, and maintain new data platform functionality
- Contribute to software and data architecture design and reviews
- Provide support for other engineers or internal customers in the matters of data or software
- Implement and enforce best practices for code quality, testing, and documentation
- Improve or develop frameworks, packages, and/or documentation to support engineering standards
- Conduct code reviews to ensure adherence to coding standards and promote knowledge sharing within the team
Requirements:
- 5+ years of experience in Software Development
- 3+ years of full-time professional Python experience including production experience with data pipelines
- 3+ years of experience with SQL via relational or columnar databases
- 2+ years of experience working with Snowflake
- 2+ years of experience developing in AWS
- 2+ years of experience in data streaming or event-driven systems with Kafka or another stream processing system
- Bachelor's degree in Computer Science or equivalent experience
- Experience with job or pipeline orchestration, using tools like Prefect, Databricks, Airflow, Argo, etc
- Passionate about writing code that is scalable, maintainable, reusable, and well-tested
- Interested in building reliable, fault-tolerant, production-grade systems
- Feel comfortable debugging large or complex applications and, if necessary, guiding their refactor
- Excellent communication skills with the ability to convey technical concepts to both technical and non-technical stakeholders
- Have experience developing data software in an agile environment
- Enjoy optimizing complex processes and leaving something better off than where you found it
- A seasoned engineer who enjoys sharing your experience with the team