Senior Data Engineer

Interos.ai is defining the category of supply chain risk intelligence, building the world’s most trusted and transparent supply chains. As a Senior Data Engineer, you will ensure the data infrastructure and pipelines are robust, efficient, and scalable, while delivering maintainable and performant features aligned with engineering standards.

Responsibilities:

• Build and share knowledge of the data flow throughout the Resilience platform
• Optimize the storage, processing, and movement of data, such as tuning data models or refactoring data software
• Develop, document, and maintain new data platform functionality
• Contribute to software and data architecture design and reviews
• Provide support for other engineers or internal customers in the matters of data or software
• Implement and enforce best practices for code quality, testing, and documentation
• Improve or develop frameworks, packages, and/or documentation to support engineering standards
• Conduct code reviews to ensure adherence to coding standards and promote knowledge sharing within the team

Requirements:

• 5+ years of experience in Software Development
• 3+ years of full-time professional Python experience including production experience with data pipelines
• 3+ years of experience with SQL via relational or columnar databases
• 2+ years of experience working with Snowflake
• 2+ years of experience developing in AWS
• 2+ years of experience in data streaming or event-driven systems with Kafka or another stream processing system
• Bachelor's degree in Computer Science or equivalent experience
• Experience with job or pipeline orchestration, using tools like Prefect, Databricks, Airflow, Argo, etc
• Passionate about writing code that is scalable, maintainable, reusable, and well-tested
• Interested in building reliable, fault-tolerant, production-grade systems
• Feel comfortable debugging large or complex applications and, if necessary, guiding their refactor
• Excellent communication skills with the ability to convey technical concepts to both technical and non-technical stakeholders
• Have experience developing data software in an agile environment
• Enjoy optimizing complex processes and leaving something better off than where you found it
• A seasoned engineer who enjoys sharing your experience with the team