Design and build a high performance, scalable and reliable control plane where AI services are first-class components of the file processing pipeline, augmenting validation, transformation, and routing logic using technology such as AWS
Build solutions that prioritize AI observability, ensuring AI‑driven decisions are explainable, include confidence assessment, are traceable to specific models or configurations, and are supported by fallback paths and human‑in‑the‑loop audit trails
Own end-to‑end data observability solutions that surface anomalies across freshness, volume, schema, and data distribution
Design meaningful data profile reports that provide intuitive and business friendly insights into data quality measures to support client stewardship, issue monitoring, alerting, and troubleshooting
Monitor data processing pipelines to ensure SLAs are met and proactively communicate risks and potential impacts
Proactively surface and resolve underlying causes of issues to drive sustained improvement and stability of data processing pipelines
Mentor junior team members in proper application design and security
Define architecture & help throughout refinement process
Collaborate across teams for developing or enhancing product features
Design clear and concise REST service interfaces and APIs with corresponding documentation
Ensure code quality through comprehensive automated testing and adherence to backend engineering best practices
Effectively resolve production problems in a timely manner by rapidly organizing and deploying the appropriate resources
Ensure that secure coding practices are followed throughout the software life cycle
Experiment with new tools and technologies, build working POCs, conduct knowledge sharing sessions and provide recommendations for product improvement
Effectively communicate software solution expectations to internal customers, team members and other stakeholders in a timely and clear fashion
Participates in planning meetings, retrospectives, daily stand ups, and other meetings as part of the software development process
Requirements
Minimum of bachelor’s degree in Computer Science (or related field) from four-year college or university with minimum 3.0 GPA
Minimum 3 years of experience or similar ability in software development
Proficient in Python and SQL for backend services and data processing workflows
Experience consuming RESTful APIs
Experience working with AWS services including serverless services and containerized deployments
Experience developing internal or operational user interfaces using a modern web framework (e.g., React)
Experience with file processing in formats such as CSV, Parquet, and other delimited formats is a plus
Experience integrating AI services into production workflows is a plus
Familiarity with Snowflake or other cloud data warehouses is a plus.
Understanding of schema evolution, data quality checks, and reprocessing strategies
Working knowledge of software development tools, testing methodologies and Agile processes
Experience with continuous integration and processes
Strong teamwork and problem-solving skills
Ability to effectively present information in one-on-one as well as in large group settings
Demonstrated ability to learn and adapt to continuously changing technology
Effectively translate complex customer requirements and recommend solutions
Excellent written and verbal communication skills with the ability to present complex technical information in a clear and concise manner to a variety of audiences