Oak Ridge National Laboratory is seeking a Senior Research Software Engineer to join their National Center for Computational Sciences. This role involves developing and deploying data management tools and services that support scientific and AI/ML campaigns on high-performance computing infrastructure.
Responsibilities:
- Gain working expertise with federated data management (e.g., Pelican, Rucio), data catalog solutions (e.g. CKAN, DKAN, Schema.org), streaming data (e.g., Kafka), and data movement (XRootD, Globus, S3) tools and technologies
- Design and implement web portals and API services for data management using a combination of modern web technologies
- Develop, implement, and maintain Kubernetes deployment recipes for data portals, catalogs, API gateways, and other ancillary services like key-value stores and databases
- Implement solutions for MLOps including model lifecycle management and storage, as well as integration with existing platforms like MLFlow
- Partner closely with internal platforms, cybersecurity, and account management teams to ensure the platform meets security, compliance, role-based access controls, and usability expectations
- Participate in cross-functional projects related to platform enhancements and cluster lifecycle automation
- Be able to represent the DAPS team with internal collaborators and partners across the lab