Design, build, optimize, and maintain scalable ETL pipelines within Databricks, including Bronze, Silver, Gold, and Metrics tier data models.
Build normalization and transformation frameworks to standardize disparate datasets for analytics, cybersecurity, and mission operations.
Quality, modern, and fully reproducible code using established software engineering practices—including version control, modular design, automated testing, documentation, and CI/CD—to ensure reliability, reusability, and maintainability across data pipelines and Databricks workflows.
Develop solutions within a secure cloud-based architecture leveraging Databricks Lakehouse features (Unity Catalog, Delta Lake, Auto Loader, cluster configuration).
Manage environment setup, version control, deployment, and CI/CD processes for data pipelines and Databricks apps.
Develop and maintain integrations between Databricks and enterprise systems through APIs, S3 ingestion endpoints and database connectors.
Collaborate with cross-functional engineering, cybersecurity, and product teams to design and implement features that improve data ingestion, metadata management, automation workflows, and platform usability.
Document technical requirements, user stories, and workflow specifications for data integrations and interface development.
Evaluate and implement push/pull data transfer patterns optimized for NASA’s security, performance, and governance constraints.
Requirements
Reliability cloud solutions
Experience building scalable data-driven services, data ingestion pipelines, and automation workflows
Strong communication and problem-solving skills in dynamic, multi-functional teams
Ability to empathically work with platform customers (software or data engineering teams) to triage and resolve issues, enable self-service, and introduce improvements based on feedback
Ability to collaborate with data engineers, software engineers, platform engineers, cybersecurity, and product stakeholders to support data platform requirements
Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, or a related discipline. Experience will be considered in lieu of a degree
Ability to design and document technical solutions related to continuous integration and continuous deployment
Demonstrated experience working with agile project management tools
Must be able to obtain and maintain a NASA Public Trust background investigation
Desired: Experience supporting the NASA Web Services Operational Environment
Experience working with industry-standard Enterprise Data Platform applications, such as Databricks, Apache Airflow, or similar technologies
Experience working on complicated problems and providing solutions that are creative, yet practical and feasible
Acts independently and within a team environment to expose and resolve problems
Experience supporting Federal government project
Experience working in a dynamic, multifaceted environment.