Databricks Data Engineer

OldRex Technologies is hiring a Data Engineer to design, implement, and optimize data pipelines and workflows in Databricks. The role builds ETL processes, data models, and scalable data warehouses while supporting analytics and federal data security requirements.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and workflows within the Databricks environment
• Build and optimize ETL/ELT processes to support ingestion, transformation, and delivery of structured and semi-structured data
• Develop and maintain data models and enterprise data warehouse solutions to support reporting, analytics, and mission operations
• Collaborate with cross-functional teams including data analysts, developers, and government stakeholders to gather requirements and deliver data solutions
• Perform data validation, data quality checks, and troubleshooting to ensure integrity and reliability of datasets
• Support data analytics initiatives by preparing datasets and enabling stakeholders to derive actionable insights
• Maintain technical documentation for data pipelines, models, and workflows and support ongoing enhancements
• Follow federal data security, governance, and privacy requirements aligned to U.S. Coast Guard systems and policies

Requirements:

• Must be a US Citizen
• Ability to obtain and maintain a Public Trust background investigation (minimum requirement)
• Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical field
• 2–5 years of experience in data engineering, ETL development, or data platform engineering
• Hands-on experience building production-grade ETL/ELT pipelines and scalable data workflows
• Experience with Databricks, Apache Spark, or similar distributed data processing frameworks
• Strong proficiency in Python, SQL, or Scala for data engineering and pipeline development
• Experience designing and maintaining data warehouse and lakehouse architectures
• Working knowledge of cloud platforms such as AWS, Azure, or Google Cloud Platform
• Experience implementing Databricks medallion architecture (bronze/silver/gold)
• Familiarity with Delta Lake, Unity Catalog, or structured streaming within Databricks
• Experience working in Agile/Scrum development environments supporting federal IT programs
• Exposure to federal data security standards and compliance frameworks (e.g., FISMA, NIST)