Databricks Engineer (Active Secret Clearance Required)

Loch Harbour Group is seeking a Senior Data Solutions Architect to support a high-visibility, mission-critical environment within the Navy. The role involves leading the solution lifecycle, translating business needs into technical designs, and developing data-driven solutions using tools like Databricks and Qlik.

Responsibilities:

• Lead the end-to-end solution lifecycle:
• Facilitate requirements definition in ambiguous environments
• Translate business needs into technical designs
• Develop, test, deploy, and validate solutions with end users
• Serve as the primary bridge between stakeholders and technical teams, ensuring alignment between customer needs and delivered capabilities
• Design and implement data-driven solutions leveraging Databricks, Qlik, Python, and SQL
• Perform data validation, integrity assessment, and troubleshooting, particularly within replicated environments (e.g., Navy ERP data in Jupiter)
• Develop and maintain data pipelines, data models, and analytics solutions across data lakes and data cubes
• Conduct risk assessments and mitigation planning for data, systems, and solution delivery
• Work in a rapid Agile delivery model, supporting mission-critical needs with tight timelines
• Collaborate with:
• Jira/Atlassian administrators
• Data scientists and visualization teams
• Government stakeholders and functional users
• Support front-end solution development using Qlik, enabling downstream dashboarding and analytics
• Ensure delivered solutions meet performance, usability, and mission requirement

Requirements:

• 10+ years of experience in data engineering, software development, or solution architecture
• Demonstrated experience leading end-to-end solution delivery from requirements through deployment
• Expert-level proficiency (non-negotiable): Databricks, Qlik (Qlik Sense / QlikView), Python, SQL
• Strong experience with: Data lakes and/or data cubes, Data modeling and transformation, Data validation and integrity analysis, Power BI, PowerShell
• Proven ability to: Operate in highly ambiguous environments, Define requirements where none are clearly stated, Work independently with minimal oversight, Lead technical efforts without formal authority
• Strong analytical and troubleshooting skills, particularly with complex or conflicting data
• Excellent communication skills, with the ability to interface directly with government stakeholders
• Experience working in Agile / rapid development environments
• Experience with: Navy ERP or similar financial systems, Replicated or synthetic data environments (e.g., Jupiter or similar)
• Experience integrating with: Jira / Atlassian ecosystems
• Familiarity with: Federal or DoD environments, Data governance and compliance standards
• Relevant certifications (preferred, not required): Databricks certification, Agile /Scrum certifications, Data engineering or cloud certifications