DirectClient: Texas Health and Human Services Commission(HHSC)
Solicitation Number: 529701754
Title: Databricks Engineer
Location: 4601 W Gudalupe St Austin, TX 78751
Duration: 9/1/2026 to 8/31/2027 with possible extension
Last date for submission: July 31, 2026 (12.00 PM-CST)
Important Note: Position will be 3 days remote with 2 days (Wednesdays and Thursdays) required to be onsite. Texas local candidates only.
DESCRIPTION OF SERVICES:
The Databricks Engineer should design, develop, and optimize scalable data solutions on Databricks, leveraging PySpark or Scala for large-scale data processing. Build and maintain ingestion pipelines, Declarative Pipelines (DLT), and Medallion Architecture (Bronze, Silver, Gold) to support enterprise analytics and reporting. Develop robust data models and implement data quality, validation, and governance frameworks. Create dynamic dashboards, Databricks Apps, and analytical solutions to deliver actionable business insights. Optimize workloads, monitoring, and operational processes to ensure scalability, security, and cost efficiency.
CANDIDATE SKILLS AND QUALIFICATIONS
Minimum Requirements:
Years Required/Preferred Experience
8 Required Experience in IT, supporting the design, development, deployment, or delivery of technology solutions.
8 Required Experience with Databricks, including building and optimizing ETL/ELT data pipelines using Apache Spark.
8 Required Experience in data warehousing and dimensional data modeling (star/snowflake schemas).
8 Required Proficiency in SQL and Python (or Scala) for large-scale data processing.
8 Required Experience designing and developing dashboards and applications natively within Databricks (e.g., Databricks SQL dashboards, Databricks Apps).
8 Required Experience implementing data governance, data quality, and data security practices.
8 Required Experience implementing Lakeflow Declarative Pipelines (formerly Delta Live Tables/DLT) for building and managing production data pipelines.
8 Required Experience with (bronze/silver/gold layers), data lakehouse design, and creating and scheduling offline jobs using Lakeflow Jobs (formerly Databricks Workflows) or similar orchestration tools (e.g., Airflow).
8 Required Excellent communication skills, both verbal and written, including presenting insights to technical and business stakeholders.
1 Preferred Experience working in public sector or state government environments.
1 Preferred Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).
1 Preferred Experience with CI/CD practices for data pipelines (DevOps, Git-based workflows).
