Key skills
DatabricksData pipeline developmentSystem performance monitoringAccess control managementCollaborationAnalytics
About this role
VistalTech Inc is a technology company focused on data solutions, and they are seeking a Databricks Engineer to manage and optimize their Databricks environments. The role involves administering workspaces, developing data pipelines, and collaborating with teams to support data integration and reporting needs.
Responsibilities:
- Administer and manage Databricks environments, including workspace setup, access control, and cluster configuration
- Develop and optimize data pipelines and notebooks using Databricks for data processing and analytics
- Monitor system performance, troubleshoot issues, and ensure platform reliability and security
- Collaborate with data engineers, analysts, and stakeholders to support data integration and reporting needs
- Maintain documentation and follow best practices for governance, cost optimization, and platform management
Requirements:
- Administer and manage Databricks environments, including workspace setup, access control, and cluster configuration
- Develop and optimize data pipelines and notebooks using Databricks for data processing and analytics
- Monitor system performance, troubleshoot issues, and ensure platform reliability and security
- Collaborate with data engineers, analysts, and stakeholders to support data integration and reporting needs
- Maintain documentation and follow best practices for governance, cost optimization, and platform management