Data Platform Engineer Merger & Migration

UST is a mission-driven technology company that helps clients create transformative experiences and human-centered solutions. The Lead I - Data Engineering role focuses on migrating data assets and updating pipelines across unified AWS and Databricks environments, while also provisioning workspaces, mapping permissions, and validating migrations.

Responsibilities:

• Hands-on Migration: Execute the moving of data assets, schemas, tables, and notebooks from the source tenant to the target environment
• Pipeline Updates: Update and test data pipelines, changing storage paths, API endpoints, and connection strings to match the new unified architecture
• Workspace Setup: Use Terraform and platform APIs to spin up new, unified workspaces, clusters, and warehouses according to the new company standards
• Permissions Mapping: Recreate and map user groups, access permissions, and roles from the old systems into the new centralized governance model
• Monitoring & Validation: Run data validation tests and monitor migration logs to ensure zero data loss or downtime during cutovers

Requirements:

• UST is searching for a Data Platform Engineer Merger & Migration with solid hands-on experience using AWS (S3, IAM, EC2, Lambda) in a multi-account setup
• 2-4 years of experience working in Data Engineering, Platform Operations, or Cloud Operations
• Strong troubleshooting skills and the ability to work collaboratively to solve migration roadblocks
• Practical administration experience with Databricks (clusters, notebooks, jobs) OR Snowflake (warehouses, roles, storage integration)
• Automation Tools: Comfortable using Terraform for provisioning infrastructure and Git/CI/CD for deployment pipelines
• Core Coding: Proficient in Python and SQL for writing tests, scripting automation tasks, and verifying data structures