Data Platform Engineer Merger & Migration

UST is seeking a Data Platform Engineer to support data platform mergers and migrations. The role involves moving data assets into target environments, updating pipelines, provisioning workspaces, mapping permissions, and validating migrations to prevent data loss or downtime.

Responsibilities:

• Hands-on Migration: Execute the moving of data assets, schemas, tables, and notebooks from the source tenant to the target environment
• Pipeline Updates: Update and test data pipelines, changing storage paths, API endpoints, and connection strings to match the new unified architecture
• Workspace Setup: Use Terraform and platform APIs to spin up new, unified workspaces, clusters, and warehouses according to the new company standards
• Permissions Mapping: Recreate and map user groups, access permissions, and roles from the old systems into the new centralized governance model
• Monitoring & Validation: Run data validation tests and monitor migration logs to ensure zero data loss or downtime during cutovers

Requirements:

• solid hands-on experience using AWS (S3, IAM, EC2, Lambda) in a multi-account setup
• 8+ years of experience working in Data Engineering, Platform Operations, or Cloud Operations
• Strong troubleshooting skills and the ability to work collaboratively to solve migration roadblocks
• Practical administration experience with Databricks (clusters, notebooks, jobs) OR Snowflake (warehouses, roles, storage integration)
• Comfortable using Terraform for provisioning infrastructure and Git/CI/CD for deployment pipelines
• Proficient in Python and SQL for writing tests, scripting automation tasks, and verifying data structures