Key skills
AWSAzureCloudDistributed SystemsDockerJavaKubernetesLinuxPythonShell ScriptingSparkUnityShellData LakeSnowflakeDatabricksAgileCommunicationCollaboration
About this role
Role Overview
- Manage data governance capabilities, such as metadata, data lineage, data quality, etc. for various workloads within a cloud and across cloud environments.
- Design and implement scalable data governance solutions using technologies such as Snowflake, Databricks, Collibra, etc.
- Develop and optimize data pipelines for ingestion, transformation, and storage to ensure meeting various data governance requirements.
- Diagnose and resolve issues related to networks, job failures, and performance bottlenecks.
- Provide on-call support and collaborate with other teams to ensure smooth operations.
- Deploy and manage containerized applications.
- Collaborate well across functional teams and business lines to support data governance solutions in the cloud.
Requirements
- Bachelor’s degree, or equivalent work experience
- Four to six years of relevant experience
- Working knowledge of Microsoft Azure cloud or AWS.
- Extensive experience in data governance and technologies such Databricks Unity Catalog, Collibra, Snowflake.
- Working knowledge and hands-on experience in Data Lake Architectures, such as Databricks and Snowflake platforms.
- Working knowledge with Java, Shell scripting, Python, Spark languages.
- Proficiency in Linux and distributed systems
- Adept with agile software development lifecycle and DevOps principles.
- Strong problem-solving skills and the ability to diagnose and resolve system failures and performance.
- Experience in addressing PCI and PII data requirements.
- Experience in cloud-native architectures (Azure/AWS), Kubernetes, Docker, etc.
- Excellent ability to analyze problems and develop effective solutions
- Excellent communication and collaboration skills to work effectively with cross-functional teams
Tech Stack
- AWS
- Azure
- Cloud
- Distributed Systems
- Docker
- Java
- Kubernetes
- Linux
- Python
- Shell Scripting
- Spark
- Unity
Benefits
- Healthcare (medical, dental, vision)
- Basic term and optional term life insurance
- Short-term and long-term disability
- Pregnancy disability and parental leave
- 401(k) and employer-funded retirement plan
- Paid vacation (from two to five weeks depending on salary grade and tenure)
- Up to 11 paid holiday opportunities
- Adoption assistance
- Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law