Key skills
ApacheCloudPySparkPythonSparkSQLMachine LearningSnowflakeDatabricksApache SparkCI/CDLeadershipDecision MakingRemote Work
About this role
Role Overview
- Your team will develop datasets that enable data visualization, machine learning and data driven decision making across client product line
- Working with structured and unstructured datasets and automating data pipelines to ingest, analyze, validate, normalize and clean data in a hybrid multi-cloud environment
- Building data ingestion pipelines from multiple data sources using Data Bricks and Apache Spark
- Partnering with analysts, solution architects, modelers and developers to build data product and data pipelines.
- Providing technical and thought leadership
Requirements
- Strong T-SQL Skills with experience in Snowflake
- Familiarity with CI/CD methods
- Significant experience in Python development
- Highly proficient at PySpark development
- Solid grasp of database engineering and design principles
- Current Databricks Certification
- Experience in building business stakeholder relationships at all levels, leadership communications and managing project delivery from design to launch
Tech Stack
- Apache
- Cloud
- PySpark
- Python
- Spark
- SQL
Benefits
- Education Assistance/Student Loan Repayment
- up to $2400 annually
- Remote work allowance
- Internet reimbursement
- Bench pay
- Profit share
- Healthcare reimbursement
- 401k
- 4% match
- Short-Term disability
- Long-Term disability
- Life Insurance