West MonroeRemote
Senior Data Engineer
United States of America
Full Time
2 weeks ago
$126,000 - $148,000 USD
H1B Sponsor Likely
Key skills
DatabricksSnowflakeDatabricks DataFramesDatabricks DatasetsSpark SQLDelta LakeDatabricks NotebookDatabricks File System (DBFS)Databricks ConnectSnowflake WorksheetsSnowflake Virtual WarehousesSnowflake TablesSecure Data SharingSnowpipeSnowflake Time TravelSnowflake Streams & TasksMachine Learning PipelinesData Engineering FrameworksData Architecture PrinciplesData ModelingETL ProcessesData GovernanceData QualityData Privacy ControlsData Security ControlsAzure Data TechnologiesAWS Data TechnologiesSQLMachine LearningETLData EngineeringSparkAWSAzureLeadershipMentoring
About this role
West Monroe is a global business and technology consulting firm that is looking for a Senior Data Engineer to solve technology needs for their clients. The role involves collaborating with product teams, implementing advanced data engineering strategies, and mentoring a high-performing team of data engineering professionals.
Responsibilities:
- Collaborate closely with product teams to deliver impact
- Implement advanced data engineering strategies leveraging Databricks and/or Snowflake platform capabilities
- Work on complex, large-scale data transformation initiatives for enterprise clients
- Understanding customer objectives, goals and challenges to engineer innovative solutions
- Create and evangelize innovative architectural patterns and reusable solution frameworks
- Mentor and develop a high-performing team of data engineering professionals
- Implement advanced data solutions using Databricks and/or Snowflake, focusing on scalability, performance, and business value
Requirements:
- 5 years of progressive experience in data engineering, with expertise in Databricks and or Snowflake platform
- Experience in Databrick's core components like DataFrames, Datasets, Spark SQL, Delta Lake, Databricks Notebook, DBFS, and Databricks Connect
- Expeirence in Snowflake's core components like Snowflake Worksheets, Virtual Warehouses, Snowflake Tables, Secure Data Sharing, Snowpipe, Time Travel, and Streams & Tasks
- Experience in machine learning pipelines and data engineering frameworks
- Experience in implementing enterprise-scale data platforms as part of a collaborative team
- Proven ability to translate complex technical concepts for business leadership
- Knowledge of data architecture principles, including data modelling, ETL processes, data governance, data quality, privacy and security controls
- Experience working in a fast-paced, collaborative, and team=based project environment
- Willingness to travel to client sites up to 50%
- Hybrid work environment – 2x/week in office
- Certifications in Databricks, Azure, and/or AWS data technologies preferred
- Consulting firm experience preferred