Data Engineer Databricks - REMOTE

Dice is seeking a Data Engineer with experience in complex data solutions. The role involves supporting data transformation and distribution, collaborating with the Business Intelligence team, and developing scalable data solutions across various systems.

Responsibilities:

• Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community
• Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
• Design and develop database objects, tables, stored procedures, views, etc
• Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
• Understands the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
• Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
• Maintain comprehensive project documentation
• Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement
• Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members

Requirements:

• Experience in projects emphasizing complex data solutions
• Support data transformation and distribution to end consumers
• Assist with requirements analysis, design/develop process flow, and unit/integration testing
• Work with the Business Intelligence team and operational stakeholders to design and implement the data presentation layer
• Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
• Design and develop database objects, tables, stored procedures, views, etc
• Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
• Understand the concept of Data Marts and Data lakes and experience with migrating legacy systems to data marts/lake
• Use additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
• Maintain comprehensive project documentation
• Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement
• Strong interpersonal and communication skills to work in a team environment including customer and contractor technical, end users, and management team members
• Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, DBT
• Database platforms such as: Oracle, SQL Server, MySQL
• Big data concepts and technologies such as Synapse & Databricks
• AWS and Azure cloud computing