Data Based Development Systems is seeking a Data Engineer to join their production support team. The role involves supporting data ingestion, transformation, and distribution while also troubleshooting and resolving issues reported by end users.
Responsibilities:
- Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end
- Solve problems by identifying bugs and root-cause analysis
- Work with internal development and operations team to escalate issues
- Monitor production activities/processes to ensure timely and effective reporting, tracking, follow-up, and communication for related incidents
- Identifying process improvement opportunities
- Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
- Design and develop database objects, tables, stored procedures, views, etc
- Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
- Create/update/maintain comprehensive documentation
- Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement
- Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
Requirements:
- Databricks experience required
- Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, and VB
- Database platforms such as: Oracle, SQL Server, MySQL
- Big data concepts and technologies, such as: Azure Synapse & Databricks
- Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end
- Solve problems by identifying bugs and root-cause analysis
- Work with internal development and operations team to escalate issues
- Monitor production activities/processes to ensure timely and effective reporting, tracking, follow-up, and communication for related incidents
- Identifying process improvement opportunities
- Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
- Design and develop database objects, tables, stored procedures, views, etc
- Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
- Create/update/maintain comprehensive documentation
- Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement
- Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
- SAP experience with the Business Objects toolset
- Cisco Tidal scheduler
- SAP ABAP programming