Key skills
DatabricksPythonSQLSparkSSISSSRSData warehousingData integrationETLData WarehousingSQL Server
About this role
CFS is a financially sound company that emphasizes living their core values and offers a team-oriented culture. They are seeking a Data Engineer responsible for designing, developing, and maintaining robust ETL pipelines and collaborating with business users to understand reporting requirements.
Responsibilities:
- Design, develop, and maintain robust ETL pipelines using Databricks, Python, Spark and SQL
- Migrate legacy SSIS packages to modern Databricks solutions
- Maintain and optimize existing SSIS packages and SSRS reports
- Participate in data warehouse design and implementation
- Implement data quality checks and validation processes
- Collaborate with business users to understand reporting requirements
- Troubleshoot and resolve performance issues across data platforms
- Document all development work and procedures thoroughly
Requirements:
- Design, develop, and maintain robust ETL pipelines using Databricks, Python, Spark and SQL
- Migrate legacy SSIS packages to modern Databricks solutions
- Maintain and optimize existing SSIS packages and SSRS reports
- Participate in data warehouse design and implementation
- Implement data quality checks and validation processes
- Collaborate with business users to understand reporting requirements
- Troubleshoot and resolve performance issues across data platforms
- Document all development work and procedures thoroughly
- MUST HAVE experience with Databricks
- Experience with Python, Spark, and Delta Lake
- Strong proficiency in SQL Server, T-SQL, stored procedures, and functions
- Experience with SSIS and SSRS development and maintenance
- High level proficiency in data integration and reporting
- Knowledge of data warehousing concepts and best practices