Intermediate Data Engineer

Progressive Insurance is dedicated to helping employees move forward in their careers. As an intermediate data engineer on the IT Data Management Team, you will assist in optimizing data and expanding the data pipeline infrastructure, enabling faster data insights and driving data governance improvements.

Responsibilities:

• Assist in the optimization of data and expanding the data pipeline infrastructure
• Build data solutions that could be consumed for data science, artificial intelligence, machine learning and other advanced data & analytic solutions
• Help drive faster time-to-insights by automating data orchestration to eliminate manual data preparation bottlenecks
• Enable analysts to extract and analyze data more rapidly decreasing time to insights
• Eliminate data silos, unlock data, and enhance data governance by centralizing disparate data sources
• Position IT data for scalable growth, managing data ingestion and transformation jobs as data complexity and volumes increase
• Research industry trends and Progressive enterprise-wide data/architecture capabilities, implement new techniques as necessary, and provide technical recommendations for advancing data strategy

Requirements:

• Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of one year of work experience designing, programming, and supporting software programs or applications
• In lieu of degree, minimum of two years related work experience designing, programming, and supporting software programs or applications may be accepted
• Experience with building data pipelines for collecting, transforming, and integrating data from various sources. Also, experience calling external API's
• Experience with cloud platforms like AWS (S3) and cloud services like Snowflake with data replication, orchestration, and transformation tools (Prefect, DBT, Airflow, etc. or similar tech stack)
• Experience with programming languages and other technical tools such as Python, R, SQL, SSIS, Power Automate/PowerApps
• Comprehensive understanding of the data lifecycle, from ideation and ETL/ELT processes, through deployment of data products, ensuring efficient data enablement and reporting solutions. Also, experience with CI/CD automation (e.g. Jenkins or Azure DevOps), Unix/Shell scripting, and experience with data warehouses
• Experience writing technical documentation