Design, develop and maintain scalable data and file ingestion framework
Collaborate with cross-functional value stream teams, analysts and business stakeholders to understand and refine the data requirements and translate them into technical solutions
Optimize data ingestion framework for performance and reliability
Follow data governance and security best practices
Troubleshoot data integrity and performance issues
Participate in code reviews and enforce coding standards
Participate in architectural decisions and design discussions
Work on initiatives to mitigate and/or alleviate core data application issues, including opportunities for process automation
Stay updated with the latest trends and technologies in data engineering and apply them to improve our data framework
Collaborate with colleagues regarding development of best practices and/or data application issues
Provide input and work on initiatives to mitigate and/or alleviate core data application issues, including opportunities for process automation
Operate independently with some latitude for un-reviewed actions or decisions
Complete other duties as assigned
Requirements
Bachelor's degree in computer science or related field (Information Systems, Mathematics, Software Engineering) or equivalent combination of training and experience
2
4 years of software development experience preferably in a Data related field
Experience with ETL development and design using Python, Big Data (Hadoop/SPARK) SQL knowledge, RDBMS experience on any recognized database (Aurora, MySQL, Postgres, Redshift)
Experience on the AWS platform
Understanding of dimensional model and ER designs
Strong written and verbal communication skills
SDLC (Software Development Life Cycle) and Agile Methodology
Exposure to Data Warehouse principles
2 years IT in financial or other highly regulated industry preferred
Use of JIRA in Agile development strongly desired
Knowledgeable about DevOps and CI/CD best practices is a plus
Tech Stack
Amazon Redshift
AWS
ETL
Hadoop
MySQL
Postgres
Python
RDBMS
SDLC
Spark
SQL
Benefits
Medical, dental, vision and life insurance
Retirement savings – 401(k) plan with generous company matching contributions (up to 6%), financial advisory services, potential company discretionary contribution, and a broad investment lineup
Tuition reimbursement up to $5,250/year
Business-casual environment that includes the option to wear jeans
Generous paid time off upon hire – including a paid time off program plus ten paid company holidays and three floating holidays each calendar year
Paid volunteer time — 16 hours per calendar year
Leave of absence programs – including paid parental leave, paid short
and long-term disability, and Family and Medical Leave (FMLA)
Business Resource Groups (BRGs) – BRGs facilitate inclusion and collaboration across our business internally and throughout the communities where we live, work and play. BRGs are open to all.