Participate in developing high quality, scalable software modules for next generation analytics solution suite
Engage in activities with cross-functional IT unit stakeholders (e.g., database, operations, technical support, etc.)
Formulates logical statements of business problems and devises, tests and implements efficient, cost-effective application program solutions
Identify and validate internal and external data sources for availability and quality
Work with SMEs to describe and understand data lineage and suitability for a use case
Create data assets and build data pipelines that align to modern software development principles for further analytical consumption
Perform data analysis to ensure quality of data assets
Perform preliminary exploratory analysis to evaluate nulls, duplicates and other issues with data sources
Assist in developing code that enables real-time modeling solutions to be ingested into front-end systems
Produce code artifacts and documentation using GitHub for reproducible results and hand-off to other data science teams

2+ years of relevant experience recommended
Bachelor’s degree in Computer Science, Engineering, IT, Management Information Systems, or a related discipline
Experience in R (preferred), Python, and SQL
Experience in ingesting data from a variety of structures including relational databases, Hadoop/Spark, cloud data sources, XML, JSON
Experience in ETL concerning metadata management and data validation
Experience in Linux and Git
Experience in Automation tools (Autosys, Cron, Airflow, etc.)
Exposure to AWS Services (i.e. S3, EMR, etc) a plus
Able to communicate effectively with both technical and non-technical teams
Able to translate complex technical topics into business solutions and strategies

Data Engineer

Key skills