Versant MediaRemote
Data Engineer II -AWS Data Platform (Redshift, Glue, and Airflow)
United States of America
Full Time
6 hours ago
H1B Sponsor Likely
Key skills
Data WarehousingOLAPMultidimensional Database ArchitectureSQLPythonAmazon RedshiftNoSQLAWS GlueApache AirflowAPI DevelopmentDimensional Database ArchitectureSystems Life Cycle MethodologyCloud Data Warehouse OperationsTableauSQL Server Reporting Services (SSRS)Data StreamingAzureGoogle Cloud Platform (GCP)T-SQLPL/pgSQLETL/ELT DevelopmentData Pipeline DevelopmentGolangVendor Partner ManagementETLELTAnalyticsBIRedshiftAirflowAWSGCPGlueCommunication
About this role
VERSANT Media is an industry-changing media and entertainment business that operates across various markets. They are seeking a Data Engineer II to design and develop data pipelines and data marts, supporting their data warehousing environments and analytical needs.
Responsibilities:
- The candidate will design and develop data pipelines, data marts, and schemas to support our data warehousing environments and analytical requirements
- Database architecture and design of data warehouses & data marts to support presentation layers elastic cubes, reporting and analytics
- Hands on experience with tsql or psql development, query tuning, table development, stored procedures, functions
- Hands on experience with creating indexes to enhance performance of workloads
- Hands on experience with development of ETL/ELT processes, share responsibilities for monitoring the data warehouse and data marts
- Hands on development and support of data pipelines in Airflow, AWS Glue, Azure Data factory, Python, Golang
- Hands on experience with cloud environments Azure, AWS, GCP
- Troubleshoot and resolve data issues in production system
- Communicate with business users and project managers to resolve business problems and create solutions
- Use of technical experience to suggest better solutions to new and existing problems
- Involvement with other IT departments providing systems communication processes
- Meet with various IT groups (other departments and computer operations' staff) to address issues/concerns. This includes other business unit IT groups, as well as the technical operations group (Server Group and other Infrastructure groups)
- Identify software solutions needed for new projects
- Weekly reporting to management on project status and issues
- On call production support
Requirements:
- 5 years of data warehousing / OLAP experience
- 5 years multidimensional database architecture and design experience
- 5+ years of SQL Experience
- 3+ years of Python Experience
- 2+ years of Redshift Experience
- 2+ years of NoSQL Experience
- Team and vendor partner management
- Clear understanding of principles and techniques of Web development
- Experience with AWS Glue and Airflow
- Experience with API
- Dimensional database architecture experience
- Formal systems life cycle methodology experience
- Cloud Data Warehouse operations experience
- Tableau, SSRS, big data and Realtime BI experience
- Experience with data streaming