Data Engineer III

Republic Services is an environmental services company seeking a Data Engineer III for its Enterprise Data organization. The role develops full-stack software, data pipelines, data lakes, data warehouses, integrations, and analytics solutions using AWS and related technologies, while participating in architecture, requirements definition, and the Agile software life cycle.

Responsibilities:

• Designs and develops code and data pipelines to ingest from relational databases (Oracle, SQL Server, DB2, Aurora), file shares, and web services
• Streaming ingestion with Kinesis Streams, Kinesis Firehose, Kinesis Analytics and Kafka(MSK)
• Build Data Lake on AWS S3 with optimal performance considerations by partitioning and compressing data
• Data Engineering and Analytics using AWS Glue, Informatica, EMR, Spark, Athena, Python
• Data modeling and building Data Warehouse using Snowflake
• Designs and develops code and data pipelines to ingest relational databases, file shares, and web services
• Designs JavaScript modules and REST APIs utilizing MarkLogic to support complex searches
• Develops MarkLogic integrations with existing enterprise platforms
• Participates in requirements definition, system architecture design, and data architecture design
• Participates in all aspects of the software life cycle using Agile development methodologies

Requirements:

• 7+ years of experience in Enterprise Information Solution Architecture, Design, and development required
• 7+ years of experience with integration architectures such as SOA, Microservices, ETL or other integration technologies
• 7+ years of experience with working content or knowledge management systems, search engines, relational databases, NoSQL databases, ETL tools, geospatial systems, or semantic technology
• 5+ years of hands-on experience with AWS services ( S3, Kinesis, Lambda, Athena, Glue, EMR) required
• 5+ years of analytics tools like SAS, R, Python, and other advanced statistical software
• 5+ years of Web development experience with Angular, JavaScript, and Node.js
• Experience with JSON or XML data modeling required
• Experience with Git/GitHub, branching, and other modern source code management methodologies required
• Domain knowledge of NoSQL or relational database required
• Understanding of database architecture and performance implications required
• Experience integrating Business Intelligence applications like Qlik Sense, Tableau, or PowerBI
• Experience with Machine Learning and Artificial Intelligence
• Ability to multi-task effectively
• Ability to work collaboratively as part of an Agile Team
• Extensive knowledge and experience with Python, JavaScript and Java
• Excellent written and verbal communication skills, sense of ownership, urgency and drive
• Bachelor's degree in Computer Science, Computer Information Systems, Engineering, Statistics or closely related field (willing to accept foreign education equivalent) (required)
• Experience in AWS services for data and analytics (required)
• 5 years of experience in Data Ingestion, Data Extraction, and Data Integration (required)
• 5+ years of hands-on experience with a MarkLogic framework , DynamoDB preferred