Big Data Engineer III (60641)

AAA Northeast is a resilient and reliable organization committed to serving its members and community. The Big Data Engineer III designs, develops, and maintains large-scale data processing systems, including data pipelines, ETL processes, data models, databases, and cloud-based data solutions. The role also involves performance optimization, security, DevOps practices, and mentoring junior engineers.

Responsibilities:

• Data Engineering: Architect and optimize ETL processes for complex data requirements. Design advanced data models to support sophisticated data processing needs. Design and manage robust, scalable data pipelines
• Database Management: Oversee the management and optimization of databases. Utilize advanced SQL techniques for complex data operations. Oversee the implementation and management of NoSQL databases. Architect and manage data warehousing solutions
• Big Data and Cloud Technologies: Lead the implementation and optimization of big data technologies. Manage and optimize distributed computing resources for large-scale data processing. Build, maintain, and manage data pipelines using cloud technologies, Snowflake, Fivetran, DBT, Airflow. Utilize cloud platforms for scalable data processing and storage
• DevOps and Security: Apply DevOps practices to automate and streamline data engineering workflows. Implement containerization solutions for data processing jobs. Implement data security measures to protect sensitive information. Optimize the performance of data processing and storage systems
• Leadership: Mentor and guide junior engineers, fostering a collaborative and innovative work environment

Requirements:

• Bachelor's Degree Computer science, Information Technology, Engineering, or a related field. required
• 6-8 years of additional relevant experience required
• 5+ years Experience in data engineering or a related field required
• Master's Degree Computer science, Information Technology, Engineering, or a related field or 5+ YOE of direct experience. preferred
• While not required, there are a variety of certifications that prove skillset (Big data certs, Azure cloud certs, Snowflake certs)