Associate Manager, Data Engineering

Tredence Inc. is a company focused on data engineering and analytics, and they are seeking an Associate Manager to oversee end-to-end delivery in data engineering projects. The role involves managing teams, optimizing data pipelines, and working cross-functionally to meet business requirements.

Responsibilities:

• Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders
• Follow the Agile development methodology; think strategically and execute methodically
• Develop and manage capacity and growth projection forecasts of the environment within budgets
• Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements
• Drive optimization, testing and tooling to improve quality of solutions
• Manage teams that build and operate high volume distributed systems in a SaaS environment
• Great at devising efficient processes that increase velocity and quality
• Managing and administering Databricks environment include managing workspace setup, user permissions, cluster configuration, security policies, and cost optimization

Requirements:

• Bachelor's degree (or foreign equivalent) in Data Science, Information Technology, or related field
• Five (5) years of experience in the job offered or a related position
• Demonstrable knowledge of: Python
• Demonstrable knowledge of: SQL
• Demonstrable knowledge of: Databricks
• Demonstrable knowledge of: Snowflake
• Demonstrable knowledge of: Azure Data Lake Storage
• Demonstrable knowledge of: Azure Data Factory
• Demonstrable knowledge of: Power BI
• Demonstrable knowledge of: Apache Spark
• Demonstrable knowledge of: Apache Airflow
• Demonstrable knowledge of: GitHub CI/CD
• Demonstrable knowledge of: Kubernetes
• Travel to unanticipated client locations throughout the U.S. approximately 30%, as required
• May telecommute from any location within the U.S