WeVision LLC is a leading global streaming and media technology company seeking a Sr. Data Engineer Consultant to support the development of a large-scale Audience Data Platform. The role involves building scalable data infrastructure to process consumer behavior data and deliver insights for marketing and business decision-making.
Responsibilities:
- Design, develop, and maintain large-scale data pipelines that capture and process consumer interaction data across multiple platforms
- Contribute to the development of the Audience Manager Platform (AMP), a centralized system that unifies customer profiles and provides a trusted source of audience insights
- Build scalable and fault-tolerant data processing systems to ensure reliable delivery of audience data to multiple business endpoints
- Develop backend data services and pipelines that support data ingestion, transformation, and activation workflows
- Work with cross-functional teams including data scientists, analytics teams, product teams, and business stakeholders to enable timely access to high-quality audience data
- Optimize and maintain distributed data processing frameworks to improve system performance and scalability
- Ensure high data quality, reliability, and observability across production data systems
- Serve as a technical point of contact or SME for data engineering systems in a multi-system production environment
Requirements:
- 4+ years of experience in big data engineering, building and maintaining large-scale data pipelines
- Hands-on experience with distributed data processing systems such as Spark (PySpark) or Flink
- Strong programming skills in Python and SQL for processing large datasets
- Experience with at least one MPP or cloud data warehouse such as Snowflake, Redshift, BigQuery, or Databricks
- Solid understanding of data modeling, data warehousing concepts, and best practices
- Experience supporting production data environments and acting as a technical point of contact or subject matter expert
- Strong analytical, problem-solving, and communication skills, with high attention to detail
- Bachelor's degree in Computer Science, Information Systems, Software Engineering, Electrical/Electronics Engineering, or a related technical field, or equivalent practical experience
- Minimum of 4 years of relevant professional experience in data engineering or related roles
- Experience working with AWS cloud technologies (e.g., S3, ECS, EMR, EC2, Lambda)
- Hands-on experience with data orchestration and integration tools such as Airflow
- Familiarity with CI/CD practices for data pipelines
- Experience working within Agile or Scrum development environments