Senior Data Engineer

Velir is a mid-sized agency and data and analytics consultancy that helps client organizations manage and leverage their data effectively. The Senior Data Engineer leads complex data engineering projects, designs and maintains data infrastructure and warehouses, optimizes data pipelines, and recommends suitable tools and technologies. The role also involves cross-team collaboration, mentoring, and enabling successful delivery of engineering projects aligned with business outcomes.

Responsibilities:

• Data Engineering Leadership: You are responsible for bridging technical gaps to lead and oversee various data engineering projects for our data solutions engagements. You possess advanced data engineering knowledge and expertise, and your assignments, projects, and programs are of significant scope and/or complexity where effective decision-making requires navigating ambiguous or uncertain conditions
• Cross-Team Collaboration: You are responsible for contributing to alignment across the organization through influence and by translating context across different teams. You have a strong, foundational understanding of other Data Team functions, while also being able to translate these concepts for less technical colleagues
• Project Enablement: You are responsible for ensuring that large and/or more complex engineering projects are delivered in alignment with the appropriate business outcomes. As a senior+ member of the Data Engineering function, you serve as a mentor to data solutions team members, data engineering managers, and other data engineers, and may be embedded on a client team to unblock and upskill them
• Optimizes data pipelines to achieve low latency, ensuring timely processing and delivery of data
• Can design and implement real-time and /or micro-batch data processing solutions that handle high-volume data with low latency requirements
• Acts as an internal resource for data warehousing, providing help with advanced techniques and strategies for novel scenarios
• Has an authoritative or deep holistic understanding, deals with routine matters intuitively, able to go beyond existing interpretations, achieves excellence with ease
• Is able to be a technical leader across a set of related team's domains, consistently pushing boundaries and exploring gaps in understanding
• You can design, build, and maintain the underlying data infrastructure for a complex, large-scale system that integrates with multiple disparate data sources
• Comfortable with modeling and transforming extremely large and complex datasets in a performant and cost-efficient manner
• Understands and can execute the steps required to deploy a trained model into a production environment for offline or online scoring

Requirements:

• Because our clients are mostly US-based organizations, we look for the ability to communicate with professional proficiency in English, verbally and in writing
• • Strong programming skills in Python and SQL
• • Deep knowledge of data warehousing and ETL/ELT processes
• • Intermediate / expert proficiency with common data integration / orchestration platforms (e.g., Fivetran, Azure Data Factory, Apache Airflow)
• • Deep experience with at least one cloud data warehouse (Snowflake, BigQuery, Databricks, or similar)
• • Strong experience with at least one cloud platform such as AWS, Azure, or Google Cloud
• • Experience mentoring and advising other engineers
• • Ability to define, explain, and sell long-term vision for technical architecture, technical approaches / procedures, etc
• • Excellent communication and collaboration skills
• At this time, Velir does not sponsor candidates and unfortunately cannot accept those on OPT or CPT
• • Proven experience as a Data Engineer or related role, with a focus on designing and developing data pipelines
• Experience with Scala and Rust is a plus but not required
• • Experience with streaming solutions such as Spark Streaming, Kafka, or Flink is desirable but not required
• • Familiarity with machine learning operations (MLOps) techniques and platforms is a plus but not required