Cuboid IT SolutionsRemote
Data Engineer - PIPELINES MEDALLION MODELS DATA QUALITY
Remote
Contract
3 hours ago
Key skills
PythonSQLETLELTAnalyticsBIPower BISnowflakeDatabricksdbt
About this role
Data Engineer
Pipelines Medallion models data quality
Role Summary
Builds the ridership pilot automated pipelines from APIs, databases, and Excel into the Medallion model, with validation and quality checks built in.
Key Responsibilities
- Data pipelines. Build automated, scalable ingestion and transformation pipelines with orchestration and reconciliation.
- Profiling & modeling. Profile source data and implement logical/physical models across Medallion layers.
- Data quality. Implement validation, error handling, auditing, and quality checks.
- Analytical outputs. Produce validated reporting/analytical views aligned to business definitions and KPIs.
Minimum Qualifications (MQ)
- 4+ years building production pipelines on a modern data platform (Fabric, Databricks, or Snowflake).
- Strong SQL and Python / PySpark; solid ELT/ETL and orchestration.
- Experience ingesting from APIs, relational databases, and flat/Excel files.
- Hands-on Medallion / layered modeling and data-quality frameworks.
Desired Qualifications (DQ)
- dbt or equivalent transformation tooling.
- Experience preparing data for Power BI.
- Transit or operational analytics data experience.