Central Business Solutions Inc. is seeking a Senior Data Engineer/Architect to work remotely. The role involves ingesting and processing data from various enterprise systems and building data pipelines to support AI/ML initiatives.
Responsibilities:
- Ingest and process data from Salesforce (Investments), Dynamics 365 & Coupa (Finance), Workday (HR), Concur (Operations), and external program/partner data (e.g., Health, Education)
- Build and maintain pipelines in Databricks, DBT, and Snowflake to deliver curated datasets for AI/ML
- Design simple, reusable data models to support training and inference
- Implement data quality tests, documentation, and lineage in DBT
- Ensure performance optimization, cost efficiency, and compliance with governance standards
- Collaborate with Knowledge Management (AI/Data Science) team to provide feature ready datasets
Requirements:
- Hands-on experience with Databricks (PySpark/SQL, Unity Catalog), DBT (models, tests, docs), and Snowflake (SQL, performance tuning), Delta Live Tables
- Strong background in ETL/ELT pipeline development
- Experience with enterprise SaaS systems (Salesforce, D365, Coupa, Workday, Concur)
- Solid SQL and Python skills; knowledge of data quality frameworks