ThoughtStormRemote
Senior Data & Analytics Engineer (Microsoft Fabric & Power BI)
United States of America
Full-time
1 month ago
H1B Sponsor
Key skills
Microsoft FabricPower BIData EngineeringPySparkSpark SQLDAXSQLData FactoryDelta/ParquetMarketing analyticsGovernanceMonitoringAlertingAzure Data FundamentalsAzure FundamentalsProduction experienceDocumentationReliabilityAnalyticsBISparkAzurePerformance OptimizationCRM
About this role
ThoughtStorm is seeking a hands-on Senior Data & Analytics Engineer to design, build, and operate enterprise-grade Microsoft Fabric Lakehouse and Power BI solutions. This role involves managing the full lifecycle of data ingestion, transformation, and reporting, while collaborating closely with marketing and product teams.
Responsibilities:
- Design and implement Microsoft Fabric Lakehouse using Bronze/Silver/Gold (medallion) architecture
- Build and orchestrate pipelines using Fabric Data Factory
- Develop scalable transformations using PySpark and Spark SQL
- Model optimized star schemas and design Power BI semantic models
- Develop advanced DAX and optimize Power BI performance
- Implement incremental loads and CDC patterns
- Apply data quality checks , governance , and documentation/runbooks
- Configure Row-Level Security (RLS) and enterprise security standards
- Manage monitoring, alerting, and reliability for production workloads
- Support Dev/Test/Prod deployments using Fabric Workspaces and Deployment Pipelines
- Partner closely with Marketing, Growth, and Product stakeholders
Requirements:
- 8–12+ years of data engineering / analytics delivery experience
- Recent hands-on delivery using Microsoft Fabric, including: Lakehouse, Data Factory, Data Engineering (Spark), Workspaces & Deployment Pipelines
- Strong Power BI experience: Semantic models, DAX, Performance optimization
- Advanced SQL, PySpark, and Spark SQL
- Experience with Delta/Parquet, partitioning, and tuning
- Marketing analytics domain experience: Web/app events, Campaign, email, and paid media data, CRM / CDP data
- Proven production experience: Monitoring & alerting, Reliability & operations, Governance and documentation
- Design and implement Microsoft Fabric Lakehouse using Bronze/Silver/Gold (medallion) architecture
- Build and orchestrate pipelines using Fabric Data Factory
- Develop scalable transformations using PySpark and Spark SQL
- Model optimized star schemas and design Power BI semantic models
- Develop advanced DAX and optimize Power BI performance
- Implement incremental loads and CDC patterns
- Apply data quality checks, governance, and documentation/runbooks
- Configure Row-Level Security (RLS) and enterprise security standards
- Manage monitoring, alerting, and reliability for production workloads
- Support Dev/Test/Prod deployments using Fabric Workspaces and Deployment Pipelines
- Partner closely with Marketing, Growth, and Product stakeholders
- Azure Data Fundamentals (DP-900)
- Azure Fundamentals (AZ-900)