Data Analyst Databricks / PySpark / Power BI
Client: NCDIT State of North Carolina
Job ID: 814178
Location: North Carolina (Hybrid)
Duration: Long-Term Contract
Job Description
NCDIT is seeking a highly skilled Data Analyst with strong expertise in Databricks, PySpark, Spark SQL, and Power BI to support enterprise data initiatives. The ideal candidate will be responsible for analyzing complex datasets, developing data mappings, building insightful dashboards, and collaborating with business and technical stakeholders to deliver high-quality data solutions.
This role requires a blend of technical data analysis, business requirement gathering, documentation, and stakeholder communication. The selected candidate will work closely with data engineers, technical leads, and development teams throughout the data lifecycle.
Key Responsibilities
Analyze large and complex datasets to identify trends, patterns, and business insights.
Use Databricks, PySpark, and Spark SQL to query, transform, and analyze enterprise data.
Create detailed source-to-target data mappings and support data integration initiatives.
Develop and maintain interactive dashboards and reports using Power BI and Databricks visualization tools.
Collaborate with data engineering teams to design and deliver scalable data products.
Build and maintain Gold-layer datasets to support reporting, analytics, APIs, and business applications.
Ensure data quality, integrity, and consistency across multiple data sources.
Gather and document business requirements and translate them into data-driven solutions.
Prepare technical documentation, data models, data mappings, and reporting specifications.
Participate in solution design discussions, sprint planning, and stakeholder meetings.
Perform statistical analysis, data mining, and exploratory analytics to provide actionable business insights.
Required Qualifications
Strong experience with Databricks and PySpark.
Hands-on expertise in Spark SQL and complex query development.
Experience designing and developing dashboards using Power BI.
Strong understanding of data analysis, data profiling, and data validation techniques.
Experience creating data mapping and transformation documentation.
Knowledge of data warehousing and data modeling concepts.
Experience collaborating with cross-functional teams and business stakeholders.
Strong communication, analytical, and documentation skills.
Preferred Qualifications
Experience with Databricks native reporting and visualization features.
Knowledge of Medallion Architecture (Bronze, Silver, Gold layers).
Experience supporting APIs and downstream analytical applications.
Exposure to machine learning, predictive analytics, and data mining techniques.
Previous experience working within government, public sector, or large enterprise environments.
