CACI International Inc is seeking a skilled Mid-Level Data Engineer to support the creation and sustainment of business intelligence tools for the Office of the Deputy Assistant Secretary of War. The role involves building data pipelines, implementing data governance policies, and collaborating with stakeholders to ensure data architecture meets visualization needs.
Responsibilities:
- Research, recommend, and implement the optimal combination of technologies for the infrastructure dashboard data platform (e.g., databases, processing frameworks, orchestration tools)
- Set up necessary data storage solutions with a focus on long-term scalability
- Connect live data via API or other appropriate mechanisms from multi-domain sources
- Collaborate with domain experts to understand Research, Development, Test & Evaluation (RDT&E) data being ingested. Ensure modeling controls for data abnormalities and structural differences
- Build a robust data pipeline for loading and transforming data into a model appropriate for STF use, considering both short- and long-term data goals
- Create and enforce data governance policies, including data quality standards, data lineage tracking, and metadata management. Communicate these policies to data analysts and stakeholders
- Monitor and optimize database and/or data model performance and security. Conduct periodic testing of pipeline health and data validity
- Work with data stakeholders and the data analyst team to ensure the background data and architecture meet the needs of requested visualizations and analyses
- Create and maintain detailed documentation for data architecture, data models, pipeline jobs, and all related processes
Requirements:
- Bachelor's degree in Computer Science, Data Science, Engineering, or a related field
- Minimum of five (5) years of experience in database and dashboard development
- Strong experience with databases, data processing frameworks, and orchestration tools
- Proficiency in API integration and data ingestion from various sources
- Experience with data modeling, ETL processes, and data pipeline development
- Expert proficiency in PowerBI
- Excellent problem-solving skills and attention to detail
- Strong communication skills and ability to work collaboratively with cross-functional teams