Centene Corporation is a diversified national organization focused on improving health outcomes through technology. They are seeking a Lead Data Engineer to develop and operationalize data pipelines for advanced analytics, ensuring data quality and efficiency while leading a team of data engineers.
Responsibilities:
- Uses advanced expertise and knowledge to lead the development and operationalization of data pipelines to make data available for consumption (reports and advanced analytics), including data ingestion, data transformation, data validation / quality, data pipeline optimization, and orchestration
- Works closely with the DevSecOps Engineer during continuous integration and continuous deployment
- Leads the design and implementation of standardized data management procedures around data staging, data ingestion, data preparation, data provisioning, and data destruction (scripts, programs, automation, assisted by automation, etc.)
- Leads data engineers and provides advanced experience in the design, development, implementation, testing, documenting, and operating of large-scale, high-volume, high-performance data structures for business intelligence analytics
- Leads the team using advanced experience and knowledge in the design, development, and maintenance of real-time processing applications and real-time data pipelines
- Ensure quality of technical solutions as data moves across Centene’s environments
- Provides advanced knowledge and insight into the changing data environment, data processing, data storage, and utilization requirements for the company and offers suggestions for solutions
- Develops, constructs, tests, and maintains architectures using advanced programming language and tools
- Leads and implements ways to improve data reliability, efficiency, and quality; use data to discover tasks that can be automated
- Performs other duties as assigned
- Complies with all policies and standards
Requirements:
- A Bachelor's degree in a quantitative or business field (e.g., statistics, mathematics, engineering, computer science)
- 5 – 7 years of related experience
- Experience with Big Data; Data Processing
- Experience with diagnosing system issues, engaging in data validation, and providing quality assurance testing
- Experience with Data Manipulation; Data Mining
- Experience working in a production cloud infrastructure
- Experience with one or more of the following: C# (Programming Language), Java (Programming Language), Programming Concepts, Programming Tools, Python (Programming Language), SQL (Programming Language)
- Knowledge of Microsoft SQL Servers