The Texas Department of Motor Vehicles (TxDMV) is dedicated to serving and advancing the citizens and industries of Texas with quality motor vehicle-related services. They are seeking a Systems Analyst - Data Engineer to design, develop, and maintain ETL and data pipeline solutions, ensuring data quality and system security while collaborating with various stakeholders.
Responsibilities:
- Design, develop, test, and deploy ETL pipelines using industry-standard ETL tools and technologies
- Translate business requirements into technical specifications and efficient ETL processes
- Implement data quality checks and validation rules within ETL pipelines
- Optimize ETL processes for performance, scalability, and reliability
- Document ETL processes, data flows, and technical specifications
- Extract data from various sources, including databases, APIs, flat files, and cloud storage
- Transform data into the required formats and structures for target systems
- Load data into the data warehouse and data lake
- Work with data source owners to understand data structures and ensure data accuracy
- Monitor ETL pipeline performance and identify areas for improvement
- Troubleshoot and resolve data integration issues
- Maintain and update existing ETL processes to accommodate changing business needs
- Collaborate with data/enterprise architects, BI developers, and other stakeholders to understand their data requirements
- Work closely with database administrators and infrastructure teams to ensure proper system performance
- Participate in code reviews and knowledge sharing
- May travel up to 5% of the time. Travels by car (may include flying). May include overnight travel. May require working extended hours and some evenings and weekends, as needed
- Required to attend work regularly and adhere to approved work hours in accordance with department policies and procedures
- Performs other duties as assigned
Requirements:
- Bachelor's degree from an accredited college or university in the areas of data science, data management, computer information systems, management information systems, computer science, cybersecurity or information security, or in a field related to assignment or a related field, or equivalent experience
- Two (2) years of experience in a Data Engineer or Developer-related role creating ETL pipelines with a focus on Enterprise Analytics projects
- Five (5) years of experience working with a variety of relational databases (e.g. DB2, SQL Server)
- Two (2) years of experience in ETL development using industry-standard ETL tools (e.g., Informatica, Azure Data Factory, Microsoft Fabric)
- Two (2) years of experience in administration, configuration, development, and management of data storage, integration, and ETL solutions on cloud (AWS, Azure) and on premise
- Experience in building data pipelines in AWS or Azure public clouds
- A valid Class 'C' driver's license is required. If not currently a Texas resident, must obtain a Texas Driver's License within ninety (90) days after entering Texas as a new resident
- A satisfactory driving record is required for operating state or personal vehicles to conduct department business
- Five (5) years of experience with development following the Agile formal/structured methodology
- Five (5) years in implementing scalable and efficient data workflows, including data warehousing, data lakes, and data marts
- Four (4) years of experience in trouble shooting and performance tuning ETL Workflows and SQL
- Four (4) years of experience with batch processing in mainframe, DB2, or Oracle batch framework
- Two (2) years of experience with Data Governance and Data Catalog tools such as Informatica Data Catalog
- Proficient in scripting (SQL, R, Python, etc)
- Azure or AWS cloud certifications
- AI Knowledge will be preferred