Crossing Hurdles is seeking a Data Engineer to design, implement, and manage data pipelines for AI agent training initiatives. The role involves collaborating with AI/ML engineers, developing scalable ETL processes, and optimizing AI model performance through effective data engineering practices.
Responsibilities:
- Design, implement, and manage data pipelines for AI agent training initiatives
- Collaborate with AI/ML engineers to ensure efficient data flow and high-quality datasets
- Develop and maintain scalable ETL processes using Python, MySQL, and PostgreSQL
- Integrate diverse data sources using Java and JavaScript for seamless data exchange
- Optimize AI model performance through effective data engineering practices
- Document data workflows and communicate technical concepts to stakeholders
- Troubleshoot data issues and ensure data integrity and reliability
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field
- Strong experience as a Data Engineer with exposure to AI/ML projects
- Advanced proficiency in Python, MySQL, PostgreSQL, Java, and JavaScript
- Strong understanding of AI concepts and data preparation for model training
- Excellent written and verbal communication skills
- Ability to build scalable data pipelines and architectures
- Self-motivated with the ability to work effectively in a remote environment