Sr Data Engineer

Horizontal Talent is seeking a Senior Data Engineer in a dynamic remote role that leverages Python and AI expertise to develop scalable solutions. The role involves designing services focused on automation, enhancing AI communication, and managing data pipelines while collaborating with cross-functional teams.

Responsibilities:

• Design and develop services using Python that focus on automation and optimization
• Enhance agent communication in AI systems with MCP frameworks
• Transform and manage data pipelines to expand AI capabilities
• Deploy and optimize solutions on major cloud platforms to ensure efficiency
• Work closely with diverse teams to deliver integrated solutions
• Maintain high standards of code quality, security, and maintainability

Requirements:

• High proficiency in Python, including API development and async processing
• Experience designing AI agents and implementing coordination frameworks
• Strong background in managing SQL and NoSQL databases
• Competence in using cloud technologies like Azure, AWS, or Google Cloud
• Skilled in CI/CD processes and deployment in cloud-native environments
• Knowledge of vector databases and embedding techniques
• Understanding of MLOps or LLMOps for operational efficiency
• Experience with streaming data and event-driven architecture
• Familiarity with security and compliance for AI systems
• Background in regulated sectors like healthcare