Sr. AI/ML Engineer

AlertMedia provides a Risk Intelligence and Response platform that helps organizations protect their people, operations, and brand. The Sr. AI/ML Engineer will lead the evaluation, training, fine-tuning, and integration of AI and machine learning models, while developing evaluation pipelines, optimizing AI systems, and supporting their safe and scalable deployment across the product suite.

Responsibilities:

• Train and fine-tune supervised learning models (e.g., classification, ranking, embeddings) for internal tools and customer-facing product features
• Lead prompt engineering and testing efforts to fine-tune LLM behavior for specific use cases across the product suite
• Design and implement evaluation pipelines for both LLMs and traditional ML models
• Work with and optimize Elasticsearch-backed data systems that power AI and intelligence pipelines
• Proactively identify opportunities to improve AI models, data pipelines, and engineering workflows beyond the existing roadmap
• Develop tools and frameworks to support prompt iteration, model benchmarking, and performance tracking
• Coordinate with security team to ensure adherence to AI compliance standards
• Evaluate and compare commercial and open-source LLMs (e.g., OpenAI, Anthropic, Mistral, Meta, etc.) for performance, cost, alignment, and reliability
• Collaborate with product and engineering teams to integrate AI features in a safe, scalable, and maintainable way
• Monitor, evaluate, and continuously improve the performance of AI and machine learning models in production
• Stay informed of emerging research in NLP, machine learning, and AI infrastructure, and evaluate potential applications for the business
• Contribute to AlertMedia’s culture, values and vision for the future

Requirements:

• You are an applied AI and machine learning engineer with strong data science fundamentals, deeply curious about what's possible with large language models and practical machine learning applications
• You're a collaborative engineer who thrives in a fast-moving environment, and you're as comfortable training and fine-tuning models as you are crafting prompts or evaluating model outputs
• You have a strong understanding of ML fundamentals, but you're pragmatic in applying the right solution for the problem
• 2+ years of software engineering experience
• 4–6+ years of experience in data science and/or software engineering, specifically in machine learning engineering, or applied AI
• Strong understanding of LLMs and traditional machine learning methods
• Experience with prompt engineering, model fine-tuning, and evaluation
• Familiarity with model evaluation best practices, including offline metrics, cross-validation, and A/B testing
• Proficiency in Python and ML libraries (e.g., scikit-learn, PyTorch, TensorFlow, Hugging Face)
• Experience working with Elasticsearch or other large-scale search and indexing platforms
• Experience with cloud-based ML tooling (e.g., SageMaker, Bedrock) and data workflows
• Ability to work independently and collaboratively on cross-functional teams
• Strong organizational skills and ability to manage working on multiple projects in parallel
• The ability and desire to work in a fast-paced challenging environment
• Candidates must have existing authorization to work in the U.S. without the need for sponsorship now or in the future
• Bachelor's degree in a technical field such as computer science, computer engineering or related field
• Python
• Demonstrated experience training and deploying supervised learning models, ideally in production environments (a plus)