AzureCloudCyber SecurityAIMLLarge Language ModelsRAGAzure ADSaaSLeadership
About this role
Role Overview
The AI Solution Analyst plays a critical role in evaluating, testing, and validating AI‑related software tools, copilots, agents, and automation platforms for enterprise use across Teledyne.
Conduct hands‑on technical evaluations of AI software tools, copilots, AI agents, RAG systems, and emerging AI platforms.
Assess capabilities, limitations, performance, model behavior, integration feasibility, and operational requirements.
Develop structured test plans, evaluation frameworks, and comparison matrices for consistent assessment.
Document findings, risks, limitations, and recommendations for technical and executive audiences.
Analyze how candidate tools integrate with existing enterprise environments (Microsoft 365, Azure, SharePoint, on‑prem systems).
Collaborate with enterprise architecture and infrastructure teams to determine technical feasibility.
Support AI governance processes, including privacy, data‑handling assessments, and policy compliance.
Coordinate proof‑of‑concept (POC) activities with vendors and internal stakeholders.
Provide ongoing updates to IT leadership, the AI Champions, and business units.
Work with the AI Governance Committee, Cybersecurity, IT, and business units to gather requirements and evaluate use cases.
Requirements
5-10+ years of experience in IT systems, software evaluation, enterprise applications, or technical analyst roles.
Solid understanding of enterprise technology fundamentals including: Microsoft 365 and Azure ecosystem
Microsoft Copilot, Copilot Studio, Azure AI/ML services, or similar platforms.
Identity & Access Management (Azure AD/Entra)
API integrations and data flows
Cloud/SaaS security concepts
Experience conducting technical evaluations of software tools or platforms.
Working understanding of large language models (LLMs), embeddings, RAG pipelines, and AI agent concepts.
Familiarity with key AI risk themes: hallucinations, bias, safety guardrails, data leakage, and model evaluation.
Strong analytical mindset and problem‑solving capability.
Excellent written documentation skills for both technical and executive audiences.
Ability to manage multiple evaluations, pilots, and stakeholder groups simultaneously.
Comfortable presenting findings and recommendations to leadership.