Key skills

PythonFastAPI or FlaskKubernetesOIDC/OAuth 2.0Microsoft AzureAmazon Web ServicesTerraformJenkins or GitHub ActionsSQL and relational data modelingAPI gateway engineeringLLM platform engineeringPrometheus and GrafanaWritten and verbal communicationSQLAIOpenAISnowflakeFastAPIFlaskAWSAzureJenkinsGitHub ActionsEKSAKSHelmIAMBedrockEntra IDPostgreSQLSQL ServerPrometheusGrafanaGitHubGitOpsCI/CDCollaboration

About this role

TMC is a global community of highly skilled engineers and digital experts delivering high-tech solutions for leading companies across multiple industries. The AI Platform Engineering Specialist will help build, operate, secure, and scale a firmwide AI Development Platform, including its gateway, cloud deployments, APIs, data layer, observability, and platform controls. The role also supports enterprise adoption, production operations, security reviews, and collaboration with cloud, network, and security teams.

Responsibilities:

Design, build and operate the AI Gateway’s Azure and AWS deployments, taking them from proof of concept to production
Develop and extend Python services using FastAPI / Flask to provide the Gateway’s inference, onboarding and administrative APIs
Integrate new model providers and model families, including Azure AI Foundry / Azure OpenAI and AWS Bedrock, covering request signing, streaming responses, failover and quota handling
Implement cloud-native authentication and secrets handling, including Entra ID with Managed Identity and workload federation, AWS IAM roles and STS, with the goal of eliminating stored credentials
Build and evolve the entitlement and authorization data layer across SQL Server and PostgreSQL, including schema changes, migrations and data-correctness controls
Own platform controls including rate limiting, token accounting, content guardrails, audit logging and chargeback reporting
Deploy and run services on Kubernetes, including on-premises, AKS and EKS, using Helm, GitOps and Terraform, while keeping CI/CD pipelines healthy with Jenkins and GitHub Actions
Build observability capabilities across metrics, logs and dashboards using Prometheus, Grafana, Loki and Snowflake
Work with cloud platform, network and security teams on connectivity, egress policy, network controls and architecture reviews, and produce the evidence required for those reviews
Support production through on-call participation, incident investigation, fixes and platform hardening
Write tests and documentation as part of delivery and review peers’ changes