Software Engineer II - AI Engineering

Overview

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics and business intelligence. The products in our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

Responsibilities

As a Software Engineer II, you will own and deliver key components end-to-end, from design through production operations, with a strong focus on AI Engineering and modern LLM-based systems:

• • Design, build, and ship scalable backend services and/or libraries in Python that power Fabric Data Engineering and Data Science experiences
  • Develop LLM-enabled capabilities (prompting patterns, tool/function calling, RAG/grounding, orchestration/agents) with strong attention to latency, reliability, and cost
  • Build robust data pipelines and distributed compute solutions (Spark/PySpark) to support model/data workflows, feature generation, and large-scale analytics
  • Define evaluation strategies for LLM features (offline/online metrics, quality gates, safety checks), and implement telemetry/monitoring to continuously improve quality
  • Apply Responsible AI and security/privacy best practices (data handling, governance, access controls) when integrating AI into customer-facing products
  • Collaborate with Product Managers and partner engineering teams to translate scenarios into clear technical designs and incremental deliverables
  • Maintain and operate services in production, participate in on-call/incident response, and drive improvements in operational excellence
  • Review code and designs, mentor peers through constructive feedback, and contribute to engineering best practices across the team

Embody our culture and values 

Qualifications

Required/Minimum Qualifications 

•  Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience

Qualifications: Additional

• Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

  • OR Master's Degree in Computer Science or related technical field AND 1+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python

  • OR equivalent experience.

• Experience building production-grade Python services, libraries, or distributed systems; strong software engineering fundamentals (design, testing, performance, maintainability)

• Hands-on experience with Apache Spark/PySpark and data engineering patterns for large-scale structured and unstructured data

• Solid understanding of modern LLM systems and AI Engineering: prompting, grounding/RAG, tool/function calling, agent orchestration, and evaluation methodologies

• Experience operationalizing AI/ML features: monitoring, telemetry, experimentation (A/B), rollout strategies, and cost/latency optimization

• Familiarity with cloud-native engineering on Azure (compute, storage, networking) and secure, compliant data handling

• Experience collaborating across disciplines (PM, design, research, partner teams) to deliver customer-facing AI capabilities

Additional Job Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: 
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

Equal Opportunity Employer (EOP) 

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form (Accessibility | Microsoft Careers). 

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work. 

Software Engineering IC3 - The typical base pay range for this role across Canada is CAD $85,800.00 - CAD $169,300.00 per year.

Find additional pay information here:
https://careers.microsoft.com/v2/global/en/canada-pay-information.html

Software Engineering IC3 - L'échelle salariale de base typique pour ce rôle dans l'ensemble du Canada est de 85,800.00 $ CAD à 169,300.00 $ CAD par année.

Pour plus d'information au sujet de la rémunération, veuillez cliquer ici:
https://careers.microsoft.com/v2/global/en/canada-pay-information.html

Ce poste sera ouvert pendant au moins cinq jours et les candidatures seront acceptées de façon continue jusqu’à ce que le poste soit pourvu.

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft est un employeur offrant l’égalité d’accès à l’emploi. Tous les candidats qualifiés seront pris en considération pour l’emploi, sans égard à l’âge, à l’ascendance, à la citoyenneté, à la couleur, aux congés médicaux ou familiaux, à l’identité ou à l’expression de genre, aux renseignements génétiques, à l’état d’immigration, à l’état matrimonial, à l’état de santé, à l’origine nationale, à un éventuel handicap physique ou mental, à l’affiliation politique, au statut de vétéran protégé ou au statut militaire, à la race, à l’ethnie, à la religion, au sexe (y compris la grossesse), à l’orientation sexuelle ou à toute autre caractéristique protégée par les lois, ordonnances et règlements locaux applicables. Si vous avez besoin d’aide avec des accommodements religieux et/ou d’un accommodement raisonnable en raison d’un handicap pendant le processus de candidature, apprenez-en plus sur la demande d’accommodement.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.