Senior Data Scientist, AI & Model Risk

Block is a company focused on redefining the world’s relationship with money through innovative financial products. They are seeking a Senior Data Scientist to lead AI risk assessments and coordinate with various stakeholders to ensure responsible AI deployment in compliance with regulatory standards.

Responsibilities:

• Lead end-to-end AI Risk Assessments for generative AI and LLM use cases across the Bank; Embedding in Block's enterprise-wide GenAI review process, coordinating cross-functional SMEs (Legal, Compliance, InfoSec, Data Governance, MRM, ERM, BRC, TPRM, Financial Crimes), and managing timelines to ensure reviews are completed within SLA
• Review AI system design and documentation; Including retrieval sources, assumptions, limitations, fallback plans, guardrail configurations, and change management procedures — across banking use cases such as fraud detection, BSA/AML compliance, credit decisioning, and customer-facing applications, ensuring governance controls are commensurate with each use case's risk profile
• Assess pre-deployment testing for adequacy inclusive of output integrity, hallucination detection, boundary and edge case testing, ethical and safety guardrails, bias testing, A/B testing, volume testing, and UAT — designing and conducting independent testing as needed
• Evaluate ongoing monitoring plans for comprehensiveness - including accuracy, hallucination rates, drift detection, sensitive data controls, reliability metrics, CSAT, acceptable performance ranges, and documented remediation procedures
• Develop and maintain templates, tools, and procedures to support the effectiveness and scalability of the AI Risk Governance Program
• Monitor the evolving regulatory landscape for AI in banking — including FFIEC IT Examination Handbook standards, FDIC Financial Institution Letters, interagency statements, and the anticipated RFI on AI model risk management referenced in SR 26-2 — and incorporate emerging guidance into the AI risk governance program; support SFS's response to regulatory inquiries as needed