Model Validation Senior Manager

📍London or Remote (UK) | 💰 £85,000 - £105,000 + Incentive Awards tied to your performance + Benefits

⭐Our Model Oversight team

The second line of defence Model Oversight team (that’s us!) provides support to our colleagues in Borrowing, Fincrime & Fraud, Finance and Operations to help Monzo grow safely. We’re looking for a Model Validation Senior Manager - Gen AI to lead the teams’ oversight of Generative AI models/use cases (primarily built across Monzo’s Operations squads) to provide assurance that the models/use cases we use are not only good for Monzo but what's best for our customers.

🔑You’ll play a key role by...

Driving the embedding of the Model Risk Framework for Generative AI use cases across Monzo

• Lead the collaboration with the first line of defence teams to strengthen policies, standards and procedures for Generative AI model, use case, system design and build, implementation, governance, monitoring and use. Helping to embed best practice of Generative AI across the business.
• Own the setting and maintenance of Generative AI validation methods, evidence expectations and reusable technical assets with relevant 1LoD modelling teams, applicable across all model risk areas.
• Convert modelling/validation experience into controlled playbooks, tests and working examples that can be applied to 2LoD Validation standards and processes for all Generative AI models, use cases, systems overseen by the 2LoD Model Oversight team.
• Coach Generative AI validation methodologies, to 2LoD Model Oversight colleagues, whom already have transferable Machine Learning skills, to reduce reliance on any single specialist for the validation of Generative AI models, use cases, systems so it can be consistently applied across Financial, Credit and Fincrime/Fraud models.

Leading the 2LoD Oversight of Operational Model Risk

• Perform, and oversee, independent model validations of new Operational models (primarily Generative AI models, use cases, systems), and changes to existing, using proportionate modelling techniques depending on the level of complexity applied. This includes writing clear and impactful model validation reports and presenting the findings in relevant committees.
• Build relationships with first line of defence modelling teams that develop Operational Models, and wider risk teams, to support the embedding of the model risk framework to help Monzo grow safely.
• Review ongoing model performance monitoring to ensure Operational models are performing within risk thresholds and providing support to the relevant model development team when further action is required
• Monitoring and measuring the overall level of Operational model risk that Monzo operates, and driving action plans with first line teams and appropriate governance forums to mitigate residual model risk within desired risk appetite.

Being a senior advocate of Model Risk Management best practices

• Support the effective operation of the Model Risk Oversight Committee as a regular attendee, contributing to the group discussion to improve model risk management.
• Promote and help embed a strong risk culture, making risk meaningful and relevant to everyone at Monzo. You will share best practice that is easy for everyone to understand.

🤩We’d love to hear from you if…

• You are highly motivated and energised by the idea of bringing positive impact to our customers and Monzo
• You are self-motivated and thrive in a fast-paced environment
• You have great attention to detail while keeping an eye on the big picture
• You are a great communicator, able to articulate complex problems
• You can provide effective challenge whilst building strong, respectful relationships
• You are keen to grow your knowledge in both business and technology

And, from a technical and knowledge perspective, you should have:

• Robust Data Science or Machine Learning background with strong Python capability
• Experience with design of Generative AI evaluation frameworks, architectures, methods, practical tooling and platform alignment.
• Knowledge of Gemini implementations and change assessment
• Experience of managing a modelling project through its full lifecycle
• If possible, some understanding of some of the following:
• Coaching and standard setting
• Banking MRM and regulatory context

🙌What’s in it for you

💰£85,000 - £105,000 ➕ Incentive Awards tied to your performance

📍This role can be based in our London or Cardiff offices, or be distributed working within the UK (with ad hoc meetings in London)

⏰We offer flexible working hours and trust you to work enough hours to do your job well, and at times that suit you and your team.

📚£1,000 learning budget each year to use on books, training courses and conferences.

➕ Plus lots more! Read our full list of benefits.

🌈 The application journey has 4 key steps:

- Phone call with recruiter - 30 mins
- Initial call with hiring manager - 30 mins
- Assessment & technical interview - 60 mins
- Leadership & Behavioural Interview - 60 mins

This process should take around 4-8 weeks - your schedule is really important to us, so we promise to be as flexible as possible!

We have some guidelines on using Artificial Intelligence (AI) to ace an application and interview at Monzo. You can read them here.

#LI-TK1