Data Scientist | Model & AI Risk
Macquarie Group · Sydney, Australia · 1d ago
Mid levelOn-siteData & Analytics
Our Model Risk Management team provides independent oversight and challenge of model and AI risks are well managed across Macquarie globally. We assess whether models and AI systems are fit for purpose, appropriately controlled, and aligned to the firm’s risk appetite and to regulatory expectations. The team plays a critical role in enabling safe adoption of models and AI by providing robust validation, clear challenge and sound risk-based decisions.
We are a global financial services group operating in 30 markets with 57 years of unbroken profitability. At Macquarie, you’re empowered to shape a career that is fulfilling and creates value. You will bring your insights and expertise to the task at hand and feel supported as you make your own kind of impact for a better future.
As a Data Scientist within Model Risk Management, you will independently review, challenge and validate artificial intelligence use cases across the firm. Your work will assess whether AI systems are fit‑for‑purpose, operate as intended and ensure that the risks introduced are understood, appropriately controlled, and remain within the Macquarie’s risk appetite.
You will design and execute proportionate validation approaches, assess data, methodology, assumptions, and outcomes, and clearly articulate findings to technical and non‑technical stakeholders. Your analysis and judgement will directly inform model approvals, usage decisions, and risk acceptance.
Working closely with, but independently from, model developers, product owners, and business stakeholders, you will provide constructive challenge that enables safe and sustainable AI adoption. You will also contribute to the evolution of AI validation practices, tooling and standards within the team, sharing knowledge and strengthening collective capability.
- A courageous mindset and a demonstrated track record of self directed learning, with the curiosity and discipline to stay ahead of rapidly evolving AI techniques and risks
- Attention to detail and a knack for identifying problems
- Hands-on experience designing, developing, and evaluating AI and Generative AI solutions, including Retrieval-Augmented Generation (RAG), multi-agent systems, guardrail design, synthetic data generation, and LLM-as-a-Judge evaluation frameworks.
- Experience with modern GenAI frameworks and tooling, such as LangChain, LangGraph, Google ADK, OpenAI Agents SDK, Langfuse, DeepEval, or similar platforms.
- Advanced Python programming skills, along with strong experience using GitHub, version control best practices, and CI/CD pipelines. Knowledge of additional languages such as SQL, R, and TypeScript is highly regarded.
- Practical experience with AI coding agents, including tools such as Claude Code and Codex, and the ability to develop and maintain skills, sub-agents, hooks, plugins for workflow automations.
- Experience fine-tuning, evaluating, and deploying small language models (SLMs), with an understanding of performance optimisation and model assessment techniques.
- Working knowledge of traditional machine learning models, including various regression models, random forests, Xgboost, and related model evaluation approaches.
- We recognise that no candidate will meet every requirement listed above. If you are passionate about AI and its safety, possess some of these skills, and are excited to learn and grow, we strongly encourage you to apply.
We love hearing from anyone inspired to build a better future with us, if you're excited about the role or working at Macquarie we encourage you to apply.
At Macquarie, you’re empowered to shape a career that’s rewarding in all the ways that matter most to you. Macquarie employees can access a wide range of benefits which, depending on employment type, include:- 1 wellbeing leave day per year
- Up to 5 additional service bonus leave days per year
- Up to 20 weeks’ paid parental leave for primary caregivers along with 12 days of transition leave upon return to work, and 6 weeks’ paid leave for non-primary caregivers
- 2 days of paid volunteer leave and donation matching
- Up to 12 months’ gender affirmation leave, including 6 weeks’ paid leave
- Access to Employee Assistance Program and wellbeing benefits including skin and health checks, and flu vaccinations
- Access to a wide range of salary packaging options
- Access to a wide range of learning and development opportunities, including reimbursement for professional membership or subscription
- Hybrid and flexible working arrangements, dependent on role
- Reimbursement for work from home equipment
Our Risk Management Group works as an independent, and centralised function, responsible for independent and objective review and challenge, oversight, monitoring and reporting in relation to Macquarie’s material risks. We are a global team that aims to manage the risks of today and anticipate the risks of tomorrow. Our divisions include compliance, credit, financial crime risk, market risk, operational risk, aggregate risk and prudential, and central.
We are committed to providing an inclusive environment for all, where different experiences, skills and perspectives are valued and respected. Macquarie provides access to opportunities for all individuals regardless of race, colour, religion, sex, sexual orientation, national origin, age, disability, protected veteran status, genetic information, marital status, gender identity or any other characteristic or circumstance.
We provide reasonable adjustments to individuals who may need support during the recruitment process and employment. If you require an adjustment, please let us know during the application process.