Lead Data Engineer (Snowflake, dbt) – 12-Month Fixed-Term Contract
Commonwealth Bank · Sydney, Australia · 8d ago
See yourself in our team
Financial Crime Compliance (FCC) is a team of over 190 professionals and is an integral part of CBA’s Group Risk Function. FCC is accountable for the development, implementation and ongoing governance of the Group’s financial crime compliance program, driving the Group’s approach to managing Anti-Money Laundering and Counter-Terrorist Financing (AML/CTF), Sanctions, Anti-Bribery and Corruption (ABC), and Anti-Tax Evasion (ATE) risks and obligations.
What your role will involve
You will be part of a specialist team reporting to the Executive Manager, Financial Crime Compliance, with a primary focus on supporting ASB with the delivery of data engineering capabilities for Transaction Monitoring and broader financial crime initiatives.
This is a hands-on Lead Data Engineer role. You will act as both a senior individual contributor and the technical and people lead for a small team of 3–4 data engineers.
You will be expected to design solutions, write and review production code, build and troubleshoot data pipelines, and contribute directly to engineering delivery, while also setting technical direction, establishing engineering standards and leading the day-to-day delivery of the team.
You will work closely with stakeholders across ASB, FCC Australia and New Zealand, and technology teams to translate complex financial crime and business requirements into reliable, scalable and well-controlled data solutions.
In this role, you will:
Act as a senior hands-on engineer, designing, building, testing, deploying and supporting data engineering solutions.
Lead and line-manage a small team of 3–4 data engineers, analysts and QAs providing technical direction, coaching, feedback and development.
Lead delivery of ASB data engineering initiatives while also contributing directly to the codebase and technical implementation.
Design, build and optimise production-grade data pipelines, transformations and integration solutions.
Write high-quality, maintainable SQL and dbt code and contribute directly to complex engineering work where required.
Review code produced by the team, provide constructive technical feedback and ensure agreed engineering standards are consistently applied.
Lead technical and solution design reviews and make pragmatic engineering decisions where requirements, designs or delivery approaches are unclear.
Establish and maintain engineering standards covering coding, testing, documentation, source control, deployment, monitoring and support.
Translate business, data and financial crime requirements into practical end-to-end technical solutions.
Work across Snowflake, dbt, IBM StreamSets and related technologies to support cloud, on-premises and Oracle-integrated data patterns.
Diagnose and resolve complex data, performance and integration issues, including production problems where required.
Build data quality, reconciliation, load assurance and control requirements into engineering solutions.
Identify technical risks, dependencies and delivery constraints early and drive them through to resolution.
Work closely with engineers, architects, database teams, business SMEs and technology stakeholders to support successful delivery.
Promote reusable engineering patterns, automation and continuous improvement that improve delivery speed, maintainability and control.
Ensure solutions are secure, resilient, scalable and aligned with relevant enterprise technology and engineering standards.
We’re interested in hearing from people who:
You are an experienced senior or lead data engineer who combines strong hands-on engineering capability with the ability to lead and drive delivery through a team.
You are comfortable moving between hands-on technical work, code and design reviews, troubleshooting complex data problems, coaching engineers and engaging with senior business and technology stakeholders.
You will bring:
Strong and recent hands-on data engineering experience, including personally building and supporting production-grade data pipelines.
Advanced SQL skills and strong experience with cloud data platforms, ideally Snowflake.
Strong hands-on experience with dbt, including developing transformations, models, tests and reusable engineering components.
Demonstrated experience writing production code and remaining technically hands-on while leading other engineers.
Experience providing technical leadership to data engineers, including code review, solution design and engineering standards.
Strong understanding of software and data engineering practices including Git/source control, CI/CD, automated testing, deployment and production support.
Experience implementing data quality, reconciliation, load assurance, monitoring and control mechanisms.
Exposure to IBM StreamSets or similar data movement and integration technologies.
Experience working across cloud and on-premises integration patterns; Oracle experience would be advantageous.
Strong debugging and problem-solving skills, including the ability to investigate complex data and pipeline issues.
Ability to work through ambiguous requirements, identify gaps, challenge proposed approaches and shape fit-for-purpose solutions.
Strong stakeholder management skills and the confidence to provide technical direction across engineering, architecture, business and operational teams.
Experience in financial services, Financial Crime or Transaction Monitoring would be advantageous but is not essential.
Working with us
At CommBank, we're committed to creating an accessible, inclusive and respectful workplace. If you require support or adjustments, please let us know.
We welcome applications from people of all backgrounds, and we're particularly committed to making a positive difference for Aboriginal and/or Torres Strait Islander Peoples. For support, please contact 1800 989 696.
If this sounds like you, we’d love to hear from you.
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.