Senior Data Engineer
Octopus Deploy · Australia +1 · 1mo ago
About Octopus Deploy:
Octopus Deploy sets the standard for Continuous Delivery, empowering software teams to deliver value in an agile way. Over 4,000 organizations globally – including Ubisoft, Xero, Stack Overflow, NASA, and Disney – rely on our Continuous Delivery, GitOps, and release orchestration solutions.
Founded in Australia in 2012, our team of over 300 Octonauts now spans the globe. We combine high growth and big ambitions with a sustainable, balanced working environment. Our revenue has grown consistently between 20–50% every year for the past 9 years, and we’ve been profitable for 10 out of the past 12 years. Octopus now provides the industry's most comprehensive Continuous Delivery solution for organizations operating at scale.
We’ve been remote-first since 2015 and work with an uncommon level of transparency. You can read our public handbook to learn how we work. We have a transparent approach to compensation that ensures people doing the same work with the same skill get paid the same, with well-defined career pathways. We foster a supportive, collaborative, and high-trust environment. We leave our job titles at the door and focus on doing what’s best for our customers and team. Our leaders never shy away from answering the tough questions at our all-hands calls or in 1:1s. We conduct interviews and onboarding virtually as part of being a remote-first company.
Role Summary
Are you a Data Engineer who thrives at the intersection of data and software engineering? Are you excited about the impact of AI and context engineering in the world of data? We want you to shape the future of our Data Platform that serves both our internal organisation and our customers.
We're part of the Platform group at Octopus and are looking for a Data Engineer to join our small, nimble team. If you've always wanted the freedom and autonomy to build the best Data Platform in a DevOps-centred organisation, we'd love to hear from you!
What You'll Be Doing:
- Taking ownership of the end-to-end development lifecycle of new data-platform capabilities - solution architecture and design, instrumentation → ingestion → transformation, security, CI/CD and instrumenting the monitoring of it.
- Redefining how Analytics works in a world of AI, shifting from managing not just data, but building innovative solutions to manage context and AI Agents. Tackling challenges like non-determinism and managing the impact of scale and cost that AI based systems have.
- Collaborating with stakeholders, such as Organisational Leaders, Product Managers, Designers, Customer Engineers to model and deliver data to be used for insights - pair with your colleagues to get the right results.
- Bringing your strong opinions, loosely held for technical discussions and strategies to ensure high-quality solutions and alignment with company goals.
- Managing the operational day-to-day of the platform - ensuring it's reliable, performant and cost effective.
We're looking for someone like you who
- 3+ years and demonstrable experience as a data (or software-engineer), explicitly building Data Platform capabilities, using modern cloud based technology (Azure/AWS, Snowflake, Databricks, Clickhouse etc). You come with a strong understanding of data engineering and principles.
- You have a firm grasp on languages used predominately in the data-engineering landscape, preferably proficiency in SQL and strong Python experience.
- Lived experience working with the latest in data, this might include working with technology like Apache Iceberg, new-age data-stores (DuckDB, Clickhouse) or building pro-active analytics with agents.
- Background in working on real-time and streaming based problems - you have experience in the likes of Kafka, Flink or near-real-time OLAP databases like Clickhouse, RisingWave and Interactive Tables (Snowflake).
- A genuine and enthusiastic interest in the way data-engineering is evolving alongside artificial intelligence systems. This includes a desire to stay abreast of the latest advancements, experiment with AI based solutions, and actively participate in advancing our Data Platform and keeping it at the cutting edge of AI.
- You come with a pragmatic approach to the idea of self-service analytics and data-as-a-product, along with other data-mesh like principles.
- You enjoy working in a "you built it, you run it" culture, where teams take pride in the quality of their work and the availability of their systems.
- You enjoy collaborating with other people to solve problems, challenging each other to discover the best solution for a problem using a balance of passion, pragmatism, and empathy.
- You are a results-oriented person, focused on iteratively delivering valuable things to your customers, willingly changing direction based on clear and transparent business information, and someone who helps others do the same.
Nice to have:
- You've already built or worked on AI based solutions, such as creating agents.
- Strong familiarity with the software-engineering discipline, you might have had your hands in instrumenting telemetry or events before and building the pipelines. Experience being hands-on doing this in Python, C# or Typescript is a bonus.
- Experience with frameworks like Spark or dbt.
- You're knowledgeable and able to work within data-modelling methodologies like Kimball.
Interview Process
👋 Initial chat
[30 min] Meet a Talent Acquisition team member, where you'll learn more about life at Octopus and the role. We'll give you a glimpse into the organization structure and how we work, and ask questions to understand your suitability for the role.
☕ Hiring manager interview
[45-60 min] Meet our Engineering Manager and Lead Data Engineer to explore your experience, the shape of the role, and the problems we're hoping to solve together. We'll ask questions to understand how your skills might complement our mission.
🧑💻 Take home & live assessment
[60 min] You'll architect a lightweight data-engineering process (capture/ingestion → transformation → consumption) to provide data for self-serving analytics. Then you'll pair with the team to explain your design decisions, perform live coding and analysis using your solution, and work through follow-up questions together.
Benefits & More
- Maturing: $145k AUD/NZD
- Performing: $165k AUD/NZD
Our public employee handbook is the best place to learn more about life at Octopus. It includes our values, how we structure teams, career progression, leave and benefits, and much more.
Octopus has an internally open and transparent system for compensation. Any Octonaut can view the compensation for any role at any level. This ensures people doing the same work with the same skill get paid the same. Benefits include a minimum of 25 days annual leave, up to 10 days of paid sick and carers leave, 12 weeks of fully paid parental leave with flexible return options, generous health care including dental and vision for US based candidates, 401K matching/pension contributions depending on your location, and stock options. Learn more.
If you're enthusiastic about this position, even if you don’t meet all the criteria above, we wholeheartedly encourage you to submit your application. Our talent team is in-house, and we recognize that every individual brings something unique. We take the time to review every application and consider how you might add to the team.
We know your time is precious. If you apply, we promise to update you at least once per week about the status of your application and to give you clear expectations for each step in the journey.