Backend Engineer, AI Engineering: Duo Chat
GitLab · Remote · Canada +1 · 1mo ago
GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster.
The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. Co-create the future with us as we build technology that transforms how the world develops software.
*Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab.
An overview of this role
As a Backend Engineer on the Chat Engine team, you'll build the engine behind GitLab Duo Chat, the conversational AI experience for GitLab. You'll work primarily in Python to build and maintain our agentic runtime: the Flow Registry, LangGraph flows, and the Duo Workflow Service. You'll also work in the GitLab Rails monolith, where Chat connects with the product.
You'll own scoped parts of the system, ship small features and improvements with minimal guidance, and collaborate with the team on larger projects. You'll work alongside senior and staff engineers who will partner with you on design and support your growth.
What you’ll do
- Develop secure, well-tested, and performant features and improvements for GitLab Duo Chat.
- Implement and extend agentic flows in Python using LangGraph, registered through the Flow Registry and served by the Duo Workflow Service.
- Integrate Chat capabilities with the GitLab Rails monolith, including its GraphQL application programming interface (API).
- Write maintainable code that meets our internal standards for a high-scale environment, including tests with every merge request.
- Review code within our Code Review Guidelines and respond promptly to contributions from people who don't work for GitLab.
- Identify technical debt and propose and implement solutions that improve the team's efficiency.
- Collaborate with Product Management, User Experience, and Frontend team members to improve product quality, security, and performance.
- Participate in Tier 2 or Tier 3 weekday, weekend, and occasional night on-call rotations to help troubleshoot product operations, security operations, and urgent engineering issues.
What you’ll bring
- Professional experience with Python, including building and testing production services.
- Working proficiency with Ruby on Rails, or a willingness to learn it, since a meaningful part of Chat lives in the GitLab monolith.
- Exposure to, or strong interest in, building on top of large language models, including prompting, tool or function calling, evaluation, and the failure modes of non-deterministic systems.
- Experience designing and building APIs, including diagnosing and optimizing performance issues, and comfort working with well-documented third-party services.
- A security-minded development approach that applies secure coding guidelines early in the development process.
- Clear and concise written communication about technical problems and iterative solutions, which is essential in a remote, largely asynchronous environment.
- Manage work independently, organize priorities, and ask for help when an issue is taking longer than expected.
- Demonstrate GitLab's values by collaborating effectively in a fully remote, intensely iterative environment.
- Experience with LangGraph, LangChain, or a comparable agent orchestration framework.
- Experience with GraphQL and RSpec.
- Experience with the GitLab product as a user or contributor.
- Experience working on a remote, globally distributed team.
About the team
We're part of GitLab's AI Engineering organization and own the AI-powered chat experience embedded across the GitLab platform. Chat Engine is the backend-focused team within the Duo Chat group. We're backend, frontend, and AI specialists working asynchronously across time zones, using issues, merge requests, and documentation as our main collaboration tools. We focus on expanding generative and agentic AI capabilities, improving the performance and reliability of chat workflows, and strengthening the debugging and testing foundations that help us run AI features safely at scale.
The base salary range for this role’s listed level is currently for residents of the United States only. This range is intended to reflect the role's base salary rate in locations throughout the US. Grade level and salary ranges are determined through interviews and a review of education, experience, knowledge, skills, abilities of the applicant, equity with other team members, alignment with market data, and geographic location. The base salary range does not include any bonuses, equity, or benefits. See more information on our benefits and equity. Sales roles are also eligible for incentive pay targeted at up to 100% of the offered base salary.
How GitLab Supports Full-Time Employees
- Benefits to support your health, finances, and well-being
- Flexible Paid Time Off
- Team Member Resource Groups
- Equity Compensation & Employee Stock Purchase Plan
- Growth and Development Fund
- Parental Leave
Please note that we welcome interest from candidates with varying levels of experience; many successful candidates do not meet every single requirement. Additionally, studies have shown that people from underrepresented groups are less likely to apply to a job unless they meet every single qualification. If you're excited about this role, please apply and allow our recruiters to assess your application.
Country Hiring Guidelines: GitLab hires new team members in countries around the world. All of our roles are remote, however some roles may carry specific location-based eligibility requirements. Our Talent Acquisition team can help answer any questions about location after starting the recruiting process.
Privacy Policy: Please review our Recruitment Privacy Policy. Your privacy is important to us.
GitLab is proud to be an equal opportunity workplace and is an affirmative action employer. GitLab’s policies and practices relating to recruitment, employment, career development and advancement, promotion, and retirement are based solely on merit, regardless of race, color, religion, ancestry, sex (including pregnancy, lactation, sexual orientation, gender identity, or gender expression), national origin, age, citizenship, marital status, mental or physical disability, genetic information (including family medical history), discharge status from the military, protected veteran status (which includes disabled veterans, recently separated veterans, active duty wartime or campaign badge veterans, and Armed Forces service medal veterans), or any other basis protected by law. GitLab will not tolerate discrimination or harassment based on any of these characteristics. See also GitLab’s EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know during the recruiting process.