Lead Quality Engineer

About the Role

We are looking for the first Quality Engineer to join an established Agentic AI team in Sydney. This role is focused on keeping delivery speed high while ensuring the products remain reliable, safe, and trusted by legal professionals. The position is based in-office three days per week.

About CORTO

CORTO is a modern software company building AI-powered tools that help reshape the legal sector. The company creates solutions that reduce repetitive work, simplify document handling, and support better decisions for lawyers, paralegals, and legal assistants.

The business is expanding quickly from 80 to more than 150 employees, with a highly technical team where roughly 90% of people are developers and engineers. You would be joining a Sydney-based group of ambitious, fast-moving professionals in an environment where priorities and products evolve quickly.

What You Will Do

You will report to Dale Hurley, Head of Agentic AI Engineering, and work with a growing team of 8 people focused on AI-driven product delivery under the direction of ATI Group founder Christian Beck. The team is already using AI-assisted coding and moving quickly on the Global Forms Automation project, with more products planned afterward.

Your main responsibility is to ensure rapid delivery does not create brittle software. You will create the quality systems, automation, and safeguards that help a compact, AI-enabled engineering team ship frequently while maintaining customer confidence.

• Work closely with engineers to define testing approaches, automation, and quality tooling that fit an AI-assisted development process.
• Create assessment frameworks for agentic and generative AI functionality, including prompt regressions, model checks, retrieval quality, tool-use validation, and end-to-end agent behaviour testing.
• Manage the automated testing ecosystem across unit, integration, contract, and end-to-end levels, making practical decisions on scope, tools, and when manual review is needed.
• Set up CI/CD quality controls that support multiple daily releases without sacrificing trust, including pre-merge checks, canary release approaches, and production monitoring for AI behaviour.
• Build strong feedback loops between live production indicators and the development process, including errors, user corrections, evaluation drift, cost changes, and latency regressions.
• Help shape the safe use of AI coding tools by identifying likely failure patterns such as convincing-but-incorrect code, missed edge cases, and silent regressions, then putting guardrails in place.
• Communicate findings, recommendations, and progress clearly to engineering, product, and leadership stakeholders.

What You Bring

• Experience designing and delivering quality frameworks for products that grew from early-stage usage to thousands of users, especially in small teams where you built the tooling yourself.
• Practical experience validating generative AI or agent-based systems in production, including evaluation methods, LLM-as-judge workflows, golden datasets, regression detection for non-deterministic output, and checks for cost, latency, safety, and hallucinations.
• Strong hands-on ability with contemporary test automation across unit, integration, contract, and end-to-end layers, especially for cloud services, APIs, and data pipelines.
• Confidence writing code rather than only producing test documentation.
• Direct experience working in teams that use AI-assisted development tools such as Claude Code, Cursor, Copilot, or similar, along with a thoughtful view of how quality practices need to change when reviewing AI-generated code at scale.

Nice to Have

• Exposure to document-intensive workflows or SaaS products.
• Experience testing document automation, form workflows, or structured extraction systems where correctness is critical.
• Background in internal venture studios, innovation teams, startups, or product incubation environments.
• Experience launching or growing a quality engineering practice as the first quality hire on a team.

Who You Are

• You think from the customer’s point of view and care more about real trust in the product than about raw test coverage percentages.
• You are effective with engineers, product teams, and senior leaders, and you are comfortable driving work across teams without formal authority.
• You take ownership end-to-end and are accountable for solving issues rather than passing them along.
• You hold a high standard for yourself and others because you care deeply about what is released.
• You prefer asking how something can be shipped safely rather than how it can be slowed down.

Why Join CORTO

• Your work will directly support local law firms and the communities they serve.
• You will be trusted with meaningful ownership and complex problems rather than routine, isolated tasks.
• You will work with authentic, enthusiastic people who enjoy what they do.
• CORTO is part of ATI Global, a large international LegalTech group with strong backing.
• The company offers flexible and hybrid-style collaboration, with in-office time in Sydney.
• There are real career and learning opportunities in a scaling business that values growth.
• Team culture includes celebrations, social events, sports teams, and access to sailing and yacht events.
• Employees receive additional time off, a gym membership, and other benefits.
• The environment is fast-moving and competitive, with a strong focus on staying ahead through innovation.
• There is access to LEAP Home, a program designed to help employees buy their primary residence.

Additional Information

CORTO describes itself as an inclusive, people-first employer that works to remove barriers that limit opportunity. Candidates are encouraged to apply even if they do not meet every listed requirement.

This position is Sydney-based and requires on-site presence three days each week.