Now accepting guest editorial from SAP, Oracle, Workday and ServiceNow practitioners.Pitch a guide
The Sign-Off Table

Lesson 1 of 7

Where AI coding agents fit in SAP testing

9 min

Listen to this lesson

0:00 / 14:43

This course discusses ACCELQ by name. Matt Angerer, who runs The Sign-Off Table, works at ACCELQ. Disclosure

Contoso's test team, led by Priya, carries a heavy regression load since Contoso's SAP S/4HANA go-live in August 2026: Fiori apps in the launchpad, classic transactions such as VA01 and MIGO in SAP GUI, OData services used by the custom core returns app, and about 7,500 custom ABAP objects. Two of Priya's automation engineers have started using Claude Code with Playwright, and their first results look impressive. Grace, the PMO lead, now asks a fair question: can that pair carry Contoso's regression suite through the feature packs and upgrades of the years ahead, or should the TCoE invest in a test platform? This course answers it with evidence rather than enthusiasm.

What Claude Code is, and what it is not

Anthropic describes Claude Code as an agentic coding tool that reads your codebase, edits files, runs commands and integrates with your development tools. It runs in the terminal, in VS Code and JetBrains IDEs, in a desktop app and in the browser. Agentic is the important word: you state a goal, and Claude Code plans, reads files, runs commands, checks the results and tries again, asking for permission according to rules you set. That makes it an excellent assistant to a person who writes or reviews test assets. It is not a test management tool, an execution grid or an evidence repository, and it doesn't claim to be.

  • CLAUDE.md: a project instruction file Claude Code reads at the start of every session. Anthropic's docs are explicit that Claude treats it as context, not enforced configuration.
  • Permissions: allow, ask and deny rules (evaluated deny first) and permission modes, set in .claude/settings.json and shareable through version control.
  • MCP servers: tools connected through the Model Context Protocol, such as Microsoft's Playwright MCP server, which lets the agent drive a real browser.
  • Hooks: shell commands that run at fixed points; a PreToolUse hook can block a tool call outright.
  • Subagents and headless mode: specialized helpers with their own context and tool limits, and claude -p for scripts and CI pipelines.

The SAP test surface, and what an agent can reach

An SAP program proves quality on several surfaces at once, and an AI coding agent reaches each of them differently. Claude Code works through files, commands and connected tools. Anything that runs in a browser can be driven by Playwright code the agent writes. APIs can be called by scripts. ABAP source can be read and drafted, and SAP now ships an ABAP MCP server that, in SAP's words, lets any agent that supports MCP interact with ABAP code. SAP GUI for Windows is different: it is a desktop application, and the only programmatic route into it is SAP GUI Scripting, which you met in sap-tau-201.

Business process and sign-offTest plans, approvals and evidence in SAP Cloud ALM. The agent can draft documents; people approve.
SAP Fiori and UI5 appsRun in the browser. Playwright can drive them, but UI5 renders generated IDs and works asynchronously.
SAP GUI for HTML (WebGUI)Classic screens converted to HTML by the integrated ITS. Browser-reachable, with its own quirks.
SAP GUI for WindowsA desktop app. Not reachable by Playwright; needs SAP GUI Scripting, a separate stack.
APIsOData and SOAP services. Scripts can call them; SAP's API Policy applies to agent-driven calls.
ABAP codeABAP Unit and ATC. The agent can draft tests; SAP's ABAP MCP server connects agents to the system.
The SAP test surfaces from process to code, with how far an AI coding agent reaches into each.
The Sign-Off Table · thesignofftable.com/academy/sap-aiq-201

Assistant, author or executor

It helps to separate three roles an agent can play. As an assistant, Claude Code drafts test cases, data plans and defect summaries that a person reads and corrects. The risk is low and the value is high. As an author, it writes automation code that an engineer reviews, commits and owns. The value is real, but someone now maintains that code for years. As an executor, it would run tests and decide pass or fail on its own. That is where SAP sign-off needs things an agent doesn't give by itself: the same steps and verdict on every run, an audit trail, and evidence a process owner can read.

AI drafts and triages, people approve at two gates, and a deterministic run produces the evidence that sign-off rests on.
The Sign-Off Table · thesignofftable.com/academy/sap-aiq-201

What would you do?

Grace asks Priya for a one-line answer: "Can Claude Code replace our regression tool, so we don't need to buy one?" Contoso's scope includes about 140 Fiori scripts, a set of SAP GUI transactions (VA01, VL02N, MIGO, FB60) and OData checks. What is the best answer?

Key points
  • Claude Code is an agentic coding tool: it plans, edits, runs commands and uses connected tools under permission rules you set.
  • It reaches browser UIs (through Playwright), APIs and code; SAP GUI for Windows needs SAP GUI Scripting, a separate stack.
  • Use it first as an assistant and author with human review; be cautious about making it the executor of record.
  • CLAUDE.md guides behavior but doesn't enforce it; permissions, hooks and sandboxing are the controls.

Check your understanding · not graded

Lesson check

  1. 1. How does Anthropic say Claude Code treats the instructions in a project CLAUDE.md file?

  2. 2. Which SAP UI cannot be driven by Playwright, whatever code the agent writes?

  3. 3. In the "assistant, author, executor" model, which role needs the most extra governance before SAP sign-off can rely on it?

  4. 4. Priya wants a hard stop that prevents Claude Code from ever running a command against the production host. What should she use?