Lesson 3 of 6
Test scoping and test case generation with Joule
17 min
Listen to this lesson
The newest AI features in SAP Cloud ALM target test design. With Joule, two agents work in sequence: the Test Scoping Agent decides what to test, and the Test Preparation Agent decides how, proposing a test plan and then generating manual test cases. A third, the Test Data Management Agent, reads a manual test case and lists the test data it needs. As of October 2026, SAP's help pages mark all three as part of an Early Adopter Care program, so they are not available outside it. Learn how they work now; plan production use only once they're GA for you.
Prerequisites
- Joule activated with SAP Cloud ALM, plus the agent features requested in SAP for Me under Portfolio & Products > Business AI (SAP lists the ALM Project Setup Agent and Test Data Management Agent features).
- A custom solution process with a custom Solution Process Flow Diagram containing BPMN content.
- At least one requirement or user story linked directly to that diagram or its parent solution process.
- Display access to Test Management, Process Management, Project Management and Requirements Management, and Manage authorization for Test Management to generate.
Two stages, two confirmations
In stage 1 you ask Joule, for example, "I want to test process Sell from Stock 1910. Prepare the test scope for review." The agent can't see your screen, so name the process, requirement, user story or project. It returns a Scope Summary: relevant requirements and user stories, main process paths, alternative and exception variants, and reference information. If the scope is wrong, fix the underlying requirements or process documentation and start again; the workflow doesn't continue until you confirm.
In stage 2, in the same conversation, the Test Preparation Agent proposes a Test Plan Summary: planned test cases, coverage categories such as happy path, error case and edge case, and the variants covered. Only after you confirm does it generate, asynchronously. The result is a new test plan with manual test cases (steps and expected results), traceability links to the source requirements, user stories and processes, and coverage information.
Limits that shape how you use it
| Limit (per SAP's documentation) | Consequence for your test strategy |
|---|---|
| One Solution Process Flow Diagram per run | Plan runs per process; end-to-end scenarios across processes still need a person |
| Direct links only; indirect relationships are ignored | Link requirements and stories directly to the process, or they won't be in scope |
| Manual test cases only, no automated scripts in this release | Automation remains a separate step (see the lab) |
| Output reflects the quality of your requirements and process documentation | Weak requirements produce weak tests; fix the source, not the output |
What the agents can and can't do in this release.
What would you do?
Contoso is in the Early Adopter Care program. Priya asks the Test Scoping Agent to prepare scope for the Monterrey process "Sell from Stock 1910". The Scope Summary lists only the happy path, although four requirements about credit blocks and CFDI cancellation exist for Wave 2. What is the most likely cause, and what should she do?
The Test Data Management Agent
Ask Joule, for example, "What test data do I need for test case 8-1-1578?" and the agent reads the instruction text of the case's in-scope activities and returns parameters grouped as Org (company code, plant, sales organization), Master (customer, material, supplier), Config (document type, posting period, Fiori app) and Transactional Data (quantity, delivery date, net price), each with a description, an example value and its reasoning. Two cautions from SAP: it doesn't create or provision data, and its example values are SAP reference defaults such as company code 1010 or plant 1710, not values from your system. For Wave 2, every "1710" it suggests must become 1910 before anyone runs the test.
- Is the feature GA for your tenant, or are you in the EAC program?Neither → write tests the usual way and track the feature · Yes → continue.
- Is there a custom process diagram with directly linked requirements?No → fix the process documentation first · Yes → run the Test Scoping Agent.
- Does the Scope Summary match what the business must prove?No → correct requirements and rerun · Yes → confirm and review the Test Plan Summary.
- Have key users reviewed each generated case and set it to Prepared?No → cases stay In Preparation and can't be executed · Yes → test.
- The Test Scoping Agent proposes what to test; the Test Preparation Agent proposes a plan and generates manual test cases; both are Early Adopter Care as of October 2026.
- You confirm the Scope Summary and the Test Plan Summary before anything is created.
- Generated cases are flagged "Manually created with AI" and must be set to Prepared by a person before execution.
- The Test Data Management Agent lists required data with SAP reference examples; it doesn't provision data or know your values.
Check your understanding · not graded
Lesson check
1. What does the Test Scoping Agent produce for review?
2. Which input must exist before the agents can define test scope?
3. How are generated test cases marked in SAP Cloud ALM?
4. The Test Data Management Agent suggests company code 1010 and plant 1710. What should Contoso's Wave 2 testers do?