Lesson 1 of 6
Why refresh
10 min
Listen to this lesson
A quality system starts life as a faithful image of production and then drifts. Test data piles up, master data in production changes, emergency fixes go straight to production, and volumes in production grow while the test system stays small. After a few months, a pass in the test system says less about production than it used to. A refresh, copying production into the test system and adjusting it, resets that drift.
What drift does to test evidence
Drift creates two kinds of false result. A false pass: a scenario works in CMQ because CMQ lacks a production condition, such as a customer with a credit block or a material with a new valuation, so the defect only appears after go-live. A false fail: a test breaks because its test data is stale or used up, wasting a developer's day on a problem production never has. Both erode trust in testing. A refresh before an important cycle makes test results more representative.
The cost side
Refreshes are not free. The test system is unavailable for days; test data built by hand is lost unless it is preserved or rebuilt; transports that were in CMQ but not yet in CMP have to be imported again; and every post-copy step is a chance for error, such as an interface that suddenly talks to a real partner. That is why refreshes are planned events with an owner, a runbook and a calendar slot, not favors done on a Friday afternoon.
Measuring drift
Drift can be measured instead of guessed. Useful indicators include the share of test failures caused by missing or used-up data, the age of the last refresh, the number of production changes made outside the normal transport path since then, and the gap in table sizes between CMQ and CMP for the tables that matter to performance tests. Priya reviews these after each cycle; when two or more move past their thresholds, a refresh goes on the calendar. The point is to make the refresh decision on evidence, the same way the release decision is made.
Alternatives to a full refresh
- Targeted data creation: build the specific master data and documents a test needs, by script or by tools such as eCATT.
- Client-level copy: refresh only client-specific data, where volumes allow it (next lesson).
- Reduced or selective copies: copy a time slice or a company code subset, with SAP tools designed for that; check licensing and fit.
- Test data hygiene: reserve and reset data sets so cycles do not consume each other's data.
What would you do?
After go-live, Priya notices that 30% of regression failures in CMR last cycle were caused by missing or used-up test data, and production has had a major master data cleanup since the last refresh. The next cycle is the final regression before a quarterly release. What should she propose?
- Test systems drift in data, volume and configuration; test data is consumed.
- Drift causes false passes and false fails.
- Refreshes cost availability, test data and re-import effort, so plan them.
- Refresh before critical cycles and performance tests; consider lighter alternatives otherwise.
Check your understanding · not graded
Lesson check
1. What is a false pass caused by drift?
2. Which kind of drift makes performance results unrealistic?
3. Why is a refresh a planned event?
4. When does a refresh pay off most?