Now accepting guest editorial from SAP, Oracle, Workday and ServiceNow practitioners.Pitch a guide
The Sign-Off Table

Lesson 1 of 6

Why refresh

10 min

Listen to this lesson

0:00 / 4:50

A quality system starts life as a faithful image of production and then drifts. Test data piles up, master data in production changes, emergency fixes go straight to production, and volumes in production grow while the test system stays small. After a few months, a pass in the test system says less about production than it used to. A refresh, copying production into the test system and adjusting it, resets that drift.

Data driftProduction master data and open documents change daily; the test system keeps old and test-created data
Volume driftProduction tables grow; performance results from a small test database stop being realistic
Configuration driftEmergency changes or settings made directly in production never reach the test system
Test data exhaustionUsable test cases are consumed: orders billed, stock used up, periods closed
Four kinds of drift between a test system and production.
The Sign-Off Table · thesignofftable.com/academy/sap-bas-204

What drift does to test evidence

Drift creates two kinds of false result. A false pass: a scenario works in CMQ because CMQ lacks a production condition, such as a customer with a credit block or a material with a new valuation, so the defect only appears after go-live. A false fail: a test breaks because its test data is stale or used up, wasting a developer's day on a problem production never has. Both erode trust in testing. A refresh before an important cycle makes test results more representative.

Drift produces two kinds of false result, and both cost trust in testing.
The Sign-Off Table · thesignofftable.com/academy/sap-bas-204

The cost side

Refreshes are not free. The test system is unavailable for days; test data built by hand is lost unless it is preserved or rebuilt; transports that were in CMQ but not yet in CMP have to be imported again; and every post-copy step is a chance for error, such as an interface that suddenly talks to a real partner. That is why refreshes are planned events with an owner, a runbook and a calendar slot, not favors done on a Friday afternoon.

Critical cycle, recent refreshCheck drift indicators; refresh only if production changed significantly
Critical cycle, old refreshRefresh before the cycle: regression before go-live, performance test, mock cutover rehearsal
Routine cycle, recent refreshNo refresh; keep test data hygiene
Routine cycle, old refreshSchedule a refresh at the next quiet point in the calendar
When a refresh pays off.
The Sign-Off Table · thesignofftable.com/academy/sap-bas-204

Measuring drift

Drift can be measured instead of guessed. Useful indicators include the share of test failures caused by missing or used-up data, the age of the last refresh, the number of production changes made outside the normal transport path since then, and the gap in table sizes between CMQ and CMP for the tables that matter to performance tests. Priya reviews these after each cycle; when two or more move past their thresholds, a refresh goes on the calendar. The point is to make the refresh decision on evidence, the same way the release decision is made.

CMQ's condition between refreshes: drift indicators move it toward a refresh, decided on evidence rather than habit.
The Sign-Off Table · thesignofftable.com/academy/sap-bas-204

Alternatives to a full refresh

  • Targeted data creation: build the specific master data and documents a test needs, by script or by tools such as eCATT.
  • Client-level copy: refresh only client-specific data, where volumes allow it (next lesson).
  • Reduced or selective copies: copy a time slice or a company code subset, with SAP tools designed for that; check licensing and fit.
  • Test data hygiene: reserve and reset data sets so cycles do not consume each other's data.

What would you do?

After go-live, Priya notices that 30% of regression failures in CMR last cycle were caused by missing or used-up test data, and production has had a major master data cleanup since the last refresh. The next cycle is the final regression before a quarterly release. What should she propose?

Key points
  • Test systems drift in data, volume and configuration; test data is consumed.
  • Drift causes false passes and false fails.
  • Refreshes cost availability, test data and re-import effort, so plan them.
  • Refresh before critical cycles and performance tests; consider lighter alternatives otherwise.

Check your understanding · not graded

Lesson check

  1. 1. What is a false pass caused by drift?

  2. 2. Which kind of drift makes performance results unrealistic?

  3. 3. Why is a refresh a planned event?

  4. 4. When does a refresh pay off most?