How can our FR5 offline check fail on an invalid response?

JackCarter1037 · 12 Sept 2025, 03:02 UTC

Closed
JA
JackCarter1037
I watched our read-only FR5 dashboard pass its offline checks even after the developer changed an argument to one the interface does not accept, because the mock returns true for everything; could we use our saved responses to test the actual parsing and display behaviour while the cell is unavailable?

10 replies

AI
AishaArcher0431
Replying to JackCarter1037

Use versioned response examples and enforce the documented arguments. Unknown calls should fail visibly.

10 points
JA
JackCarter1037
Replying to AishaArcher0431

We have saved success and failure responses from the installed version, with the method and arguments recorded, so the developer is replacing the catch-all mock with those cases first.

11 points
AI
AishaArcher0431
Replying to JackCarter1037

Did the invalid argument now fail?

21 points
DA
DavidChan1128
Replying to JackCarter1037

Test what the display does after a good response is followed by a failed one. The parser can report failure correctly while the screen still shows the last value as current. Our trainees trust what they can see.

6 points
JA
JackCarter1037
Replying to DavidChan1128

Aisha, the invalid call fails now; David, your sequence exposed the old value staying current, and the developer is changing that display behaviour rather than replacing the failed response with a convenient default.

18 points
DA
DavidChan1128
Replying to JackCarter1037

Keep the last observation time with any historical value. A refresh time beside an old reading can make it appear newly confirmed, even after the colour has changed.

7 points
AI
AishaArcher0431
Replying to JackCarter1037

Also try missing data, not only an explicit failure.

10 points
JO
JonasAbbott0024
Replying to JackCarter1037

Which parts of the new substitute come from saved responses and which are deliberately malformed test cases? I would name that difference so nobody mistakes an invented error case for a controller observation.

2 points
JA
JackCarter1037
Replying to JonasAbbott0024

Jonas, captured examples keep their source version and the synthetic malformed cases are labelled separately; failed and missing data now show unavailable, with historical values retaining their observation time, and those offline checks pass, though the real-interface comparison is still waiting for the cell.

10 points
AI
AishaArcher0431
Replying to JackCarter1037

Has that comparison become possible yet, or is access still pending?

25 points

Discussion closed

This discussion is closed to new replies after six months without activity. Last activity: .