What should our offline FR5 reporting substitute refuse?

DineshChen1169 · 20 Aug 2026, 09:17 UTC

Reply to discussion
DI
DineshChen1169
Controller unavailable at the training bench. Our FR5 reporting mock returns true everywhere, so the inspection-block screen looks healthy without exercising the interface. I need useful software checks, not a claim to simulate the physical robot.

18 replies

OW
OwenArcher0399
Replying to DineshChen1169

Start with the documented calls your application actually uses, checking their arguments and response shapes; an unexpected method should fail the test rather than receive another helpful true.

4 points
ER
EricBriggs
Replying to OwenArcher0399

Where do the response examples come from? Use the installed contract and identifiable captured examples where available. A strict fake with an invented contract is still capable of agreeing very confidently with the wrong application.

17 points
HE
HenryChan1047
Replying to OwenArcher0399

Do you need all the SDK methods? I would keep this to the reporting boundary, with unsupported calls obvious. Building a pretend robot is a much larger task than checking a parser.

9 points
RA
RachelBrooks0870
Replying to DineshChen1169

I've seen an old value keep reassuring people after the connection label changed. Include what the screen shows after a good reading followed by failure, and after failure with no prior reading. The fake can exercise those without pretending anything physical moved.

3 points
GR
GraceAdams0146
Replying to RachelBrooks0870

Rachel's initial-failure case matters. Default values can look remarkably official once somebody gives them a green label and a timestamp.

18 points
DI
DineshChen1169
Replying to EricBriggs

Only three read-only calls are used. I have their installed documentation and two captured successful responses. Failure examples will be documented cases with their source stated, not described as captured events.

16 points
DE
DeanCarr
Replying to DineshChen1169

Who will update those three contracts when the training environment changes, instead of leaving the next instructor a fake that tests last year's setup?

8 points
OW
OwenArcher0399
Replying to DeanCarr

Keep the examples and expected interpretation versioned beside the adapter, with unsupported shapes rejected explicitly. That makes an environment change a visible review rather than a silent expansion of what the fake approves.

5 points
DI
DineshChen1169
Replying to OwenArcher0399

Application maintainer owns that record. Strict argument checks now expose a wrong keyword in our caller. The fake still supplies response cases through the same parser the real application uses.

10 points
ER
EricBriggs
Replying to DineshChen1169

Good. Has a failed response containing a plausible status value been tested? A range check can miss the original problem if the fake's failure data is conveniently impossible.

22 points
HE
HenryChan1047
Replying to EricBriggs

And don't replace the real parser in the test to make that case easy to assert. The boundary matters more than the number of mock cases on a report.

17 points
DI
DineshChen1169
Replying to EricBriggs

That case fails correctly at the adapter now. The screen test found a different issue: after rejection it keeps the last good value under the current heading. Caller keyword repaired, display repair still open.

21 points
RA
RachelBrooks0870
Replying to DineshChen1169

Show the earlier observation as earlier, if it is useful to keep it. Give the current request its own unavailable result and reason, with the observation time separate from the latest attempted read. The user shouldn't need your test log to discover that no fresh answer arrived.

7 points
GR
GraceAdams0146
Replying to RachelBrooks0870

Who reads the export, if there is one? Fixing the label won't help another report if it still consumes the stale value as current.

20 points
DI
DineshChen1169
Replying to GraceAdams0146

There is an export. It had the same stale-current confusion. Both now use the adapter result and separate observation time; initial failure, good-then-failed and malformed cases pass in the offline checks.

23 points
DE
DeanCarr
Replying to DineshChen1169

Can a different instructor tell from the screen which observation is current, without you explaining the repair beside them?

3 points
DI
DineshChen1169
Replying to DeanCarr

Instructor readback distinguished unavailable current data from the retained earlier observation. Thanks Rachel, the separate times helped. Real-controller confirmation remains due when the bench returns; timing and disconnect coverage are also unfinished.

21 points
ER
EricBriggs
Replying to DineshChen1169

Keep those unfinished cases beside the results, not beneath a general passed banner. You have found and repaired specific software defects with a bounded substitute, which is useful without making it more than that.

17 points

Add to the discussion

Welcome to Application Robot

Everyone can read the forum. Sign in or create an account to start a discussion, reply, or upload photos.

Forgot your password?

By creating an account, you agree to our Terms and Conditions and community guidelines. Read our Privacy Policy for how your information is handled.