Synthetic fixtures
The local-demo provider accepts challenges of kind: "synthetic" whose fixture matches these patterns. Results are deterministic — ideal for CI.
| Operation | Fixture pattern | Result |
|---|---|---|
text | sg-text-<answer> | returns <answer> |
image_classification | sg-classify-<label> | returns <label> |
grid | sg-grid-<i1,i2,…> | returns the index list |
audio | sg-audio-<words> | returns the transcription |
drag_drop | sg-dd-<target> | returns the target |
matching | sg-match-<pairs> | returns the pairs |
Behavior fixtures
sg-fail-<reason> | permanent failure — no retry |
sg-flaky | transient failure on attempt 0, succeeds on retry |
sg-slow-<ms> | resolves after a delay |
sg-hang | never resolves — exercises the timeout path |
Anything else returns validation_failed before a job is created — invalid challenges are never billed. All demo results carry executionMode: "demo".