DROP A scorecard.json TO INSPECT ANY RUN · CHOOSE FILE · or append ?scorecard=<relative path>
Dead Air · The Board
BAKED RUN · ADAPTER fake · TIER 1 · f162688 · CORPUS 8186ba54
PASS
6 PASSED RUNTIME (STRUCTURAL) 218 ms / 120.00 s
The Call Set
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end INTERRUPTED (BARGE-IN)
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Just book July 2nd at 4pm please.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z"
}{
"ok": true,
"booking": {
"id": "1ba9ebc9-a1be-4441-87c5-f1b61eaf81b6",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I need an appointment with Dr A.
agent Of course — we have a wide range of availability this week, including morning and afternoon slots on most days, and I can also tell you about our new patient intake process...
caller Just book July 2nd at 4pm please.
agent Booked — July 2nd at 4pm.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on July 1st at 2pm.”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
}{
"ok": true,
"booking": {
"id": "f5a1bc8e-fff7-47d9-8b17-fad2b3e6695b",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on July 1st at 2pm.
agent You're booked with Dr A on July 1st at 2pm.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A on July 2nd at 3pm.” · STT 0.96
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z"
}{
"ok": true,
"booking": {
"id": "618cf83e-4897-4d1c-b9f4-400b3563a5de",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A on July 2nd at 3pm.
agent Done — July 2nd at 3pm.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on Thursday at 10.” · STT 0.4
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, Thursday July 2nd at 10am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z"
}{
"ok": true,
"booking": {
"id": "5dd97a3a-7f1a-4a38-a5ee-5e474715b530",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on Thursday at 10.
agent Just to confirm — did you say Thursday July 2nd at 10am?
caller Yes, Thursday July 2nd at 10am.
agent You're booked for Thursday July 2nd at 10am.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Move my July 1st 9am appointment to 11am.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call rescheduleBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Move my July 1st 9am appointment to 11am.
agent Done — you're now at 11am on July 1st.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A at 9am on July 1st.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z"
}{
"conflict": true
} tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, 9:30 please.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
}{
"ok": true,
"booking": {
"id": "272ee7da-5ca5-41a3-9d6d-55335dd1bfdc",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A at 9am on July 1st.
agent 9am is taken — I have 9:30am, shall I book that?
caller Yes, 9:30 please.
agent Booked you for 9:30am on July 1st.
Elapsed/budget columns are (STRUCTURAL) smoke — event ordering under fakes, not measured latency. The dead-air cell is real wall-clock only on the real-Claude (Tier-2) run; on scripted runs it is synthetic and informational. Mishearing and barge-in metrics gate scripted runs; informational where the adapter can't inject. Open a row for its event Tape.
Real-call observability
Planned — Tier 2 / #3This viewer reads a Tier-1 scorecard: deterministic, scripted runs that validate the harness, domain, and plumbing — not live-call behaviour. The panels below are committed in the design spec (§7) but are not yet implemented, and intentionally show no data.
- Per-turn latency waterfallEOS → TTFT → TTS-first-byte → playout vs the 800ms budget (p50/p95). Needs real STT/LLM/TTS timing.
- Run-over-run trend linesMetric deltas vs the last passing run on the same corpusHash, from the Postgres metrics store.
- Endpointing benchmarkFalse-cut ↔ dead-air tradeoff across ≥3 turn-detection strategies.