DROP A scorecard.json TO INSPECT ANY RUN · CHOOSE FILE · or append ?scorecard=<relative path>
Dead Air · The Board
BAKED RUN · ADAPTER fake · TIER 1 · de541d0 · CORPUS 629cb08e
PASS
18 PASSED RUNTIME (STRUCTURAL) 584 ms / 120.00 s
Metric Radar
PASS RATE PER METRIC · INFO AXES ARE NON-GATINGThe Call Set
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Hi, I need to see someone about my knee.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes — a new appointment with Dr A, July 3rd at 9am.”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-03"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T09:30:00Z",
"slotEnd": "2026-07-03T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T10:30:00Z",
"slotEnd": "2026-07-03T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T11:00:00Z",
"slotEnd": "2026-07-03T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T11:30:00Z",
"slotEnd": "2026-07-03T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T12:00:00Z",
"slotEnd": "2026-07-03T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T12:30:00Z",
"slotEnd": "2026-07-03T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T13:00:00Z",
"slotEnd": "2026-07-03T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T13:30:00Z",
"slotEnd": "2026-07-03T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T14:00:00Z",
"slotEnd": "2026-07-03T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T14:30:00Z",
"slotEnd": "2026-07-03T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T15:00:00Z",
"slotEnd": "2026-07-03T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T16:00:00Z",
"slotEnd": "2026-07-03T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T16:30:00Z",
"slotEnd": "2026-07-03T17:00:00Z"
}
] tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-knee",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z"
}{
"ok": true,
"booking": {
"id": "654aae14-9f1b-4d27-b843-e22ac6993f80",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-knee",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Hi, I need to see someone about my knee.
agent I can help with that. Would you like a new appointment with Dr A, and is there a day that suits you?
caller Yes — a new appointment with Dr A, July 3rd at 9am.
agent Booked — Dr A on July 3rd at 9am for your knee.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end INTERRUPTED (BARGE-IN)
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Just book July 2nd at 4pm please.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z"
}{
"ok": true,
"booking": {
"id": "d2533c11-2788-4450-ab9b-8b4e89900413",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I need an appointment with Dr A.
agent Of course — we have a wide range of availability this week, including morning and afternoon slots on most days, and I can also tell you about our new patient intake process...
caller Just book July 2nd at 4pm please.
agent Booked — July 2nd at 4pm.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on July 1st at 2pm.”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
}{
"ok": true,
"booking": {
"id": "7d769b37-a2df-42d4-b3be-7a571f03275b",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on July 1st at 2pm.
agent You're booked with Dr A on July 1st at 2pm.
5000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 5000ms (STRUCTURAL)
8000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 8000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Hi, I want to make an appointment.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TURN 2
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Hi, I want to make an appointment.
agent Of course — which practitioner and day would you like?
agent Are you still there? I can book you with Dr A if you tell me a day.
agent I haven't heard from you, so I'll let you go — please call back any time. Goodbye.
4000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 4000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Sorry — July 3rd at 3:30pm.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-silence",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z"
}{
"ok": true,
"booking": {
"id": "08e49188-ed31-4bb4-9167-b6a218b407c9",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-silence",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A.
agent Happy to help — which day would you like?
agent Are you still there? Which day should I book you for with Dr A?
caller Sorry — July 3rd at 3:30pm.
agent No problem — booked for July 3rd at 3:30pm.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Cancel my appointment on the first.” · STT 0.5
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, cancel the July 1st 9am one.”
llm_first_token
tool_call cancelBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"patientRef": "patient-000"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Cancel my appointment on the first.
agent Just to confirm — you want to cancel your July 1st 9am appointment with Dr A?
caller Yes, cancel the July 1st 9am one.
agent Cancelled — your July 1st 9am appointment is gone.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need to cancel my July 1st 9am appointment with Dr A.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call cancelBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"patientRef": "patient-000"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I need to cancel my July 1st 9am appointment with Dr A.
agent Done — your July 1st 9am appointment is cancelled.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I want to cancel my appointment — my reference is cccccccc-cccc-cccc-cccc-0000000000cc.”
llm_first_token
tool_call findBooking
{
"ref": "cccccccc-cccc-cccc-cccc-0000000000cc"
}null
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I want to cancel my appointment — my reference is cccccccc-cccc-cccc-cccc-0000000000cc.
agent I can't find a booking under that reference. Let me transfer you to our front desk so they can look into it.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end INTERRUPTED (BARGE-IN)
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Skip that — what do you have on July 3rd?”
llm_first_token
tts_first_byte
agent_speech_end INTERRUPTED (BARGE-IN)
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Just give me 10am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-double-barge",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z"
}{
"ok": true,
"booking": {
"id": "705f9fde-1dcd-4afa-88cf-047cc2b503bd",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-double-barge",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I need an appointment with Dr A.
agent Certainly — before we pick a time, let me tell you about our clinic hours, parking arrangements, and the new patient portal, which...
caller Skip that — what do you have on July 3rd?
agent On July 3rd we have a broad range of morning availability, and in the afternoon there are also several options, starting with...
caller Just give me 10am.
agent Booked — July 3rd at 10am.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I've had chest pain since this morning — can I get an appointment today?”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I've had chest pain since this morning — can I get an appointment today?
agent Chest pain needs urgent attention — please hang up and call emergency services now, or go to your nearest emergency department. I'm also flagging this call for our nurse to ring you back immediately.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Forget it, I'll call back later.”
llm_first_token
tts_first_byte
agent_speech_end INTERRUPTED (BARGE-IN)
call_end
TRANSCRIPT scripted (Tier-1)
caller Forget it, I'll call back later.
agent We have plenty of availability this week — mornings are usually quieter, and if you'd like I can also walk you through...
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A on July 2nd at 3pm.” · STT 0.96
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z"
}{
"ok": true,
"booking": {
"id": "3a27f03a-0914-4ddb-a3e9-6b7e9c4a3673",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A on July 2nd at 3pm.
agent Done — July 2nd at 3pm.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on Thursday at 10.” · STT 0.4
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, Thursday July 2nd at 10am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z"
}{
"ok": true,
"booking": {
"id": "a1e38270-09cb-4bab-942f-11d0b41cff6a",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on Thursday at 10.
agent Just to confirm — did you say Thursday July 2nd at 10am?
caller Yes, Thursday July 2nd at 10am.
agent You're booked for Thursday July 2nd at 10am.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Two things: move my July 1st 9am to 11:30, and book my son in right after.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call rescheduleBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, 12 o'clock for him.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-multi-son",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
}{
"ok": true,
"booking": {
"id": "defab2f3-6360-4de2-ba56-b32bd233d35a",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-multi-son",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Two things: move my July 1st 9am to 11:30, and book my son in right after.
agent Done — you're moved to 11:30. And for your son, right after at 12?
caller Yes, 12 o'clock for him.
agent All set — you're at 11:30 and your son is at 12 on July 1st.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to make an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “July 1st, please.”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “1pm is perfect.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-partial",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
}{
"ok": true,
"booking": {
"id": "238ac092-abbf-4bcd-9102-3800d3b418c2",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-partial",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to make an appointment with Dr A.
agent Of course — which day works for you?
caller July 1st, please.
agent On July 1st I have 1pm free, among others — what time suits?
caller 1pm is perfect.
agent You're booked with Dr A on July 1st at 1pm.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Move my July 1st 9am appointment to 11am.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call rescheduleBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Move my July 1st 9am appointment to 11am.
agent Done — you're now at 11am on July 1st.
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A at 9am on July 1st.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z"
}{
"conflict": true
} tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, 9:30 please.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
}{
"ok": true,
"booking": {
"id": "fb9e8ec4-64d5-4008-8fcb-df52e98494af",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A at 9am on July 1st.
agent 9am is taken — I have 9:30am, shall I book that?
caller Yes, 9:30 please.
agent Booked you for 9:30am on July 1st.
3000ms TOOL TIMEOUT · createBooking · 3000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A on July 3rd at 2pm.”
llm_first_token
tool_timeout
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A on July 3rd at 2pm.
agent I'm sorry — our booking system isn't responding right now, so I haven't made that booking. Let me transfer you to our front desk to finish this.
Elapsed/budget columns are (STRUCTURAL) smoke — event ordering under fakes, not measured latency. The dead-air cell is real wall-clock only on the real-Claude (Tier-2) run; on scripted runs it is synthetic and informational. Mishearing and barge-in metrics gate scripted runs; informational where the adapter can't inject. Open a row for its event Tape.
Dead Air · Scripted vs Real
BAKED RUN · fake/T1 → fake/T1 · 2026-07-09T03:38:38.879Z · 38c599c · CORPUS 8186ba54
6 SAME
Scenarios
barge-in-yield Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 1 → 1 ✓ ✓
book-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 5 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
mishearing-clean-negative Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
mishearing-repair-booking Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4 ✓ ✓
mishearing_handling 1 → 1 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
reschedule-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 5 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
slot-conflict-alternative Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 5 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
Real-call observability
Planned — Tier 2 / #3This viewer reads a Tier-1 scorecard: deterministic, scripted runs that validate the harness, domain, and plumbing — not live-call behaviour. The panels below are committed in the design spec (§7) but are not yet implemented, and intentionally show no data.
- Per-turn latency waterfallEOS → TTFT → TTS-first-byte → playout vs the 800ms budget (p50/p95). Needs real STT/LLM/TTS timing.
- Run-over-run trend linesMetric deltas vs the last passing run on the same corpusHash, from the Postgres metrics store.
- Endpointing benchmarkFalse-cut ↔ dead-air tradeoff across ≥3 turn-detection strategies.