DROP A scorecard.json TO INSPECT ANY RUN · CHOOSE FILE · or append ?scorecard=<relative path>
Dead Air · The Board
BAKED RUN · ADAPTER patter · TIER 2 · 9bb039c · CORPUS 629cb08e
FAIL
17 PASSED1 FAILED RUNTIME (STRUCTURAL) 151.34 s / 540.00 s
Metric Radar
PASS RATE PER METRIC · INFO AXES ARE NON-GATINGThe Call Set
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Hi, I need to see someone about my knee.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes — a new appointment with Dr A, July 3rd at 9am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-knee",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z"
}{
"ok": true,
"booking": {
"id": "4dcf9e8f-f4b8-4725-b53c-be4142298bf4",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-knee",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Hi, I need to see someone about my knee.
agent I can help with that. Do you have a preferred practitioner or date in mind? Our practitioner has availability — what day works for you?
caller Yes — a new appointment with Dr A, July 3rd at 9am.
agent You're booked with Dr A on July 3rd at 9:00 AM. Your booking reference is 4dcf9e8f-f4b8-4725-b53c-be4142298bf4. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Just book July 2nd at 4pm please.”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-02"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T09:00:00Z",
"slotEnd": "2026-07-02T09:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T09:30:00Z",
"slotEnd": "2026-07-02T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T10:30:00Z",
"slotEnd": "2026-07-02T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T11:00:00Z",
"slotEnd": "2026-07-02T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T11:30:00Z",
"slotEnd": "2026-07-02T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T12:00:00Z",
"slotEnd": "2026-07-02T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T12:30:00Z",
"slotEnd": "2026-07-02T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T13:00:00Z",
"slotEnd": "2026-07-02T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T13:30:00Z",
"slotEnd": "2026-07-02T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T14:00:00Z",
"slotEnd": "2026-07-02T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T14:30:00Z",
"slotEnd": "2026-07-02T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T15:30:00Z",
"slotEnd": "2026-07-02T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T16:30:00Z",
"slotEnd": "2026-07-02T17:00:00Z"
}
] tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z"
}{
"ok": true,
"booking": {
"id": "3c408d2f-7506-4a5a-9bda-26082b925a7c",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I need an appointment with Dr A.
agent I can help with that. What day were you hoping to come in, and any preferred time?
caller Just book July 2nd at 4pm please.
agent I'll check that slot and book it for you. 4pm is free — booking it now. You're booked with Dr A on July 2nd at 4:00pm. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on July 1st at 2pm.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
}{
"ok": true,
"booking": {
"id": "cff0e692-efb3-4d93-8d04-dfd69bfc8525",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on July 1st at 2pm.
agent I'll check that slot and book it for you. You're booked with Dr A on July 1st at 2:00 PM UTC. Anything else?
5000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 5000ms (STRUCTURAL)
8000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 8000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Hi, I want to make an appointment.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TURN 2
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Hi, I want to make an appointment.
agent I can help with that. Who would you like to see, and on what date and time?
agent Are you still there? Just let me know the practitioner, date, and time you'd like.
agent It seems we may have a bad connection. I'll end the call now — please call back when you're ready to book. Take care! Call ended due to no response. Feel free to call back anytime to schedule your appointment.
4000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 4000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Sorry — July 3rd at 3:30pm.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-silence",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z"
}{
"ok": true,
"booking": {
"id": "f5e3d7c2-a252-4c4a-9135-3750d15ec820",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-silence",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A.
agent I can help with that. What date and time would you like to book with Dr. A?
agent Are you still there? What date and time would you like to book with Dr. A?
caller Sorry — July 3rd at 3:30pm.
agent I'll check that slot and book it for you. You're booked with Dr. A on July 3rd at 3:30pm. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Cancel my appointment on the first.” · STT 0.5
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call cancelBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"patientRef": "patient-000"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
}
} tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, cancel the July 1st 9am one.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Cancel my appointment on the first.
agent I can help with that. Let me pull up your booking first. I found your appointment on July 1st at 09:00 UTC. Let me cancel that for you. Done — your appointment on July 1st at 09:00 UTC has been cancelled. Anything else I can help with?
caller Yes, cancel the July 1st 9am one.
agent Let me look up that booking to confirm the details. That appointment — July 1st at 09:00 UTC — is already cancelled. There's nothing further to do on it. Anything else I can help with?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need to cancel my July 1st 9am appointment with Dr A.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call cancelBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"patientRef": "patient-000"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I need to cancel my July 1st 9am appointment with Dr A.
agent I'll pull up that booking to confirm the details before cancelling. I found your appointment on July 1st at 9:00 AM with Dr. A. Cancelling it now. Done — your July 1st 9:00 AM appointment with Dr. A has been cancelled. Anything else I can help with?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I want to cancel my appointment — my reference is cccccccc-cccc-cccc-cccc-0000000000cc.”
llm_first_token
tool_call findBooking
{
"ref": "cccccccc-cccc-cccc-cccc-0000000000cc"
}null
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I want to cancel my appointment — my reference is cccccccc-cccc-cccc-cccc-0000000000cc.
agent I'll look that up for you. I'm sorry, but I couldn't find any booking with that reference. Could you double-check the reference number, or would you like me to look it up by your full name instead?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Skip that — what do you have on July 3rd?”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-03"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T09:30:00Z",
"slotEnd": "2026-07-03T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T10:30:00Z",
"slotEnd": "2026-07-03T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T11:00:00Z",
"slotEnd": "2026-07-03T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T11:30:00Z",
"slotEnd": "2026-07-03T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T12:00:00Z",
"slotEnd": "2026-07-03T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T12:30:00Z",
"slotEnd": "2026-07-03T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T13:00:00Z",
"slotEnd": "2026-07-03T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T13:30:00Z",
"slotEnd": "2026-07-03T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T14:00:00Z",
"slotEnd": "2026-07-03T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T14:30:00Z",
"slotEnd": "2026-07-03T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T15:00:00Z",
"slotEnd": "2026-07-03T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T16:00:00Z",
"slotEnd": "2026-07-03T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T16:30:00Z",
"slotEnd": "2026-07-03T17:00:00Z"
}
] tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Just give me 10am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-double-barge",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z"
}{
"ok": true,
"booking": {
"id": "fd288a8b-07f5-408e-a9b6-9c1e5e1b847f",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-double-barge",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I need an appointment with Dr A.
agent I can help with that. What date and time would you like to see Dr. A?
caller Skip that — what do you have on July 3rd?
agent Dr. A has plenty of openings on July 3rd, from 9:00 AM through 4:30 PM UTC. What time works best for you?
caller Just give me 10am.
agent I'll book that for you now. You're booked with Dr. A on July 3rd at 10:00 AM UTC. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I've had chest pain since this morning — can I get an appointment today?”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I've had chest pain since this morning — can I get an appointment today?
agent I'm sorry you're experiencing chest pain. This could be serious, and I'm not able to assess medical emergencies. **Please hang up and call emergency services (911, or your local emergency number) right now, or go to your nearest emergency department** — especially if you also have shortness of breath, pain spreading to your arm or jaw, sweating, or dizziness. Chest pain isn't something to wait for a routine appointment for. Would you like me to connect you to a member of staff right away?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Forget it, I'll call back later.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Forget it, I'll call back later.
agent No problem at all — call back anytime and we'll be happy to help. Take care!Goodbye!
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A on July 2nd at 3pm.” · STT 0.96
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z"
}{
"ok": true,
"booking": {
"id": "f82e68b0-1c31-4a58-9694-c0fada402905",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A on July 2nd at 3pm.
agent I'll book that for you now. You're booked with Dr A on July 2nd at 3:00 PM. Your booking reference is f82e68b0-1c31-4a58-9694-c0fada402905. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on Thursday at 10.” · STT 0.4
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, Thursday July 2nd at 10am.”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-02"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T09:00:00Z",
"slotEnd": "2026-07-02T09:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T09:30:00Z",
"slotEnd": "2026-07-02T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T10:30:00Z",
"slotEnd": "2026-07-02T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T11:00:00Z",
"slotEnd": "2026-07-02T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T11:30:00Z",
"slotEnd": "2026-07-02T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T12:00:00Z",
"slotEnd": "2026-07-02T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T12:30:00Z",
"slotEnd": "2026-07-02T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T13:00:00Z",
"slotEnd": "2026-07-02T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T13:30:00Z",
"slotEnd": "2026-07-02T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T14:00:00Z",
"slotEnd": "2026-07-02T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T14:30:00Z",
"slotEnd": "2026-07-02T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T15:30:00Z",
"slotEnd": "2026-07-02T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-02T16:30:00Z",
"slotEnd": "2026-07-02T17:00:00Z"
}
] tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z"
}{
"ok": true,
"booking": {
"id": "b59ad3a1-d013-4be1-abf5-5dafaf972eff",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on Thursday at 10.
agent I can help with that. Which Thursday do you mean — could you give me the date?
caller Yes, Thursday July 2nd at 10am.
agent I'll check that slot and book it for you. 10am is available — booking it now. You're all set — booked with Dr A on Thursday, July 2nd at 10:00am. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Two things: move my July 1st 9am to 11:30, and book my son in right after.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tool_call rescheduleBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z",
"status": "active"
}
} tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-multi-son",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
}{
"ok": true,
"booking": {
"id": "0cfec8d1-6d20-40e9-9155-b12d83b57645",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-multi-son",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, 12 o'clock for him.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z",
"status": "active"
} tool_call listAvailability
{
"date": "2026-07-01",
"resourceId": "00000000-0000-0000-0000-0000000000aa"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Two things: move my July 1st 9am to 11:30, and book my son in right after.
agent I'll take care of both. Let me first verify your existing booking, then check availability for your son's slot. Both slots are free (11:30 and 12:00). Let me make both changes now. Both done: - Your appointment is moved to **July 1st, 11:30–12:00**. - Your son is booked right after, **12:00–12:30**. Anything else?
caller Yes, 12 o'clock for him.
agent I'll verify your booking and check availability first. Good news — your appointment is already at **11:30–12:00 on July 1st**, so that move is done. However, the **12:00 slot for your son is not available**. The nearest open slot is **12:30–13:00**. Would you like me to book him in at 12:30 instead?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to make an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “July 1st, please.”
llm_first_token
tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “1pm is perfect.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-partial",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
}{
"ok": true,
"booking": {
"id": "411fdb55-44a7-4f03-a355-6adb9ab1bc04",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-partial",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to make an appointment with Dr A.
agent I can help with that. What date and time would you like to see Dr. A?
caller July 1st, please.
agent I'll check Dr. A's availability for July 1st. Dr. A has openings on July 1st from 9:30 AM through 5:00 PM UTC, in 30-minute slots. What time works best for you?
caller 1pm is perfect.
agent I'll book that for you. You're all set — Dr. A on July 1st at 1:00 PM UTC. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Move my July 1st 9am appointment to 11am.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call rescheduleBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Move my July 1st 9am appointment to 11am.
agent I'll pull up your appointment first. Done — your appointment is moved to July 1st at 11:00am. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A at 9am on July 1st.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z"
}{
"conflict": true
} tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, 9:30 please.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
}{
"ok": true,
"booking": {
"id": "954a23da-38e7-464c-a2d3-85670b3134e9",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A at 9am on July 1st.
agent I'll book that for you right away. That 9am slot is already taken. Let me check what's available nearby. The nearest opening is **9:30am** on July 1st. Would you like that instead?
caller Yes, 9:30 please.
agent I'll book the 9:30am slot for you. You're all set — booked with Dr A at 9:30am on July 1st. Anything else?
3000ms TOOL TIMEOUT · createBooking · 3000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A on July 3rd at 2pm.”
llm_first_token
tool_timeout
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A on July 3rd at 2pm.
agent I don't have your patient reference in the call context, which I need to book an appointment for you. Could you provide your booking reference, or let me transfer you to a colleague who can verify your identity?
Elapsed/budget columns are (STRUCTURAL) smoke — event ordering under fakes, not measured latency. The dead-air cell is real wall-clock only on the real-Claude (Tier-2) run; on scripted runs it is synthetic and informational. Mishearing and barge-in metrics gate scripted runs; informational where the adapter can't inject. Open a row for its event Tape.
Dead Air · Scripted vs Real
BAKED RUN · fake/T1 → patter/T2 · 2026-07-16T01:13:30.206Z · 9bb039c · CORPUS 629cb08e
17 SAME · 1 REGRESSED
Scenarios
ambiguous-intent-clarify Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 5793.465920000001 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
barge-in-yield Passed Failed REGRESSED
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 11331.551659 ✓ ✗
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 1 → 0 ✓ ✗
book-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 4279.918489 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
caller-silence-abandoned Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 3 → 1514.133257999998 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
caller-silence-reprompt Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 8786.402460999998 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
cancel-confirm-low-confidence Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 6308.641557000003 ✓ ✓
mishearing_handling 1 → 0 ✓ ✗
barge_in_handling 0 → 0 ✓ ✓
cancel-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 6374.363876000003 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
cancel-unknown-booking Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 3986.804682999995 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
double-barge-in Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4509.816499999986 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 2 → 0 ✓ ✗
escalation-emergency Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 3 → 3269.5503029999963 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
mid-barge-hangup Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 3 → 3319.2619940000004 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 1 → 0 ✓ ✗
mishearing-clean-negative Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4782.8838629999955 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
mishearing-repair-booking Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 9276.014928000004 ✓ ✓
mishearing_handling 1 → 1 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
multi-intent-reschedule-and-book Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 9679.518802000006 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
partial-slot-filling Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 5839.6296379999985 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
reschedule-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 5906.8501169999945 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
slot-conflict-alternative Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 6814.613382999989 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
tool-timeout-escalation Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 2084.4870780000056 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
Real-call observability
Planned — Tier 2 / #3This viewer reads a Tier-1 scorecard: deterministic, scripted runs that validate the harness, domain, and plumbing — not live-call behaviour. The panels below are committed in the design spec (§7) but are not yet implemented, and intentionally show no data.
- Per-turn latency waterfallEOS → TTFT → TTS-first-byte → playout vs the 800ms budget (p50/p95). Needs real STT/LLM/TTS timing.
- Run-over-run trend linesMetric deltas vs the last passing run on the same corpusHash, from the Postgres metrics store.
- Endpointing benchmarkFalse-cut ↔ dead-air tradeoff across ≥3 turn-detection strategies.