DROP A scorecard.json TO INSPECT ANY RUN · CHOOSE FILE · or append ?scorecard=<relative path>
Dead Air · The Board
BAKED RUN · ADAPTER patter · TIER 2 · ba1fbef · CORPUS 629cb08e
PASS
18 PASSED RUNTIME (STRUCTURAL) 130.83 s / 540.00 s
Metric Radar
PASS RATE PER METRIC · INFO AXES ARE NON-GATINGThe Call Set
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Hi, I need to see someone about my knee.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes — a new appointment with Dr A, July 3rd at 9am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-knee",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z"
}{
"ok": true,
"booking": {
"id": "83b23bf4-d43f-4cfb-8ea3-36a8d85e576d",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-knee",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Hi, I need to see someone about my knee.
agent I can help with that. Which date works for you, and do you have a preferred time?
caller Yes — a new appointment with Dr A, July 3rd at 9am.
agent I'll book that for you now. You're all set — Dr A on July 3rd at 9:00 AM. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Just book July 2nd at 4pm please.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z"
}{
"ok": true,
"booking": {
"id": "8bc9d6cc-8819-4a37-b04c-d84bae97c547",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-barge",
"slotStart": "2026-07-02T16:00:00Z",
"slotEnd": "2026-07-02T16:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I need an appointment with Dr A.
agent I can help with that. What day would you like to come in?
caller Just book July 2nd at 4pm please.
agent I'll book that for you now. You're booked with Dr. A on July 2nd at 4:00 PM UTC. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on July 1st at 2pm.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
}{
"ok": true,
"booking": {
"id": "8f721df6-7109-4623-96f4-ff6d8055f433",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-001",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on July 1st at 2pm.
agent I'll check that slot and book it for you. You're all set — Dr A on July 1st at 2:00 PM. Anything else?
5000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 5000ms (STRUCTURAL)
8000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 8000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Hi, I want to make an appointment.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TURN 2
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Hi, I want to make an appointment.
agent I can help with that. Who would you like to see, and on what date and time?
agent Are you still there? Just let me know the practitioner, date, and time you'd like.
agent I'm not able to hear you, so I'll end the call for now. Please call back when you're ready and we'll get your appointment booked. Take care! Call ended due to no response. Feel free to call back anytime to schedule your appointment.
4000ms DEAD AIR · CALLER NO-INPUT · TIMEOUT 4000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
caller_no_input
llm_first_token
tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Sorry — July 3rd at 3:30pm.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-silence",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z"
}{
"ok": true,
"booking": {
"id": "fe504801-fe1f-44c5-b686-6a47d70291f7",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-silence",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A.
agent I can help with that. What date and time would you like to book?
agent Are you still there? What date and time would you like your appointment with Dr. A?
caller Sorry — July 3rd at 3:30pm.
agent You're booked with Dr. A on July 3rd at 3:30pm. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Cancel my appointment on the first.” · STT 0.5
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call cancelBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"patientRef": "patient-000"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
}
} tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, cancel the July 1st 9am one.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Cancel my appointment on the first.
agent I can help with that. Let me pull up your booking first. I found your appointment on July 1st at 9:00 AM UTC. Cancelling it now. Done — your appointment on July 1st at 9:00 AM UTC has been cancelled. Anything else I can help with?
caller Yes, cancel the July 1st 9am one.
agent Let me check that for you. That appointment on July 1st at 9:00 AM UTC is already cancelled — no further action needed. Anything else I can help with?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need to cancel my July 1st 9am appointment with Dr A.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call cancelBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"patientRef": "patient-000"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "cancelled"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I need to cancel my July 1st 9am appointment with Dr A.
agent Let me pull up that booking first. I found your appointment on July 1st at 9:00 AM. Cancelling it now. Done — your July 1st 9:00 AM appointment with Dr. A is cancelled. Anything else I can help with?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I want to cancel my appointment — my reference is cccccccc-cccc-cccc-cccc-0000000000cc.”
llm_first_token
tool_call findBooking
{
"ref": "cccccccc-cccc-cccc-cccc-0000000000cc"
}null
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I want to cancel my appointment — my reference is cccccccc-cccc-cccc-cccc-0000000000cc.
agent I'll pull up that booking to confirm the details. I'm sorry, but I couldn't find a booking with that reference. Could you double-check the reference number, or give me the name the appointment is under?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I need an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Skip that — what do you have on July 3rd?”
llm_first_token
tool_call listAvailability
{
"date": "2026-07-03",
"resourceId": "00000000-0000-0000-0000-0000000000aa"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T09:00:00Z",
"slotEnd": "2026-07-03T09:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T09:30:00Z",
"slotEnd": "2026-07-03T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T10:30:00Z",
"slotEnd": "2026-07-03T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T11:00:00Z",
"slotEnd": "2026-07-03T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T11:30:00Z",
"slotEnd": "2026-07-03T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T12:00:00Z",
"slotEnd": "2026-07-03T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T12:30:00Z",
"slotEnd": "2026-07-03T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T13:00:00Z",
"slotEnd": "2026-07-03T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T13:30:00Z",
"slotEnd": "2026-07-03T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T14:00:00Z",
"slotEnd": "2026-07-03T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T14:30:00Z",
"slotEnd": "2026-07-03T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T15:00:00Z",
"slotEnd": "2026-07-03T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T15:30:00Z",
"slotEnd": "2026-07-03T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T16:00:00Z",
"slotEnd": "2026-07-03T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-03T16:30:00Z",
"slotEnd": "2026-07-03T17:00:00Z"
}
] tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Just give me 10am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-double-barge",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z"
}{
"ok": true,
"booking": {
"id": "bfc00b7e-73a7-421c-80a9-9ce2654bef87",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-double-barge",
"slotStart": "2026-07-03T10:00:00Z",
"slotEnd": "2026-07-03T10:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I need an appointment with Dr A.
agent Happy to help. What date would you like to come in?
caller Skip that — what do you have on July 3rd?
agent Dr. A has plenty of openings on July 3rd, from 9:00 AM through 4:30 PM (UTC), on the half hour. What time works best for you?
caller Just give me 10am.
agent I'll book that for you now. You're booked with Dr. A on July 3rd at 10:00 AM UTC. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I've had chest pain since this morning — can I get an appointment today?”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller I've had chest pain since this morning — can I get an appointment today?
agent I understand you're worried, but chest pain can be a sign of a serious medical emergency. I'm not able to assess symptoms, and this needs immediate attention — please **hang up and call 999 (or 112)** right now, or go to your nearest A&E. Don't wait for a routine appointment. Would you like me to do anything else once you're safe?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Forget it, I'll call back later.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Forget it, I'll call back later.
agent No problem at all — call back anytime and we'll be happy to help. Take care!Goodbye!
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A on July 2nd at 3pm.” · STT 0.96
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z"
}{
"ok": true,
"booking": {
"id": "5b96de9a-a607-46aa-9566-7cb74bf4d82f",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-clean",
"slotStart": "2026-07-02T15:00:00Z",
"slotEnd": "2026-07-02T15:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A on July 2nd at 3pm.
agent I'll book that for you right now. You're booked with Dr A on July 2nd at 3:00 PM. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to book with Dr A on Thursday at 10.” · STT 0.4
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, Thursday July 2nd at 10am.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z"
}{
"ok": true,
"booking": {
"id": "220dac85-0f0a-424c-abd2-fe7e45271413",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-m2-repair",
"slotStart": "2026-07-02T10:00:00Z",
"slotEnd": "2026-07-02T10:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to book with Dr A on Thursday at 10.
agent I can help with that. Just to confirm — which date is Thursday? Let me check availability for the upcoming Thursday. Could you tell me the exact date, or should I use the next Thursday in2026?
caller Yes, Thursday July 2nd at 10am.
agent I'll book that for you now. You're booked with Dr. A on Thursday, July 2nd at 10:00 AM. Your booking reference is 220dac85-0f0a-424c-abd2-fe7e45271413. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Two things: move my July 1st 9am to 11:30, and book my son in right after.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call listAvailability
{
"date": "2026-07-01",
"resourceId": "00000000-0000-0000-0000-0000000000aa"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tool_call rescheduleBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z",
"status": "active"
}
} tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-multi-son",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
}{
"ok": true,
"booking": {
"id": "7c49587c-a49e-4533-b0bd-b6e5f51019d1",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-multi-son",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, 12 o'clock for him.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z",
"status": "active"
} tool_call listAvailability
{
"date": "2026-07-01",
"resourceId": "00000000-0000-0000-0000-0000000000aa"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Two things: move my July 1st 9am to 11:30, and book my son in right after.
agent I'll help with both. Let me first verify your existing booking, and check availability for the 11:30 slot and your son's slot. Both 11:30 and 12:00 are available. I'll move your appointment to 11:30 and book your son at 12:00. Both done: - Your appointment is moved to July 1st, 11:30 AM. - Your son is booked right after at 12:00 PM. Anything else?
caller Yes, 12 o'clock for him.
agent Let me verify your booking and check availability first. A couple of things I need to clarify: Your existing booking is actually already at **11:30 AM**, not 9:00 AM. There's no 9:00 booking under this reference to move. Would you still like me to make a change, or leave it as-is at 11:30? Also, the **12:00 slot for your son isn't available** — the nearest open slots are 12:30 or 10:30. Which would you like?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “I'd like to make an appointment with Dr A.”
llm_first_token
tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “July 1st, please.”
llm_first_token
tool_call listAvailability
{
"date": "2026-07-01",
"resourceId": "00000000-0000-0000-0000-0000000000aa"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
TURN 2
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “1pm is perfect.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-partial",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
}{
"ok": true,
"booking": {
"id": "8c021682-650f-4c0d-8776-0cafa61f8843",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-partial",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller I'd like to make an appointment with Dr A.
agent I can help with that. What date and time would you like to see Dr. A?
caller July 1st, please.
agent Let me check Dr. A's availability for July 1st. Dr. A has several openings on July 1st, from 9:30 AM through 4:30 PM UTC. What time works best for you?
caller 1pm is perfect.
agent You're all set — your appointment with Dr. A is booked for July 1st at 1:00 PM UTC. Is there anything else I can help with?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Move my July 1st 9am appointment to 11am.”
llm_first_token
tool_call findBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb"
}{
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z",
"status": "active"
} tool_call rescheduleBooking
{
"ref": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
}{
"ok": true,
"booking": {
"id": "bbbbbbbb-bbbb-bbbb-bbbb-0000000000bb",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-000",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Move my July 1st 9am appointment to 11am.
agent I'll pull up your booking first. Done — your appointment is now July 1st at 11:00am. Anything else?
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A at 9am on July 1st.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:00:00Z",
"slotEnd": "2026-07-01T09:30:00Z"
}{
"conflict": true
} tool_call listAvailability
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"date": "2026-07-01"
}[
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:00:00Z",
"slotEnd": "2026-07-01T10:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T10:30:00Z",
"slotEnd": "2026-07-01T11:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:00:00Z",
"slotEnd": "2026-07-01T11:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T11:30:00Z",
"slotEnd": "2026-07-01T12:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:00:00Z",
"slotEnd": "2026-07-01T12:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T12:30:00Z",
"slotEnd": "2026-07-01T13:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:00:00Z",
"slotEnd": "2026-07-01T13:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T13:30:00Z",
"slotEnd": "2026-07-01T14:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:00:00Z",
"slotEnd": "2026-07-01T14:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T14:30:00Z",
"slotEnd": "2026-07-01T15:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:00:00Z",
"slotEnd": "2026-07-01T15:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T15:30:00Z",
"slotEnd": "2026-07-01T16:00:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:00:00Z",
"slotEnd": "2026-07-01T16:30:00Z"
},
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"slotStart": "2026-07-01T16:30:00Z",
"slotEnd": "2026-07-01T17:00:00Z"
}
] tts_first_byte
agent_speech_end
call_end
TURN 1
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Yes, 9:30 please.”
llm_first_token
tool_call createBooking
{
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z"
}{
"ok": true,
"booking": {
"id": "f1ceeba8-e5ea-4777-8f99-489ce23defe6",
"resourceId": "00000000-0000-0000-0000-0000000000aa",
"patientRef": "patient-002",
"slotStart": "2026-07-01T09:30:00Z",
"slotEnd": "2026-07-01T10:00:00Z",
"status": "active"
}
} tts_first_byte
agent_speech_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A at 9am on July 1st.
agent I'll book that for you right now. That 9am slot is taken. Let me check what's available nearby. The nearest opening is 9:30am on July 1st. Would you like me to book that instead?
caller Yes, 9:30 please.
agent You're booked with Dr A on July 1st at 9:30am. Anything else?
3000ms TOOL TIMEOUT · createBooking · 3000ms (STRUCTURAL)
TURN 0
call_start
user_speech_start
user_speech_eos TRIGGER vad_silence
user_transcript “Book me with Dr A on July 3rd at 2pm.”
llm_first_token
tool_timeout
tts_first_byte
agent_speech_end
call_end
TRANSCRIPT scripted (Tier-1)
caller Book me with Dr A on July 3rd at 2pm.
agent I don't have your patient details in the call context, which I need to make a booking. Could you provide your booking reference or your full name so I can pull up your record?
Elapsed/budget columns are (STRUCTURAL) smoke — event ordering under fakes, not measured latency. The dead-air cell is real wall-clock only on the real-Claude (Tier-2) run; on scripted runs it is synthetic and informational. Mishearing and barge-in metrics gate scripted runs; informational where the adapter can't inject. Open a row for its event Tape.
Dead Air · Scripted vs Real
BAKED RUN · fake/T1 → patter/T2 · 2026-07-17T02:07:13.617Z · ba1fbef · CORPUS 629cb08e
18 SAME
Scenarios
ambiguous-intent-clarify Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 3997.5697910000004 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
barge-in-yield Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4783.589922 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 1 → 0 ✓ ✗
book-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 4473.922850000001 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
caller-silence-abandoned Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 3 → 1402.1519230000013 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
caller-silence-reprompt Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4563.2064900000005 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
cancel-confirm-low-confidence Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 8917.963027000005 ✓ ✓
mishearing_handling 1 → 0 ✓ ✗
barge_in_handling 0 → 0 ✓ ✓
cancel-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 6534.146808999998 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
cancel-unknown-booking Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 3582.8511139999973 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
double-barge-in Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4623.041987000004 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 2 → 0 ✓ ✗
escalation-emergency Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 3 → 2674.5761670000065 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
mid-barge-hangup Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 3 → 3139.135190000001 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 1 → 0 ✓ ✗
mishearing-clean-negative Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 3914.911355999997 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
mishearing-repair-booking Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 4976.313553999993 ✓ ✓
mishearing_handling 1 → 1 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
multi-intent-reschedule-and-book Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 9336.240909999993 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
partial-slot-filling Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 8219.231007999988 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
reschedule-happy-path Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 5299.267242000002 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
slot-conflict-alternative Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 5 → 6160.763576000012 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
tool-timeout-escalation Passed Passed SAME
METRICS
outcome_success 1 → 1 ✓ ✓
dead_air_latency 4 → 2028.086565000005 ✓ ✓
mishearing_handling 0 → 0 ✓ ✓
barge_in_handling 0 → 0 ✓ ✓
Real-call observability
Planned — Tier 2 / #3This viewer reads a Tier-1 scorecard: deterministic, scripted runs that validate the harness, domain, and plumbing — not live-call behaviour. The panels below are committed in the design spec (§7) but are not yet implemented, and intentionally show no data.
- Per-turn latency waterfallEOS → TTFT → TTS-first-byte → playout vs the 800ms budget (p50/p95). Needs real STT/LLM/TTS timing.
- Run-over-run trend linesMetric deltas vs the last passing run on the same corpusHash, from the Postgres metrics store.
- Endpointing benchmarkFalse-cut ↔ dead-air tradeoff across ≥3 turn-detection strategies.