Key takeaways
- Write your requirements first: hours, volume, triage or messages only, languages, how messages reach you and what reports you need.
- Judge vendors on escalation and handoff, not on the greeting. Ask what happens when the on-call physician does not answer.
- Get the business associate agreement, breach-notice terms and security answers in writing before any call is forwarded.
- Place a set of scripted test calls to each finalist, score them the same way, and keep testing after you sign.
Start with your own requirements
Vendors are good at demonstrations. You will compare them more fairly if you write down what you need before the first sales call. Use your after-hours call log and a short conversation with your physicians to answer these questions:
- Which hours need cover: nights, weekends, holidays, lunch, overflow?
- How many calls in each period, and what share are symptom calls?
- Message-only service, nurse triage, or a mix?
- Which languages do your callers need, and at what hours?
- How should messages reach you: EHR inbox, secure app, portal?
- Who is on call, how should they be reached, and who is the backup?
- What reports do you want, and how often?
If you are still deciding whether to outsource at all, read answering service vs in-house after-hours coverage first.
The vendor checklist
| Area | Ask | Good answer | Red flag |
|---|---|---|---|
| Scripts | Can we write and approve every script? | Yes, with version history and sign-off | Standard scripts only |
| Triage protocols | Which protocols do your nurses use, and can our clinicians review them? | Named, recognized protocol set; clinician review welcome | “Our nurses use their judgement” |
| Escalation | How do you reach our on-call provider, and how fast? | Defined page sequence with time limits and logging | One attempt, then a message |
| Backup | What if the on-call provider does not respond? | Second attempt, then named backup, all logged | No answer |
| Message delivery | How do messages reach us? | Secure, sorted by type, before opening | Plain email or fax only |
| BAA | Will you sign our business associate agreement or provide yours? | Yes, before go-live | Hesitation or “not needed” |
| Security | Where are recordings and messages stored, for how long, and who can access them? | Clear written answers | Vague answers |
| Breach notice | How quickly will you tell us about a breach? | A contractual deadline well inside HIPAA limits | No commitment |
| Languages | How do you handle callers who need an interpreter at 3 a.m.? | Interpreter added on the call, named languages | Callback in the morning |
| Reporting | What reports do we get? | Call log, response times, pages, by type | Monthly invoice only |
| Quality | How do you review agent calls? | Regular sampled review, shared with us | No process |
| AI use | Do you use automated or AI tools on our calls? | Clear disclosure and controls | Unclear |
Escalation is where services differ most
Greetings sound alike across vendors. The real difference shows up when a caller meets your urgent criteria at 2 a.m. Ask each vendor to walk through, step by step, what happens next, and get it in writing.
- How the agent recognizes a call that meets your criteria, and whether non-clinical agents ever decide a symptom can wait (they should not).
- The page sequence: first method, retry interval, number of attempts and when the backup is called.
- What the caller is told while the service tries to reach the provider, and when the service calls them back.
- How the vendor records each attempt, and whether you can see that record the next day.
- What happens on holidays, during outages and if the vendor's own site goes down.
Write the page criteria with your physicians before you choose; our guide to on-call escalation rules shows how.
BAA, security and breach notice
An answering service handles protected health information on almost every call. HIPAA allows a covered entity to let a business associate handle that information only with satisfactory assurance, in a business associate agreement, that the vendor will safeguard it[1]. Breach rules apply too: notification to affected individuals must be made without unreasonable delay and no later than 60 calendar days after discovery[2], and breaches affecting fewer than 500 individuals must be logged and reported to HHS within 60 days after the end of each calendar year[3]. Your contract should require the vendor to tell you quickly enough for you to meet those duties.
If the vendor uses AI or automation
More services now use speech recognition, automated message summaries or AI voices. Ask exactly where automation is used, whether a person reviews its output, and how it is tested. Few practices have rules of their own for this yet: only 20% of medical groups have AI governance or a formal AI-use policy, and 56% have none[4].
- Have one 20%
- Developing one 22%
- None 56%
- Unsure 2%
Source: Medical Group Management Association (MGMA), 2026[4]
Show the data
| Item | Value |
|---|---|
| Have one | 20% |
| Developing one | 22% |
| None | 56% |
| Unsure | 2% |
- If any tool supports patient care decisions, Section 1557 rules require covered entities to make reasonable efforts to identify and mitigate discrimination risks from tools that use race, color, national origin, sex, age or disability[5].
- If the vendor places outbound reminder or follow-up calls with AI-generated voices, note that in 2024 the FCC ruled such calls are artificial under the Telephone Consumer Protection Act[6]. Check consent and calling rules with the vendor and your counsel.
- Ask whether call recordings or transcripts are used to train the vendor's systems, and get the answer in the contract.
Language access
Under Section 1557 rules, when interpretation is required a covered entity must offer a qualified interpreter[7]. That duty does not stop at 5 p.m. Ask finalists to demonstrate an interpreted call during a test, and ask how triage nurses document calls made through an interpreter.
Test calls before you sign
Set up a trial line
Ask finalists to set up a test number with your draft scripts for a week.
Write the scenarios
Routine refill request at 9 p.m.; caller describing chest pain; Spanish-speaking parent; frustrated caller about a bill; hospital asking for the on-call physician; parent of a feverish infant; wrong number; caller who hangs up mid-call.
Call at different hours
Include a weekday evening, after midnight and a weekend morning.
Score each call the same way
Greeting, emergency instruction, accuracy of the message, correct escalation, time to page, tone, and what reached you the next morning.
Check the paperwork
Compare what you said with the message and log the vendor delivered.
Use fictional patient names and details in test calls. Never use real patient information to test a vendor that has not yet signed a business associate agreement.
Ask two or three people to make the calls, not just the manager, and include someone who sounds anxious or speaks quickly. Agents behave differently with a calm, well-organized caller than with a worried parent at midnight, and the second is the caller who matters most.
A weighted scorecard
| Criterion | Example weight | What earns full marks |
|---|---|---|
| Escalation and backup | 25 | Correct, fast, fully logged page in every urgent test call |
| Message accuracy and delivery | 20 | Accurate, sorted, secure, before opening |
| Compliance and security | 15 | BAA, clear storage answers, breach-notice commitment |
| Triage protocols (if used) | 15 | Recognized protocols, notes shared, clinician review |
| Language access | 10 | Interpreter added on the call at any hour |
| Reporting | 10 | Useful reports without asking |
| Caller experience | 5 | Calm, clear, uses your scripts |
Talk to practices that use them
Ask each finalist for two or three current clients of a similar size and specialty, and call them yourself. Sales references are chosen to be happy, so ask specific questions that reveal how problems are handled rather than whether the client likes the vendor.
- When did the service last make a mistake on an urgent call, and how did it respond?
- How long do script changes take to go live?
- Do messages arrive complete and sorted, or does your staff rework them each morning?
- Has the service ever failed to reach your on-call provider, and what happened next?
- Would you choose the same vendor again, and what would you negotiate differently?
If a vendor's call center is within reach, a short visit to watch agents take live calls tells you more about training and pace than any brochure. Ask to see how an agent finds your scripts and page criteria on screen.
Contract questions
- What counts as a billable call or minute? Hang-ups, wrong numbers and patches to the provider are handled differently by different vendors.
- Are there minimums, setup fees, holiday surcharges or charges for script changes?
- How long is the term, how much notice to leave, and how will call records be returned or destroyed when you leave?
- Who at the vendor is your named contact, and how quickly do they respond to problems?
- Can you listen to recordings of your calls on request?
The first ninety days
- Kick-off: scripts, page criteria, on-call schedule and message routing confirmed in writing.
- Go-live on a weekday, with a staff member checking the first night's messages early.
- Weekly review for the first month: a sample of calls, pages and messages.
- Monthly review after that, with the vendor's quality lead.
- A repeat set of test calls at day ninety.
Update your after-hours voicemail greeting and your after-hours policy so they match what the service now does. For background on the models, see how medical answering services work.
Example: choosing between two finalists
Example (fictional): an internal medicine group shortlisted two services. The first gave a polished demo and the lower quote. The second was plainer on the phone. In test calls, the first service took a message for the chest-pain scenario instead of giving the emergency instruction, and its morning report arrived by unencrypted email. The second gave the instruction at once, paged the test on-call number within the agreed time and delivered sorted messages through a secure app. The group chose the second service and kept the test scenarios for quarterly checks.
Frequently asked questions
What should I ask a medical answering service?
Ask who writes the scripts, which triage protocols nurses use, exactly how and how fast the on-call provider is reached, what happens if they do not respond, how messages are delivered, whether they will sign a BAA and how they handle interpreters.
Does a medical answering service have to be HIPAA compliant?
If it handles protected health information for your practice, it is a business associate and must sign a business associate agreement giving satisfactory assurance it will safeguard the information.
How do I test an answering service?
Place scripted test calls with fictional details at different hours, including an emergency scenario and an interpreter call, and score each call and the next-morning message the same way for every vendor.
Should an answering service use AI?
It depends on how. Ask where automation is used, whether people review its output, whether your recordings train its systems and how it meets nondiscrimination and calling rules.
References
Legal Information Institute, Cornell Law School (Electronic Code of Federal Regulations text) (current). 45 CFR § 164.502 - Uses and disclosures of protected health information: General rules (opens in a new tab) ↑
Legal Information Institute, Cornell Law School (Electronic Code of Federal Regulations text) (current). 45 CFR § 164.404 - Notification to individuals (opens in a new tab) ↑
Legal Information Institute, Cornell Law School (Electronic Code of Federal Regulations text) (current). 45 CFR § 164.408 - Notification to the Secretary (opens in a new tab) ↑
Medical Group Management Association (MGMA) (2026). AI governance in medical group practices: Rules for the humans in the loop (opens in a new tab) ↑
Legal Information Institute, Cornell Law School (Electronic Code of Federal Regulations text) (current). 45 CFR § 92.210 - Nondiscrimination in the use of patient care decision support tools (opens in a new tab) ↑
Federal Communications Commission (2024). FCC Makes AI-Generated Voices in Robocalls Illegal (news release) (opens in a new tab) ↑
Legal Information Institute, Cornell Law School (Electronic Code of Federal Regulations text) (current). 45 CFR § 92.201 - Meaningful access for individuals with limited English proficiency (opens in a new tab) ↑