TL;DR: Conventional OCR averages roughly 85% accuracy on medical faxes and degrades sharply on faded thermal pages, handwriting, and stamps printed over text. AI-based extraction using layout-aware models is commonly reported above 95% on the same material. Neither reaches 100%, so the question that actually determines whether fax OCR extraction works for your practice isn't the headline accuracy number — it's what the system does with the documents it can't read confidently.
The honest accuracy range, and why one number won't hold for you
Every vendor in this category quotes an accuracy figure. Most of them are quoting it honestly, measured on a dataset that looks nothing like your fax inbox.
The published ranges are directionally useful. Conventional OCR pipelines land in the mid-80s on real medical documents. Layout-aware AI extraction is reported above 95%. That gap is real and it's the reason the category moved. But both numbers were measured on document sets that skew cleaner than what a specialty practice actually receives, and neither predicts what you'll see on a Tuesday afternoon when a rural referring office sends four pages through a machine that should have been replaced in 2009.
If you've been burned by an OCR rollout before, this is almost certainly why. The pilot ran on clean documents, the number looked good, and the production environment included the twenty percent of your traffic that nobody sampled.
Treat published accuracy as evidence about which approach is stronger. Treat your own document sample as the number you actually plan around.
What actually breaks extraction on a real fax
The failure modes are specific and predictable, which means you can test for them deliberately instead of discovering them in month two.
- Faded thermal pages. Characters lose contrast unevenly. Extraction quality drops most on small print, which is where insurance details and codes tend to live.
- Handwriting. Printed and typed content extracts reliably. Handwritten annotations in margins — a physician's note about urgency, a corrected date of birth — are the weakest case for every system on the market. Cursive is worse than print.
- Stamps and overlays. "RECEIVED" stamped across the member ID, a signature crossing a date field, a highlighter mark that scanned as a black bar. Overlapping marks confuse character boundaries.
- Skew and feed errors. Pages fed crooked, upside down, or partially. Good platforms de-skew automatically; the ones that don't will fail on documents a person would read without noticing anything wrong.
- Non-standard layouts. A referring office that built its own referral form in Word fifteen years ago and never changed it. Layout-aware models generalize better here than template-based OCR, but unusual forms still produce more exceptions.
- Multi-document packets. A forty-page discharge packet containing six distinct documents. If the system can't split it, everything after page one gets mislabeled regardless of how well the characters were recognized.
- Legacy forms and pre-digital records. Photocopies of photocopies, records predating current formatting standards, documents where the original was already degraded.
Pull one week of your fax volume and count how much of it falls into these buckets. That percentage is the ceiling on what any vendor's benchmark number means for you.
Why field-level accuracy is the only number worth quoting
Character-level accuracy is what most vendors report. It's also close to meaningless operationally.
A system that reads 97% of characters correctly can still get the member ID wrong on a meaningful share of documents, because a single transposed digit in an eleven-character string ruins the field even though 91% of its characters were right. Meanwhile a misread character in a physician's middle initial changes nothing at all.
Ask for accuracy on the fields you plan to act on, reported separately:
- Patient name and date of birth, which drive chart matching
- MRN when present
- Insurance payer, member ID, and group number
- Ordering or referring provider name and NPI
- CPT and ICD codes
- Document date
These fields have very different accuracy profiles. Dates of birth extract well because they're formatted predictably. Member IDs extract worse because they're long alphanumeric strings with no internal logic to validate against. A vendor who can break out accuracy this way has measured their system properly. One who can only give you a single blended number probably hasn't.
How confidence scoring contains the damage
Accuracy alone doesn't determine how much labor you save. What determines it is whether the system knows when it's uncertain.
Consider two platforms. The first extracts correctly 96% of the time but files everything with equal confidence. Your staff has to spot-check every document, because there's no way to know which 4% is wrong — and a wrong value that files silently is worse than no value at all. The second extracts correctly 92% of the time but attaches a confidence score to every field and routes anything below your threshold to a review queue. Staff verify a small, targeted subset and the rest files automatically.
The second platform saves more time despite the lower headline number. That's the whole game.
Honey Health's fax triage and data-fetching agents are built on this principle: high extraction accuracy matters, and a designed exception path matters at least as much. Classification, extraction, patient matching, and chart filing run without a person; the documents the system isn't sure about surface with the extracted values pre-filled beside the source page, so review is a confirmation rather than a re-keying task.
Set your thresholds conservatively at go-live and loosen them as you accumulate evidence. Every practice's tolerance is different, and the fields that require near-certainty — anything that identifies a patient — should be held to a higher bar than fields that only affect routing.
What a mis-extracted field costs downstream
The compliance and revenue stakes are why this deserves more scrutiny than a typical software evaluation.
A mis-extracted date of birth or MRN can put a clinical document in the wrong patient's chart. That's a patient-safety event and a HIPAA problem, not an efficiency problem, and it's the reason match thresholds should never be set loosely to chase a higher automation rate.
A mis-extracted member ID produces a denial four to six weeks later, by which point nobody connects it back to the fax. Intake data quality is now a leading denial driver: survey data reported by AJMC found that more than a quarter of provider organizations trace at least one in ten denials to incomplete or inaccurate information captured at intake, and that a majority say claim errors are increasing year over year. Automated extraction can improve on manual keying — humans transpose digits too — but only when the errors it does make are visible rather than silent.
Keep an audit trail regardless. Every automated action on a PHI-bearing document should log what was extracted, what confidence it carried, what chart it matched to, and who reviewed it if anyone did. The first time someone asks how a document ended up in a particular chart, that log is the answer.
How to run an accuracy pilot that tells you something
Most pilots are designed to succeed. Design yours to find the failures early.
Sample deliberately, not randomly. Pull 200 to 300 documents that include your worst-quality senders, your highest-volume document types, at least a few handwritten annotations, and several multi-document packets. A random sample will over-represent clean documents.
Build a ground-truth set. Have a staff member key the target fields manually for the sample before the vendor runs it. Without ground truth you're grading the vendor's homework with the vendor's answer key.
Measure per field, per document type. Referrals and lab results will perform differently. Knowing which is which tells you where to start.
Record the exception rate, not just accuracy. What share landed below the confidence threshold? That number determines your staffing plan.
Check the failure behavior. For every document the system got wrong, did it flag itself as uncertain, or did it file confidently? Silent errors should be counted separately and weighted heavily.
Run it over at least two weeks so you capture normal variation in what arrives. A three-day pilot measures one week's senders.
What to do about the documents that never extract well
Some portion of your volume will resist automation permanently, and planning for it beats pretending otherwise.
The practical approach is triage by document type rather than trying to lift the overall rate. Automate the categories that extract cleanly — refill requests and structured lab results usually top that list — and leave the persistent problem categories on a human path with the extraction output used as a head start rather than a decision.
It's also worth working the supply side. If three referring offices generate a disproportionate share of your exceptions, a phone call asking them to send from their EHR rather than a physical machine often fixes more than any software setting. Practices rarely try this because it feels like it's outside their control. It frequently isn't.
Finally, revisit the numbers quarterly. Extraction quality improves as models update and as the system tunes to your document mix. The category you wrote off in March may be automatable by September, and nobody will tell you unless you look.
Frequently Asked Questions
What accuracy should I expect on faded thermal faxes?
Meaningfully lower than on clean documents, and the drop is steepest on small print — which is where insurance details and codes usually sit. Layout-aware AI extraction handles degraded pages better than conventional OCR because it uses surrounding context to infer partially-readable values, but faded pages should be expected to generate a higher exception rate rather than automated cleanly.
Can any system read handwritten notes on a fax reliably?
Not reliably enough to auto-file. Handwriting is the hardest case for every platform in this category, and cursive is harder than printed handwriting. A well-designed system detects handwritten regions, marks them low confidence, and routes them for human review while still filing the document to the correct chart based on the printed content.
Is 95% accuracy good enough to automate without review?
It depends entirely on which fields and whether errors are visible. For routing decisions, yes. For patient identifiers, no — a wrong match puts a document in the wrong chart, which is a safety and compliance issue rather than an efficiency one. Hold identity fields to a higher confidence threshold than everything else.
How do I compare accuracy claims across vendors?
Give every vendor the same sample of your own documents and the same ground-truth answer key, then compare field-level accuracy and exception rate side by side. Published benchmarks aren't comparable across vendors because they're measured on different datasets with different definitions of a correct extraction.
Does extraction accuracy improve over time?
Generally yes, for two reasons: the underlying models improve with vendor updates, and the system tunes to your specific document mix and sender formats over the first several weeks. Expect the automation rate to climb through roughly the first two months. If it's flat after that, raise it with the vendor rather than accepting it.

