Comment by seletskiy

To tptacek and other guys who seem to have unwavering trust in OCRs/LLMs, as well as to opposite party who think that technology is not there yet — you are all partially right, but somehow fail to hear each other while also spending time on baseless arguing instead of factual examples and attempts to find common truth.

Can it be used to greatly simplify efforts by getting through boilerplate? — Yes.

Should the result be reviewed and proof-read by human? — Also yes.

---

Here subtle one: https://catalog.archives.gov/id/34384201?objectPage=40

Here is (one of) transcripts made by `o1-pro`:

  (2)

  …and I don’t know whether it can be reset for a
  date in December or not. Cornell seemed
  anxious that it should not come up too close to Christmas,
  and of course new suspicion [would be aroused?] [about?] him.
  I will take this up with the Judge as soon as I can get rid of the brief.
  Meanwhile I would like to know whether there is anything else
  in which I can be useful to you, since it behooves me
  in ways of uncomfortable relations with the present management.

  Are you going East in December?
  Has any word come from Hagerman?
  Were there any noteworthy developments at the hearings
  on the [Teapot?] trial?

  I have no inclination yet whether Wheeler will be wanted in
  Washington, but the chances are that he will not.

  With regards to all the brethren and [flock?], I am

  very sincerely yours,
  George A. H. Fraser

I'm not native english speaker, but even I can read where it is wrong. I'll leave it to be an excercise for the reader to find out mistakes, but it is certainly not a Teapot trial.

Somehow GPT-4o performs better on this example and fails only on "New Mexican practise" part.