[P]Modern open-source OCR capabilities and which model to choose

Submitted by Rodny_ t3_yyenpp in MachineLearning

Hi, I was wondering how good modern open-source OCR models are. Are they capable of reading text with different fonts on various backgrounds with decent success? What success rate I might expect? I am primarily interested in numbers recognition could you recommend me some good models for that? If you do not get good results out of the box do the models allow you to do some fine tuning? And lastly what latency can I expect from it if there are about 5-10 numbers on one image that I want to read? I was looking on the web for such info but all I found were articles comparing the models between each other rather than specifying the state and capabilities of these models. Thanks, everyone for the information.

14

Comments

You must log in or register to comment.

flapflip9 t1_iwumecm wrote

Look into open-mmlab's MMOCR, does both detection and recognition, with English and Chinese alphabet support. Absolutely wicked performance, it scrapes off text from logos, flyers, blurred text, etc. Not suitable for real-time performance.

Until a few years ago, I was quite happy with Tesseract, but they've fallen behind since then. Still good for scanning printed text or similar. Also supports a lot of languages.

5

robertknight2 t1_iwveveb wrote

To add to this, Tesseract's text recognition of identified lines of text uses a modern approach involving LSTM neural networks, but the text detection process which comes before this uses classical/heuristic (ie. non-ML) approaches which work well on clean-ish document images, but can struggle with photos of documents that have uneven lighting conditions and spotting text in a photo (eg. numberplates in a city scene).

I maintain a JavaScript build of Tesseract with an online demo that you can try with different images: https://robertknight.github.io/tesseract-wasm/

6

mikeful t1_iwui31v wrote

I've used EasyOCR for number recognition tasks. Works fairly well. https://github.com/JaidedAI/EasyOCR

Tried to speed up recognition by running task tuned segmentation model and cropping input image on good detection but EasyOCR seemed to work better without it.

4

Jean-Porte t1_iwwbgr7 wrote

I wish this problem was addressed by big players more. OCR on handwritten text is challenging but very useful

2

Rodny_ OP t1_iwwd1ta wrote

Yea on one hand it seems like problem that is quite easy to solve but the more you dig the more problems and obstructions you find. And than it makes you wondering why is such a basic task so hard to solve with some easy to use tools but textToImage models does get so much attention witch such an accessible tools.

2

visarga t1_iwwdkai wrote

Because it's a lucrative AI API for all the big players. Selling OCR for documents.

3

AtomKanister t1_iwwx4hs wrote

Might also be the data. The open-source internet is full of images with related text that can be crawled, but you won't find a lot of document scans with annotated boxes out there.

However, it's definitely doable. The paid services from cloud providers are all very, very high quality. It's more likely an open source availability issue.

1

labloke11 t1_iwwmt3m wrote

I have been using different ocr to process forms and I came to a conclusion, they all kind of sucks.

2