OCRopus explained

OCRopus
Developer:Thomas Breuel, DFKI
Released:[1]
Latest Release Version:1.3.3
Programming Language:C++ and Python
Operating System:FreeBSD, Linux, Mac OS X
Genre:Optical character recognition
License:Apache License v2.0

OCRopus is a free document analysis and optical character recognition (OCR) system released under the Apache License v2.0 with a very modular design using command-line interfaces.

OCRopus is developed under the lead of Thomas Breuel from the German Research Centre for Artificial Intelligence in Kaiserslautern, Germany and was sponsored by Google.

Description

OCRopus was especially designed for use in high-volume digitization projects of books, such as Google Books, Internet Archive, or libraries. A large number of languages and fonts are to be supported.[2] However, it can also be used for desktop and office applications or for application for visually impaired people.

OCRopus has main components which perform:

Single or multiple scripts are available for these components. The modular programming approach allows individual workflows to be used and individual steps to be exchanged.

By default, OCRopus comes with a model for English texts and a model for text in Fraktur. These models refer to the script and are largely independent of the actual language.[3] New characters or language variants can be trained either from the start, or addeded later.

Recent text recognition is based on recurrent neural networks (LSTM) and does not require a language model. This makes it possible to train language-independent models for which good recognition results in English, German and French have been shown at the same time.[4] In addition to the Latin script, there are results for other scripts such as Sanskrit, Urdu, Devanagari, and Greek.

Very good detection rates can be achieved through an appropriate training. This extra effort is particularly worthwhile for difficult documents or scripts that are no longer common today, which are not in the focus of other OCR software.[5] [6]

History

On 9 April 2007, OCRopus was announced as a Google-sponsored project to develop advanced OCR technologies. Funding was granted for a period of three years and covered in particular PhD and postdoctoral positions at DFKI and the University of Kaiserslautern. In return, OCRopus was also used for automatic text recognition in Google Book Search.[7] Licensing under an open source license was made right from the start to facilitate collaboration between industrial and academic research.[8] OCRopus has received further funding from the Andrew W. Mellon Foundation and the BMBF.[9]

The first alpha version 0.1 was released on 22 October 2007 and several pre-releases followed between December 2007 and May 2009 reaching a stable version 0.4.4 in March 2010.[10] Originally, the software was developed in C++, Python and Lua with Jam as a build system. A complete refactoring of the source code in Python modules was done and released in version 0.5 (June 2012).[11]

Initially, Tesseract was used as the only text recognition module. Since 2009 (version 0.4) Tesseract was only supported as a plugin. Instead, a self-developed text recognizer (also segment-based) was used.[12] This recognizer was then used together with OpenFST[13] for language modeling after the recognition step. From 2013 onwards, an additional recognition with recurrent neural networks (LSTM) was offered, which with the release of version 1.0 in November 2014 is the only recognizer.[14] [15]

The source code is managed over GitHub and is maintained and developed by a developer community. The current version of OCRopus is 1.3.3 (December 2017).[16]

The OCR software kraken which is used by the transcription platform eScriptorium is a fork of OCRopus. It added support for right-to-left scripts.[17] Another fork which is based on kraken is Calamari.

Thomas Breuel also developed a successor OCRopus 2 and is actively working on OCRopus 4.[18]

Usage

OCRopus can be used from the command line. Once installed, it can be invoked by specifying the input images. It will output the recognized text to standard output directly or write it as hOCR (HTML-based) code into files, from which it then can be transformed to a searchable PDF. If more precise control is needed, options can be specified on the command line to perform specific operations (e.g. recognizing a single line).[19]

Example for the OCRopus calls to recognize the text in an image: # perform binarization ocropus-nlbin tests/ersch.png -o book # perform page layout analysis ocropus-gpageseg book/0001.bin.png # perform text line recognition (with a fraktur model) ocropus-rpred -m models/fraktur.pyrnn.gz book/0001/*.bin.png # generate HTML output ocropus-hocr book/0001.bin.png -o book/0001.html

Other tools concentrate on the training part of OCRopus. There are OCRopus models to extract text from Latin, Greek, Cyrillic and Indic scripts.[20]

External links

Notes and References

  1. News: Announcing the OCRopus Open Source OCR System. Breuel. Thomas. 2007-04-09. Google Developers Blog. 2017-12-29. en-US.
  2. Book: Breuel, Thomas. Proceedings of the International Workshop on Multilingual OCR - MOCR '09. Recent progress on the OCRopus OCR system. 2009 . New York, NY, USA. ACM. 2:1–2:10. 10.1145/1577802.1577805. 9781605586984. 16920122.
  3. Web site: Models. ocropy wiki. 2018-01-05.
  4. Book: Ul-Hasan. Adnan. Breuel. Thomas M.. Proceedings of the 4th International Workshop on Multilingual OCR - MOCR '13. Can we build language-independent OCR using LSTM networks?. 2013 . New York, NY, USA. ACM. 9:1–9:5. 10.1145/2505377.2505394. 9781450321143. 15054318.
  5. Springmann. Uwe. 2016-12-01. OCR für alte Drucke. Informatik-Spektrum. de. 39. 6. 459–462. 10.1007/s00287-016-1004-3. 26680054. 0170-6012.
  6. Book: Simistira. F.. Ul-Hassan. A.. Papavassiliou. V.. Gatos. B.. Katsouros. V.. Liwicki. M.. 2015 13th International Conference on Document Analysis and Recognition (ICDAR) . Recognition of historical Greek polytonic scripts using LSTM networks . August 2015. 766–770. 10.1109/icdar.2015.7333865. 978-1-4799-1805-8. 39049104.
  7. Web site: Research project OCRopus. dfki.de. en. 2018-01-05.
  8. Book: Breuel, Thomas M.. Berrin A. Yanikoglu. Kathrin. Berkner. Document Recognition and Retrieval XV. The OCRopus open source OCR system. 2008-01-28 . 6815. 68150F–68150F–15. 10.1117/12.783598. Document Recognition and Retrieval XV. 10.1.1.99.8505. 2008SPIE.6815E..0FB. 14728635.
  9. Web site: ocropus project website. January 2019. Google Project Hosting. https://web.archive.org/web/20121224105419/http://code.google.com/p/ocropus#Acknowledgements. 24 December 2012. dead.
  10. Web site: Older versions - ocropy. GitHub. 2018-01-05.
  11. Web site: OCRopus 0.5. 2012-06-02. Google Groups.
  12. http://groups.google.com/group/ocropus/msg/96c4081a3213dbcc OCRopus doesn't even link with Tesseract by default
  13. http://www.openfst.org/ Official OpenFST website
  14. Web site: ocropy - release v1.0. 2014-11-02. GitHub. 2018-01-05.
  15. Book: Breuel. T. M.. Ul-Hasan. A.. Al-Azawi. M. A.. Shafait. F.. 2013 12th International Conference on Document Analysis and Recognition . High-Performance OCR for Printed English and Fraktur Using LSTM Networks . August 2013. 683–687. 10.1109/icdar.2013.140. 978-0-7695-4999-6. 7244356.
  16. Web site: Releases ocropy. GitHub. 2018-01-05.
  17. Web site: Kraken - a Universal Text Recognizer for the Humanities. 2024-01-23.
  18. Web site: The OCRopus OCR System and Related Software. GitHub. 2021-08-27.
  19. Web site: ocropy wiki. GitHub. 2017-12-30.
  20. Web site: ocropy models. GitHub. en. 2018-03-13.