Description
In the digital humanities, there is a constant need to turn images and PDF files into plain text to apply analyses such as topic modelling, named entity recognition, and other techniques. However, although there exist different solutions to extract text embedded in PDF files or run OCR on images, they typically require additional training (for example, scholars have to learn how to use the command line) or are difficult to automate without programming skills. The Giles Ecosystem is a distributed system based on Apache Kafka that allows users to upload documents for text and image extraction. The system components are implemented using Java and the Spring Framework and are available under an Open Source license on GitHub (https://github.com/diging/).
Copyright Statement
Reuse Permissions
Details
Title
- The Giles Ecosystem – Storage, Text Extraction, and OCR of Documents
Contributors
- Lessios-Damerow, Julia (Contributor)
- Peirson, Erick (Contributor)
- Laubichler, Manfred (Contributor)
- ASU-SFI Center for Biosocial Complex Systems (Contributor)
Date Created
The date the item was original created (prior to any relationship with the ASU Digital Repositories.)
2017-09-28
Resource Type
Collections this item is in
Identifier
- Digital object identifier: 10.5334/jors.164
- Identifier TypeInternational standard serial numberIdentifier Value2049-9647
Note
- The final version of this article, as published in The Journal of Open Research, can be viewed online at: https://openresearchsoftware.metajnl.com/articles/10.5334/jors.164/, opens in a new window
Citation and reuse
Cite this item
This is a suggested citation. Consult the appropriate style guide for specific citation guidelines.
Damerow, J., Peirson, B. R., & Laubichler, M. D. (2017). The Giles Ecosystem – Storage, Text Extraction, and OCR of Documents. Journal of Open Research Software, 5. doi:10.5334/jors.164