Add feature for extracting images from pdf and recognizing text from images. #10653
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
dosubot
bot
added
Ɑ: doc loader
therontau0054
force-pushed
the
pdf_image
branch
from
6d31616 to
fe8dffc
Compare
therontau0054
force-pushed
the
pdf_image
branch
from
fe8dffc to
6c10c2a
Compare
|
@eyurtsev @baskaryan would it be possible to have a look at this? It may be a great feature to add. :) |
baskaryan
added
the
lgtm
|
this is awesome, thank @SuperJokerayo!! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
It is for #10423 that it will be a useful feature if we can extract images from pdf and recognize text on them. I have implemented it with
PyPDFLoader,PyPDFium2Loader,PyPDFDirectoryLoader,PyMuPDFLoader,PDFMinerLoader, andPDFPlumberLoader. RapidOCR is used to recognize text on extracted images. It is time-consuming for ocr so a boolen parameterextract_imagesis set to control whether to extract and recognize. I have tested the time usage for each parser on my own laptop thinkbook 14+ with AMD R7-6800H by unit test and the result is:Issue
#10423
Dependencies
rapidocr_onnxruntime in RapidOCR