KMS/ragflow
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

fix pdf_parser content confusion (#1458)

Browse Source 
### What problem does this PR solve?

#1407 

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
This commit is contained in:
H 2024-07-11 12:36:55 +08:00 committed by GitHub
parent 8964817d72
commit dbb8f7b77b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 13 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
deepdoc/parser/pdf_parser.py
View File

@ -286,6 +286,19 @@ class RAGFlowPdfParser:
self.mean_height[-1] / 3 self.mean_height[-1] / 3
) )
# solve char content confusion
record_error_length = 0
for c in chars[0:128]:
ii = Recognizer.find_overlapped(c, bxs)
if ii is None:
continue
record_error_length += abs((bxs[ii]["bottom"] + bxs[ii]["bottom"] - c["bottom"] - c["top"]) / 2)
record_error_length = record_error_length / 128
for char in chars:
char["top"] -= record_error_length
char["bottom"] -= record_error_length
# merge chars in the same rect # merge chars in the same rect
for c in Recognizer.sort_X_firstly( for c in Recognizer.sort_X_firstly(
chars, self.mean_width[pagenum - 1] // 4): chars, self.mean_width[pagenum - 1] // 4):