obsidian-plugin/lllin000_PaperForge
1
0
Fork 0
mirror of https://github.com/lllin000/PaperForge.git synced 2026-07-22 17:00:23 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
1130 commits 4 branches 19 tags 51 MiB
Commit graph

1130 commits

This branch
This branch
All branches
Author SHA1 Message Date
Research Assistant
fd00a5add2 fix: guard rescue from promoting non_body_insert blocks to body roles 2026-06-06 13:50:24 +08:00
Research Assistant
b4951597e7 feat: add non_body_insert role for early-page non-body insert clusters 2026-06-06 13:48:30 +08:00
Research Assistant
936902a7d6 feat: add Zotero-anchored author alignment check in resolve_metadata 2026-06-06 13:33:20 +08:00
Research Assistant
c974ba7480 fix: remove open-ended authors text heuristics, anchor to page-1 zone only 2026-06-06 13:28:46 +08:00
Research Assistant
2bf7e73fff feat: persist document_structure.json, thread structure truth through downstream pipeline 2026-06-06 13:10:56 +08:00
Research Assistant
674809a2ae refactor: converge structure truth — normalize before profile build, render consumes structure 2026-06-06 13:08:42 +08:00
Research Assistant
5566b2f992 fix: map OCR bbox coordinates to PDF space before span extraction 2026-06-06 12:59:06 +08:00
Research Assistant
6bbe00204c feat: add section-aware OCR rescue pass 2026-06-06 12:34:53 +08:00
Research Assistant
e03a50ea53 refactor: extract OCR document structure analysis into ocr_document.py 2026-06-06 12:30:44 +08:00
Research Assistant
43087401c1 docs: mark completed tasks in document analysis plan, keep only delta tasks 2026-06-06 12:23:08 +08:00
Research Assistant
2122450c8d fix: use page role distribution (not hard page==1) to gate frontmatter_noise rules 2026-06-06 11:57:37 +08:00
Research Assistant
0258f0d66e fix: restrict frontmatter_noise text-based rules to page 1 only, prevent body text misclassification 2026-06-06 11:53:57 +08:00
Research Assistant
fdc1cdf301 feat: extract span_metadata from source PDF via PyMuPDF, wire into both pipelines 2026-06-06 11:44:14 +08:00
Research Assistant
be818f4deb fix: revert PaddleOCR span_metadata passthrough — source is PDF, not OCR engine 2026-06-06 11:42:40 +08:00
Research Assistant
687332d126 docs: correct span_metadata source to PDF (not PaddleOCR), revise plan 2026-06-06 11:42:14 +08:00
Research Assistant
118f643951 feat: second-pass cross-validation for low-confidence role assignments using span profiles 2026-06-06 11:27:44 +08:00
Research Assistant
187fd53efe fix: consolidate duplicate is_visually_heading computation in _is_backmatter_boundary_heading 2026-06-06 11:24:52 +08:00
Research Assistant
9006807127 feat: dynamic heading family discovery with profile matching, remove hardcoded font-size thresholds and absolute page gate 2026-06-06 11:21:25 +08:00
Research Assistant
94de2dbbc7 feat: persist role_span_profiles.json and wire into rebuild pipeline 2026-06-06 11:16:43 +08:00
Research Assistant
5320e825ee fix: remove dead constants, tighten profile quality test assertion 2026-06-06 11:15:41 +08:00
Research Assistant
2604a1c5cf feat: create ocr_profiles.py with span extraction, profile aggregation, and cross-validation 2026-06-06 11:13:01 +08:00
Research Assistant
f67c7d5ac0 feat: carry span_metadata through raw and structured block pipeline 2026-06-06 11:08:44 +08:00
Research Assistant
bdb3eae8ac docs: add unified span metadata spec and integration plan 2026-06-06 11:06:39 +08:00
Research Assistant
7c278fbc60 fix(ocr): properly cluster multi-panel figures — role assignment, cluster bbox crop, render visibility 2026-06-06 10:08:42 +08:00
Research Assistant
c235dbdc68 feat(ocr): journal layout generalization, OCR diagnostics, and debug scripts 2026-06-06 00:46:49 +08:00
Research Assistant
f9b5fb0541 feat(ocr): journal layout generalization — structured boundary, container regime, legend validation 
- Task 1: TailBoundary namedtuple with body_end/backmatter_start/references_start
- Task 2: _classify_backmatter_form — 'container' (PeerJ) vs 'flat' (Frontiers) regime
- Task 3: _attach_container_bodies, _container_child flag for ### child headings
- Task 4: Style-family classification already complete
- Task 6: _is_formal_legend threshold raised to 100, more axis_words added,
  low-confidence fallback with legend_uncertain flag for rejected captions
- 2GN9LMCW: authors correct, furniture suppressed, heading hierarchy,
  container child headings, Figure 4 uncertain
- 7C8829BD: 26/26 markers, correct tail order, no regression
- 296/296 tests pass
 2026-06-05 23:48:56 +08:00
Research Assistant
8a0f6dd0fb feat(ocr): PeerJ-style remediation — frontmatter zoning, heading hierarchy, backmatter container 
- Task 1: Strengthen first-page frontmatter zoning (author/affiliation/furniture zones)
- Task 2: Style-aware heading hierarchy with _infer_heading_level content heuristics
- Tasks 3+4: ADDITIONAL INFORMATION AND DECLARATIONS as backmatter_boundary_heading,
  container ordering (boundary heading emitted first, sub-sections after)
- Task 5: Figure legend validation via _is_formal_legend (width/criterion/axis-vocab rejection)
- Verified on 2GN9LMCW: authors correct, furniture suppressed, heading hierarchy,
  references last
- 7C8829BD regression-free: 26/26 markers, tail order intact
- 296/296 tests pass
 2026-06-05 23:27:10 +08:00
Research Assistant
d52ea37e92 feat(ocr): tail regime remediation + style-aware heading profiles + boundary detection 
- Task: Bidirectional body/backmatter boundary detection (forward/backward spine + tail spread reconciliation)
- Task: Style-aware heading profiles from PDF span_metadata (extract, cluster, disambiguate)
- Task: Lock tests for tail-candidate overreach, cross-page continuation, style-aware heading detection
- 296/296 tests pass, real-paper 7C8829BD verified
 2026-06-05 22:47:13 +08:00
Research Assistant
2e2e8cb8e4 Revert "revert: restore original Phase 2 figure/table matching logic" 
This reverts commit 0a2988b89f.
 2026-06-05 15:38:04 +08:00
Research Assistant
0a2988b89f revert: restore original Phase 2 figure/table matching logic 2026-06-05 15:36:59 +08:00
Research Assistant
ac3c0c4b8e fix: resolve source_pdf during legacy backfill for figure/table crop extraction 2026-06-05 15:29:55 +08:00
Research Assistant
38663913d5 fix: keep images/ for page render blocks, add path_map for compatibility migration 2026-06-05 15:27:43 +08:00
Research Assistant
332eafe4be fix: write page block images to assets/ primary, mirror to images/ compat 2026-06-05 15:25:54 +08:00
Research Assistant
8e0b4bf7c9 fix: sync images/ to assets/ for structured truth 2026-06-05 15:24:29 +08:00
Research Assistant
7d20aba6ba fix: emit figure/table objects on page completion, include all legends in matching 2026-06-05 15:22:04 +08:00
Research Assistant
cff4107633 fix: stabilize object notes, render heading sanity, health/index detection 2026-06-05 15:13:33 +08:00
Research Assistant
174d2e8ccd fix: stabilize OCR table matching and image-first rendering 2026-06-05 15:11:20 +08:00
Research Assistant
0e41454748 fix: harden OCR figure legend detection and matching 2026-06-05 15:09:47 +08:00
Research Assistant
13566f7f34 fix: recover authors from OCR frontmatter with clean split 2026-06-05 15:06:25 +08:00
Research Assistant
0d9725808f fix: strengthen tests, clean object-note format, fix assets_path compat 2026-06-05 15:04:21 +08:00
Research Assistant
009be8c958 fix: stop paper_title pollution, text-to-heading, table HTML leak, author recovery 2026-06-05 15:02:00 +08:00
Research Assistant
27511b6df6 fix: strengthen frontmatter noise detection and abstract recovery for legacy OCR 2026-06-05 14:45:35 +08:00
Research Assistant
e7c942f68b fix: correct title via Zotero frontmatter, anchor figure/table placement, fix page markers and wikilinks 2026-06-05 13:50:26 +08:00
Research Assistant
b5630bc67b fix: restore OCR render assembly, anchored object placement, and LaTeX normalization 2026-06-05 13:38:48 +08:00
Research Assistant
0fa6dd19a9 fix: correct OCR object asset wikilinks for Obsidian 2026-06-05 13:35:52 +08:00
Research Assistant
73a77acbf4 fix: stabilize legacy OCR structure and metadata recovery 2026-06-05 13:34:43 +08:00
Research Assistant
f3fec67469 test: lock OCR render stabilization regressions 2026-06-05 13:31:50 +08:00
Research Assistant
73a9b9d183 style: fix lint issues in legacy backfill code 2026-06-05 13:01:55 +08:00
Research Assistant
b64c9ed130 test: add legacy OCR backfill e2e smoke test procedure 2026-06-05 13:01:15 +08:00
Research Assistant
76c8d3fc1b chore: update status JSON snapshot for legacy backfilled fields 2026-06-05 13:00:40 +08:00