No description
Find a file
Research Assistant ba68910cf3 fix(ocr): dedup backfill text in rebuild + exclude footer from table notes
- Add rebuild raw-block dedup: strip pdf_text_layer_fallback blocks
  whose 5-gram overlap with same-page body exceeds 80%
- Propagate _text_source / _ocr_raw_status / _ocr_raw_error_type to
  structured blocks for downstream debugging
- Add render-level dedup: skip body_paragraph if _text_source marks
  it as backfill with >=80% overlap vs emitted page text
- Exclude noise/page_footer/page_header/frontmatter_noise roles from
  table note candidate detection
2026-06-22 17:28:06 +08:00
.github test: clean up brittle and low-value tests 2026-05-24 20:00:47 +08:00
.opencode fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
.planning test: lock OCR phase2 figure inventory contract 2026-06-05 00:08:30 +08:00
.tmp/tail_pdf_samples feat(ocr): tail regime remediation + style-aware heading profiles + boundary detection 2026-06-05 22:47:13 +08:00
audit fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
docs docs: update PROJECT-MANAGEMENT with 2HEUD5P9 rebuild findings 2026-06-22 02:50:37 +08:00
fixtures feat: surface OCR structured health in doctor and status 2026-06-05 10:35:23 +08:00
paperforge fix(ocr): dedup backfill text in rebuild + exclude footer from table notes 2026-06-22 17:28:06 +08:00
project docs: remove OCR truth surface contradictions 2026-06-19 23:30:08 +08:00
scripts test: lock OCR readiness baseline and restore coverage ledger 2026-06-18 22:10:52 +08:00
tests feat: convert body-zone footnotes with distinct font to callout 2026-06-22 01:51:10 +08:00
.gitignore chore: add .ai-bridge/ to gitignore (codexpro temp files) 2026-06-19 16:22:31 +08:00
.pre-commit-config.yaml chore: add PR template + pre-commit config (ruff auto-format) 2026-05-10 12:04:12 +08:00
_amb_detail.py fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
_check_effect.py feat(ocr): journal layout generalization, OCR diagnostics, and debug scripts 2026-06-06 00:46:49 +08:00
_check_rebuild.py fix: remove open-ended authors text heuristics, anchor to page-1 zone only 2026-06-06 13:28:46 +08:00
_chk_pdf.py fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
_chk_vfs_p11.py fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
_extract_master_figs.py feat(ocr): journal layout generalization, OCR diagnostics, and debug scripts 2026-06-06 00:46:49 +08:00
_figmap.json fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
_final_stats.py fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
_master_funcs.txt feat(ocr): journal layout generalization, OCR diagnostics, and debug scripts 2026-06-06 00:46:49 +08:00
_render_full.py feat(ocr): journal layout generalization, OCR diagnostics, and debug scripts 2026-06-06 00:46:49 +08:00
_test_6qnr.py fix: heading detection, backmatter, table consumed, footnote reorder, figure crop + audit fixtures 2026-06-22 01:28:55 +08:00
AGENTS.md docs: make ponytail always-active with auto-trigger rules 2026-06-17 01:36:41 +08:00
CHANGELOG.md docs: CHANGELOG 1.5.9 - tail rendering fix 2026-06-17 01:33:21 +08:00
CONTRIBUTING.md docs: add CONTRIBUTING.md — sync fork guide and PR checklist 2026-05-10 12:02:07 +08:00
INSTALLATION.md docs: replace git+https install URLs with pip install paperforge (PyPI) 2026-05-11 19:25:38 +08:00
LICENSE docs: add CC BY-NC-SA 4.0 license and acknowledgments 2026-05-01 11:37:50 +08:00
manifest.json bump: 1.5.14 -> 1.5.15 2026-06-01 19:46:46 +08:00
OCR-V2-READINESS-SUMMARY.md docs: add OCR-v2 readiness summary for agent handoff 2026-06-19 00:44:00 +08:00
paperforge.json refactor: __init__.py as single version source; pyproject.toml reads dynamically; paperforge.json drops version field 2026-04-28 22:41:48 +08:00
PROJECT-MANAGEMENT.md docs: update PROJECT-MANAGEMENT with 2HEUD5P9 rebuild findings 2026-06-22 02:50:37 +08:00
pyproject.toml chore: remove sentence-transformers from [vector] extra 2026-05-18 17:24:29 +08:00
README.en.md docs: reset documentation IA (readme entry pages, tutorial/troubleshooting split, AGENTS agent-only, pure command ref, maintainer guide) 2026-05-16 22:47:00 +08:00
README.md docs: reset documentation IA (readme entry pages, tutorial/troubleshooting split, AGENTS agent-only, pure command ref, maintainer guide) 2026-05-16 22:47:00 +08:00
README.zh-CN.md docs: redesign README with banner and dashboard preview 2026-05-02 14:52:59 +08:00
README.zh.md docs: expand memory and embedding layer description in architecture 2026-05-19 02:07:53 +08:00
requirements.txt fix: add textual to requirements.txt 2026-04-23 00:09:00 +08:00
REVIEW.md docs: update REVIEW and coverage ledger 2026-06-19 15:20:15 +08:00

PaperForge banner

PaperForge

Version Python License

简体中文 · English

铸知识为器,启洞见之明。 — Forge Knowledge, Empower Insight.

PaperForge brings your Zotero library into Obsidian. Sync papers, run OCR, extract figures, and do AI-assisted deep reading — all inside a single vault.


0. What PaperForge Is

PaperForge is not just an Obsidian plugin. It has two parts:

Part What Does Where
Obsidian Plugin main.js + manifest.json + styles.css Dashboard, buttons, settings UI .obsidian/plugins/paperforge/ in your vault
Python Package paperforge Sync, OCR, Doctor, repair Your system Python (pip install)

The plugin is the interface. The Python package is the engine. Every button you click in the plugin actually runs a Python command behind the scenes.

After installing the plugin, you MUST verify that the Python package is also installed and version-matched.


1. Install the Obsidian Plugin

  1. Install BRAT from the Obsidian community plugin browser
  2. Open BRAT settings → Add Beta Plugin
  3. Enter: https://github.com/LLLin000/PaperForge
  4. BRAT downloads the latest main.js, manifest.json, and styles.css and installs them
  5. Settings → Community Plugins → enable PaperForge

BRAT auto-detects GitHub Release updates. No manual downloads needed.

Option B: Manual Download

  1. Go to Releases
  2. Download the three files: main.js, manifest.json, styles.css
  3. Create .obsidian/plugins/paperforge/ in your vault
  4. Put the three files there
  5. Restart Obsidian → Settings → Community Plugins → enable PaperForge

Manual install does not auto-update. You'll need to re-download for each new version.


2. Install the Python Package

After enabling the plugin, open the PaperForge settings tab. You'll see a Runtime Status section:

Plugin v1.5.0 → Python Package v1.5.0 ✓ Matched
  • If it says "Not installed" → click Open Wizard to re-run the setup process
  • If it says "Mismatch" → the Python package auto-updates when the plugin updates. If it didn't succeed, click Update Runtime to manually trigger

3. Quickstart

# 1. Export from Zotero (Better BibTeX JSON, Keep updated) to exports/
# 2. Sync
paperforge sync

# 3. Mark a paper for OCR in its frontmatter: do_ocr: true
# 4. Run OCR
paperforge ocr

# 5. Mark for deep reading: analyze: true
# 6. In your Agent chat:
/pf-deep <zotero_key>

Documentation

If you want to Read
Full tutorial, from install to deep read Getting Started
Troubleshooting Troubleshooting
Command reference Commands
How to update Update Guide
Architecture / Maintenance / Release Architecture
AI Agent collaboration AGENTS.md

License

CC BY-NC-SA 4.0. Non-commercial use only.

Acknowledgments

Built on PaddleOCR, Obsidian, Better BibTeX for Zotero, and other great open-source projects.