booksniff, and one place for the parts every tool shares

2026-10-22 18:57:14 +00:00 · 2026-09-19 12:40:20 -04:00
parent 36afe3350b
commit 1071f0bed3
32 changed files with 1426 additions and 237 deletions
@@ -53,6 +53,7 @@ $ for f in *.pdf; do pdftriage --quiet "$f" && ocrmypdf "$f" "ocr/$f"; done

 | | |
 |---|---|
+| `booksniff` | What a file actually is, whatever its name claims |
 | `mdscrub` | Converted markdown in, clean markdown out: residual HTML, control characters, headings, page markers |
 | `chunkmd` | Markdown into passages that carry their page, chapter and role |
 | `pdftriage` | Whether a PDF's text layer is healthy, garbled, sparse, permuted, or absent — and so whether OCR is worth its cost |