funkpower d31206dd0f idnorm: a prefix is ASCII and the text it is cut from is not ...

`10.1093/<zwsp>oso/<zwsp>` is exactly sixteen bytes, the length of
`https://doi.org/`, so testing that prefix against it sliced into the middle
of the third zero-width space and brought the process down. Found by running
citefind over the corpus: a real book prints its DOI that way, because the
typesetter marked where the line could break.

Both prefix tests — DOI and arXiv — now ask for the head rather than cutting
one, so a byte length that is not a character boundary is an answer of no
rather than a panic.

And an invisible character is not part of an identifier. Zero-width spaces
and joiners, the soft hyphen, a byte-order mark left at the front of a
fragment: text out of a PDF or an EPUB is full of them, none of them can be
seen, and a DOI carrying one does not resolve. They are dropped before
anything is read.

2026-09-20 14:11:13 -04:00

..

arxiv.rs

idnorm: a prefix is ASCII and the text it is cut from is not

2026-09-20 14:10:18 -04:00

doi.rs

idnorm: a prefix is ASCII and the text it is cut from is not

2026-09-20 14:10:18 -04:00

issn.rs

idnorm and bibfetch: an identifier read, and a register asked

2026-09-19 19:19:54 -04:00

lib.rs

idnorm: a prefix is ASCII and the text it is cut from is not

2026-09-20 14:11:13 -04:00

main.rs

idnorm and bibfetch: an identifier read, and a register asked

2026-09-19 19:19:54 -04:00