chunkmd: page and chapter aware chunking, roles, footnote flag

parity/golden/chunkmd/prose.small.ndjson

@@ -0,0 +1,13 @@
+{"v":1,"idx":0,"text":"The argument of this chapter is that the obligation ran both ways, and that\ncontemporaries said so plainly whenever they were asked. A lord who could not\nprotect was a lord who could not command, and the men who owed him service\nsaid as much in language that has survived in the court rolls.","tokens":63,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":1,"text":"The argument of this chapter is that the obligation ran both ways, and that\ncontemporaries said so plainly whenever they were asked. A lord who could not\nprotect was a lord who could not command, and the men who owed him service\nsaid as much in language that has survived in the court rolls.\n\nWhat the rolls do not say, and what has to be inferred, is how often the\nobligation was actually tested. A","tokens":90,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":2,"text":" tenant who withheld service in a year of\nfamine was not making a constitutional argument; he was hungry. The clerk who\nrecorded the withholding had no vocabulary for the difference, and so the\nrecord flattens the two into one offence with one penalty.","tokens":53,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":3,"text":"What the rolls do not say, and what has to be inferred, is how often the\nobligation was actually tested. A tenant who withheld service in a year of\nfamine was not making a constitutional argument; he was hungry. The clerk who\nrecorded the withholding had no vocabulary for the difference, and so the\nrecord flattens the two into one offence with one penalty. This flattening is the central difficulty of the sources","tokens":90,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":4,"text":". It is not that they\nlie. It is that the categories they were written in were designed to produce a\nnumber at the bottom of a column, and a number at the bottom of a column\ncannot distinguish a rebellion from a bad harvest. Everything that follows\ndepends on reading around that limitation rather than through it.","tokens":66,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":5,"text":"This flattening is the central difficulty of the sources. It is not that they\nlie. It is that the categories they were written in were designed to produce a\nnumber at the bottom of a column, and a number at the bottom of a column\ncannot distinguish a rebellion from a bad harvest. Everything that follows\ndepends on reading around that limitation rather than through it. Three approaches have been tried.","tokens":82,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":6,"text":"Three approaches have been tried. The first counts the offences and treats the\ncount as a proxy for discontent, which assumes the clerk's attention was\nconstant across years when we know it was not.","tokens":40,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":7,"text":"The first counts the offences and treats the\ncount as a proxy for discontent, which assumes the clerk's attention was\nconstant across years when we know it was not. The second reads the language\nof the entries for signs of unusual trouble, which works where a clerk was\ntalkative and fails entirely where he was not.","tokens":66,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":8,"text":"The second reads the language\nof the entries for signs of unusual trouble, which works where a clerk was\ntalkative and fails entirely where he was not. The third, adopted here,\ncompares the same manor across decades and treats changes in what was recorded\nas evidence about the recorder as much as about the recorded.","tokens":66,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":9,"text":"The third, adopted here,\ncompares the same manor across decades and treats changes in what was recorded\nas evidence about the recorder as much as about the recorded. None of the three is satisfactory, and the third has the particular weakness\nthat it needs a long run of documents from a single place.","tokens":62,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":10,"text":"None of the three is satisfactory, and the third has the particular weakness\nthat it needs a long run of documents from a single place. There are not many\nsuch runs.","tokens":36,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":11,"text":"There are not many\nsuch runs. The ones that exist are concentrated in the south and east, which\nis to say in exactly the regions where the argument is least likely to be\nsurprising.","tokens":41,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}
+{"v":1,"idx":12,"text":"The ones that exist are concentrated in the south and east, which\nis to say in exactly the regions where the argument is least likely to be\nsurprising.\n\nA reader who wants to know what happened in the north will find\nthis chapter unsatisfying, and the reason is that the documents do not exist,\nnot that the question is uninteresting.","tokens":72,"page":null,"chapter":null,"role":"body","start_time":null,"end_time":null,"flags":[]}