In plain words
Legal rules often sit inside sections and refer to other sections. Cutting a law into equal-sized text pieces can separate a rule from that context, making it harder for a search system to find the right passage.
The paper introduces StrucChunk, which keeps sections together when possible and adds their place in the law and summaries of referenced sections. On 501 queries about India’s Criminal Procedure Code, it found a relevant section in the first five search results for a larger share of queries than ordinary splitting did. The study tested retrieval, not the correctness of final answers.
The research
When a legal search system retrieves the wrong or incomplete provision, a later answer generator has less useful material to work with. The paper asks whether search can do better when its text chunks preserve where each provision belongs and include context from provisions it cites.
StrucChunk keeps legal sections and their context together in searchable chunks, then tests whether this improves retrieval across legal corpora.
The authors compare StrucChunk with recursive splitting on 501 queries about India’s Criminal Procedure Code. Both use the same hybrid search, combining keyword and semantic rankings.
Recall@5, the share of queries with a relevant section in the first five results, rises from 0.557 to 0.804 with StrucChunk.
A separate four-way comparison finds that changing the chunks accounts for 88% of the total gain from recursive chunks with dense search to StrucChunk with hybrid search.
This supports a role for section structure in the CrPC result, while a Thai legal test shows that StrucChunk does not improve on a hierarchy-aware method overall.
These evaluations measure retrieval of relevant legal sections, not whether a system’s final legal answers are correct. Results concern the structured documents and query sets tested; they do not establish performance on unstructured legal documents.
Analysis
Deep
- Original paper authors
- Surya Deep Singh, Ashutosh Tripathi, Gaurav Deep Singh
- Submitted to arXiv
- License
- CC0