Abstract
A system and method for converting a document image into an extraction-compliant data structure is disclosed. The system and method comprise receiving an image of a page of a document. An intermediate layout data structure that encodes text content and tabular layout information is generated. Errors and inaccuracies in the intermediate layout data structure are repaired using a vision language model and the image as a visual reference to generate a corrected intermediate layout data structure. Information encoded in the corrected intermediate layout data structure may be extracted by queries to a downstream large language model that performs information extraction.
Full Text
What is claimed is:
A system and method for converting a document image into an extraction-compliant data structure is disclosed. The system and method comprise receiving an image of a page of a document. An intermediate layout data structure that encodes text content and tabular layout information is generated. Errors and inaccuracies in the intermediate layout data structure are repaired using a vision language model and the image as a visual reference to generate a corrected intermediate layout data structure. Information encoded in the corrected intermediate layout data structure may be extracted by queries to a downstream large language model that performs information extraction.
Timeline
Filed
04/17/2026Published
07/30/2026Granted
Not AvailableIPC Codes(3)
G06F 40/177:of tables; using ruled lines
G06F 40/143:Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
G06V 30/412:Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables