Why it matters
llms-full.txt puts the text of a site's important pages into one Markdown file, so an AI assistant or a developer's tool can read the lot in one go. Copying pages by hand drags in menus, cookie notices, footers and the same promo paragraph on every page, which wastes the reader's context window and buries the content.
This builder finds each page's main content the way reader modes do (the main or article element, or the block with the most text and fewest links), converts it to clean Markdown with absolute links, then compares pages and removes paragraphs repeated on most of them. You get the full file, an llms.txt index that points to it, and a count of what was kept on each page.
How it works
- InputPage HTML, pasted or fetched
- In your browserMain content kept, menus and repeats dropped
- OutputOne Markdown file with token counts
Where it fits in a designer's workflow
- Plan
- Design
- Build
- Test
- Launch
By the numbers
Show the numbers as a table
| Page | Main content from | Words kept | Words left out |
|---|---|---|---|
| Hartley Oak: solid oak furniture made in Leeds | <main> | 48 | 26 |
| How to care for an oak table | text density | 80 | 38 |
| Delivery and returns | <article> | 40 | 40 |
How to use it
- Paste each page's HTML after a '=== address' line, add .html files, or fetch up to 25 pages.
- Set the site name and summary.
- Check the words kept for each page; a page with almost none is probably built by JavaScript.
- Download llms-full.txt and llms.txt and put both at your site's root.
FAQ
Why does a page have almost no words?
Its content is built by JavaScript after the page loads, so the HTML has little text. Paste the rendered HTML from your browser's developer tools instead.
What counts as a repeated block?
A paragraph or list that appears in at least 60% of the pages you add (and at least two). Headings are always kept.
How big should llms-full.txt be?
There's no fixed limit, but smaller is more useful. Include the pages that explain what you do, not every blog post.
Are my pages uploaded?
Pasted HTML and files stay on your device. Pages you fetch are read once by leej.uk's fetcher, which keeps no content.