Start a project

Tool 41 of 244 · Indexing

Near-Duplicate Content Checker

Finds near-duplicate pages within your own site using shingles and SimHash on pasted pages or crawl text.

Near-Duplicate Content Checker

Pages

Near-duplicates

Page APage BSimilarityShared shingles
Pairs CSV

01

What it does

Finds near-duplicate pages within your own site using shingles and SimHash on pasted pages or crawl text.

  • Boilerplate removal (shared extractor), 5-word shingles, MinHash LSH for candidate pairs then exact Jaccard; clusters via union-find; per…
  • Not a web plagiarism checker (no network), stated clearly

02

Private by design

Everything happens in your browser. Nothing you type, paste or upload is sent anywhere, and it keeps working offline once the page has loaded.

03

What you get

Similar page pairs and a CSV, with a Copy and a Download button on every result.

  • Near-duplicate
  • SimHash
  • SEO

Why it matters

Finds near-duplicate pages within your own site using shingles and SimHash on pasted pages or crawl text.

Boilerplate removal (shared extractor), 5-word shingles, MinHash LSH for candidate pairs then exact Jaccard; clusters via union-find; per-pair diff highlighting. Not a web plagiarism checker (no network), stated clearly. Everything runs in your browser; nothing you paste is sent unless you press Fetch.

How to use it

  1. Paste or type the input the tool asks for.
  2. Read the summary and the table or preview.
  3. Adjust the options if you need a different result.
  4. Copy or download the output. Nothing leaves this page.

FAQ

Is my input uploaded?

No. The work runs in your browser and nothing you type, paste or upload is sent anywhere.

Will this change my site for me?

No. It shows results and, where it writes rules or files, you copy them and apply them yourself.

Can I rely on this as official guidance?

It follows public documentation and well-known algorithms, and tells you where it is a subset or a simulation. Confirm critical changes in the official tool or a staging environment.

Work with me

Want a site that gets these right?

I build fast, accessible websites and web apps that pass these checks from day one. Tell me about your project and I'll reply personally with honest next steps.

All developer tools · Back to leej.uk