Start a project

Tool 37 of 244 · Indexing

URL Normalisation & Duplicate URL Finder

Normalises a URL list by your rules (case, slashes, parameters, tracking tags) and finds duplicates with redirect rules.

URL Normalisation & Duplicate URL Finder

URLs and rules

Normalised list

OriginalNormalisedDuplicate of
Redirect rules

01

What it does

Normalises a URL list by your rules (case, slashes, parameters, tracking tags) and finds duplicates with redirect rules.

  • Rule pipeline (RFC 3986 normalisation, host/www, slash policy, index.html, parameter allow/strip lists incl
  • Utm_*, gclid, fbclid, sort order); groups duplicates; emits canonical map CSV and redirect rules via redirect-generator's emitters
  • Shared normaliser used by sitemap-coverage-diff and crawl-comparison

02

Private by design

Everything happens in your browser. Nothing you type, paste or upload is sent anywhere, and it keeps working offline once the page has loaded.

03

What you get

A normalised list, duplicates and redirect rules, with a Copy and a Download button on every result.

  • URL
  • Canonical
  • Redirects

Why it matters

Normalises a URL list by your rules (case, slashes, parameters, tracking tags) and finds duplicates with redirect rules.

Rule pipeline (RFC 3986 normalisation, host/www, slash policy, index.html, parameter allow/strip lists incl. utm_*, gclid, fbclid, sort order); groups duplicates; emits canonical map CSV and redirect rules via redirect-generator's emitters. Everything runs in your browser; nothing you paste is sent unless you press Fetch.

How to use it

  1. Paste or type the input the tool asks for.
  2. Read the summary and the table or preview.
  3. Adjust the options if you need a different result.
  4. Copy or download the output. Nothing leaves this page.

FAQ

Is my input uploaded?

No. The work runs in your browser and nothing you type, paste or upload is sent anywhere.

Will this change my site for me?

No. It shows results and, where it writes rules or files, you copy them and apply them yourself.

Can I rely on this as official guidance?

It follows public documentation and well-known algorithms, and tells you where it is a subset or a simulation. Confirm critical changes in the official tool or a staging environment.

Work with me

Want a site that gets these right?

I build fast, accessible websites and web apps that pass these checks from day one. Tell me about your project and I'll reply personally with honest next steps.

All developer tools · Back to leej.uk