What is Duplicate content?
Duplicate content is text that appears in more than one place, either on several pages of your own site or on other websites, in the same or nearly the same form.
Duplicates often happen by accident. Product filters, print versions, tracking parameters, HTTP and HTTPS versions, or copying the same city page and only swapping the location name all create several URLs with almost the same text.
Google does not normally penalise duplicate content. Instead, it picks one version to show and filters the rest, which means the page you want to rank may not be the one Google chooses.
Common causes of duplicate content
Most duplicate content is not copied from anyone. It is created by the way a site builds URLs, so the same page can be reached in several ways.
| Cause | Example | Usual fix |
|---|---|---|
| HTTP vs HTTPS, www vs non www | http://site.com and https://www.site.com show the same page | 301 redirect to one version |
| Trailing slashes and case | /services and /services/ | Pick one format, redirect the other |
| URL parameters | /shoes?color=red&sort=price | Canonical to the clean URL, limit crawlable filters |
| Printer and AMP versions | /page/print | Canonical or noindex the copy |
| Session IDs and tracking codes | ?sessionid=123, ?utm_source= | Canonical tag, strip parameters in links |
| Copied manufacturer text | Same product description on many stores | Write unique descriptions |
| Location pages with swapped names | Same copy, only the city changes | Add real local content or merge pages |
Penalty or filter: how Google treats duplicates
Google does not issue a penalty for ordinary duplicate content. Instead it picks one version to show and filters the rest, which means the version it picks may not be the one you want, and links can be split across copies.
The exception is deliberate copying to manipulate rankings, such as scraped content or doorway pages built only to rank for slight keyword variations. That falls under Google's spam policies and can lead to manual actions.
How to find duplicate content
- 1Open the Page indexing report in Google Search Console and look for "Duplicate without user selected canonical" and "Duplicate, Google chose different canonical than user".
- 2Crawl the site with a tool such as Screaming Frog or Sitebulb and filter for duplicate titles, descriptions and near duplicate body content.
- 3Search Google for a unique sentence from your page in quotes to see if other sites have copied it.
- 4Check product and location templates, where duplication usually hides at scale.
- 5List each duplicate group and decide which URL should be the main version.
Canonical, redirect or noindex: which fix to use
Use a 301 redirect
When the duplicate URL does not need to exist for users, such as old HTTP or www versions. Redirects pass signals to the main page.
Use a canonical tag
When users need both URLs, such as filtered product lists, but only one should rank.
Use noindex
For pages that should stay live for users but never appear in search, such as internal search results or thin tag pages.
Rewrite or merge
When two pages target the same topic with similar text. Combine them into one stronger page and redirect the other.
Duplicate content prevention
- 1Set canonical tags on every indexable page.
- 2Redirect HTTP and non www versions.
- 3Control filter and sort parameters.
- 4Write unique product and category copy.
- 5Ask syndication partners to add canonicals.
Why Duplicate content matters for SEO
When several pages compete with the same content, ranking signals such as links are split between them. That weakens all versions and can stop any of them reaching page one.
Thin duplicate pages also waste crawl budget and lower the overall quality impression of a site, which matters more on large ecommerce and multi location websites.
How Duplicate content works
Duplicate content shows up in a few common forms.
Internal duplicates
The same text appears on several URLs of your own site, often from parameters, pagination, filters or near identical service and city pages.
External duplicates
Your content appears on other sites, such as manufacturer product descriptions used by every retailer or articles that were scraped or syndicated.
Near duplicates
Pages that share most of their text with small changes, like swapping a suburb name. Google often treats these as the same page.
A cleaning company creates 40 suburb pages by copying one template and changing only the suburb name. Google indexes three of them and ignores the rest. Rewriting each page with local details, reviews from that area and unique photos gets most of them indexed and ranking.
Duplicate content checklist
- ✓Use canonical tags to point duplicates to the main version
- ✓Redirect old or duplicate URLs with 301 redirects
- ✓Write unique descriptions for products and locations
- ✓Handle URL parameters and filters consistently
- ✓Use one preferred domain version (HTTPS, with or without www)
- ✓Check Search Console for pages marked as duplicates
Common Duplicate content mistakes
Swapping only the city name
Location pages with the same copy are treated as duplicates and often filtered out.
Using manufacturer descriptions
Every retailer selling the product has the same text, so none stand out.
Blocking duplicates in robots.txt
Blocking stops crawling but not indexing, and hides the canonical signal.
Forgetting HTTP and www versions
Several versions of the homepage split links and confuse Google.
Related SEO terms
Duplicate content FAQs
Does Google penalise duplicate content?
+
Not usually. It filters duplicates and shows one version. Penalties only apply to deliberate copying meant to manipulate rankings.
How do I find duplicate content?
+
Use Search Console page indexing reports, a site crawler such as Screaming Frog, or a plagiarism checker for external copies.
Should I noindex duplicate pages?
+
Sometimes. For true duplicates, canonical tags or redirects are usually better because they pass signals to the main page.
Does duplicate content affect AI search?
+
AI tools prefer original sources, so unique content is more likely to be cited.
How much duplicate content is acceptable?
+
Short repeated parts like footers and legal text are fine. Problems arise when the main body of pages is the same.
Is syndicated content duplicate content?
+
Yes, but it can be safe if the copy links back to the original and ideally uses a canonical tag.
Do translated pages count as duplicates?
+
No. Proper translations with hreflang tags are treated as separate language versions.
Can quoting other sites cause duplicate content?
+
Short, attributed quotes are fine. Copying whole articles is not.