SEO glossary
What is a 404 Error?
Learn what a 404 Not Found error means, when it is the correct SEO response, how Google removes 404 URLs from search results, and how to fix broken links versus intentional retirements.
Definition
A 404 error is an HTTP client error status code indicating the server could not find a resource at the requested URL—signaling to crawlers that the page does not exist without confirming permanent deletion.
404 Error: the honest "this URL has no page" signal
A 404 Not Found response means the server processed the request but found no matching resource at that path. For SEO, 404 is the correct status when content never existed, was removed without a successor, or URLs are mistyped in links—not when content moved (use 301 Redirect) or was permanently deleted with certainty (410 Gone).
404 is visible to users as "page not found" and to crawlers as a crawl error on fetch attempts. It is not a failure of the server itself—that distinction belongs to 500 Error family codes.
404 response example
GET /products/discontinued-sku-9912 HTTP/1.1
Host: shop.example.com
HTTP/1.1 404 Not Found
Content-Type: text/html; charset=utf-8
Content-Length: 3842
<!DOCTYPE html>
<html>
<head><title>Page not found</title></head>
<body><h1>We couldn't find that product</h1></body>
</html>
The HTML body is optional for machines—the status code carries the semantic signal. Custom 404 pages improve UX without changing indexing outcome.
404 in the indexing lifecycle
Previously indexed URL → Crawl → 404 → Gradual deindexing
Never existed URL → Discovery → Crawl → 404 → Not indexed
Google may recrawl known 404s for months—especially URLs with strong external links—hoping content returns. Persistent 404 eventually removes the URL from results.
| History | Typical outcome |
|---|---|
| Was indexed, now 404 | Drops from index over time |
| New broken internal link | Wastes crawl budget, no index gain |
| External backlinks to 404 | Lost referral traffic; equity decays |
| Sitemap lists 404 URL | Crawl error noise; fix sitemap |
404 vs soft 404 vs 410
| Type | Status | Body | SEO problem |
|---|---|---|---|
| 404 Error | 404 | Error or custom 404 page | Correct when gone |
| Soft 404 | 200 | "Not found" thin page | Misleading success |
| 410 Gone | 410 | Optional | Permanent removal |
Returning 200 OK with "product not found" text forces crawlers to classify soft 404—slower to diagnose than honest 404.
When 404 is the right answer
Typos and never-valid URLs
/bloog/post-name never existed. 404 is accurate; fix the internal link source.
Retired content with no substitute
A discontinued press release with no thematic replacement should 404 or 410 Gone—not redirect to homepage.
Invalid filter combinations
/category/shoes?color=ultraviolet where no products match—return 404 or noindex thin result templates; avoid infinite discovered URLs that all 404.
Authentication-free marketing site
Public SEO URLs should not 404 for bots while returning 200 for logged-in users—creates inconsistent crawl signals.
When 404 is wrong
| Situation | Correct action |
|---|---|
| Content moved permanently | 301 Redirect or 308 Redirect |
| Content definitely deleted forever | 410 Gone (optional but clearer) |
| Temporary outage | 503 Service Unavailable with Retry-After |
| Maintenance page hours | 503, not 404 |
SEO impact of 404 errors
Crawl budget
Thousands of internal links to 404 URLs queue useless fetches. Googlebot spends cycles on dead ends instead of new inventory—especially painful on large e-commerce faceted navigation.
Link equity
External sites linking to your 404 leave equity stranded unless you reclaim with redirects to relevant live URLs. Monitor backlink tools for high-value 404 targets.
User experience and CTR
Indexed URLs that flip to 404 harm brand trust when users click from SERPs. Faster honest 404 or redirect reduces stale SERP listings after recrawl.
Not a ranking penalty
404 itself is not a penalty. Patterns of broken internal linking signal poor site hygiene—indirect effects through crawl efficiency and UX.
Fixing 404 errors strategically
Priority matrix
- 404 + revenue keywords + backlinks — redirect or restore
- 404 from main navigation — fix links immediately
- 404 from sitemaps — remove or replace URLs
- Long-tail legacy 404 — fix if cheap; ignore if genuinely gone
Redirect vs restore vs 404
Moved article → 301 to new slug
Merged products → 301 to category or successor SKU
Typo in CMS link → fix link to live URL
Dead campaign → 404 or 410
Avoid redirect chains through multiple 404 recovery attempts.
Custom 404 page best practices
<!DOCTYPE html>
<html lang="en">
<head>
<title>Page not found | Example Store</title>
<meta name="robots" content="noindex">
</head>
<body>
<h1>Page not found</h1>
<p>Try search or popular categories:</p>
<nav>...</nav>
</body>
</html>
noindex on the 404 template itself is optional—Google understands 404 status. Focus on helpful navigation, consistent branding, and server returning 404—not 200—for missing paths.
Detecting 404 errors
Search Console
Page indexing and crawl reports list not found URLs. Export and join with internal link reports.
Server logs
status=404 AND user_agent~Googlebot
Spikes after deploys indicate routing regressions. Site crawlers flag 404 from internal links—more actionable than external-only 404 lists.
Example: post-migration orphan URLs
news.example migrated to example.com/news with 301 Redirect on top paths but missed /archive/2018/* patterns.
Result:
- 12,400 URLs returned 404
- Sitemap still listed old host paths for six weeks
- Crawl errors climbed; new articles indexed slower
Fix: Regex 301 rules, sitemap regeneration, internal link rewrite in CMS. 404 rate on Googlebot fell 89%; indexation rate on news section recovered within three crawl cycles.
How Crawlox helps with 404 errors
Crawlox maps 404 URLs across authorized crawls, traces which internal links still point at them, and clusters 404s by template or path pattern. Compare crawl runs after releases to catch new 404 regressions, prioritize fixes by inbound link count, and verify that retired URLs return honest 404—not misleading 200 OK soft 404s or homepage redirects that obscure the real problem.
Related terms
Frequently asked questions
Do 404 errors hurt my entire site's rankings?
A few 404s are normal. Mass 404s from broken internal links waste crawl budget and lose equity from external links—but they are not a sitewide penalty unless they reflect severe quality or availability problems.
Should I redirect all 404 pages to the homepage?
No. Homepage redirects for unrelated missing URLs create soft relevance problems. Redirect only to closely related content or return a helpful 404 page.
How fast does Google drop a 404 from search results?
After repeated crawls confirming 404, URLs typically fade from the index over weeks. There is no fixed timer—importance and crawl frequency influence speed.
Is a custom 404 page good for SEO?
A useful 404 with navigation and search helps users and may reduce bounce. It does not make the URL indexable—the status code still says not found.
404 vs 410—which should I use?
404 when absence might be temporary or ambiguous. 410 when you deliberately removed content and want a clearer gone signal.
References
Explore authoritative guidance and frameworks related to 404 error.
Explore every glossary definition
Return to the glossary to search by term, alias, starting letter, or category.