Confirm crawlers can enter
Availability plus robots.txt tells you whether Googlebot and other bots are blocked at the door.
SEO insights
Review availability, robots, Open Graph, and trust signals on the homepage.
Crawlox SEO insights summarize the homepage signals that affect indexing and sharing: reachability, robots.txt, sitemap, social metadata, HTTPS certificates, HSTS, and authority context.
Availability
HTTP status, response time, and redirect chain for the public homepage.
Crawl access
robots.txt rules and sitemap presence so you know whether bots are invited in.
Social metadata
Title, description, canonical, Open Graph, and Twitter card fields in one block.
Trust and authority
Certificate validity, HSTS, security headers, and sample internal/external links.
What are SEO insights?
SEO insights are homepage indexing and sharing signals, grouped.
Page-level checks cover every URL. SEO insights zoom out to the homepage: can crawlers reach it, are they allowed in, does it publish Open Graph and Twitter tags, is HTTPS trustworthy, and does the origin show basic authority context. Crawlox stores those blocks on the dashboard for the selected domain.
Why it matters
Homepage failures cascade to the rest of the site.
If the homepage redirect chain is long, robots.txt is overly strict, or social tags are missing, every other URL inherits that friction. Insights give a fast origin-level read before you dive into hundreds of page rows.
Control social previews
Open Graph and Twitter tags decide how links look in Slack, LinkedIn, X, and many assistants.
Show a trustworthy origin
Valid certificates, HSTS, and security headers support user trust and modern browser behavior.
Support AI citations
Answer engines often start from the same public fetch path. A stable, well-tagged homepage is easier to retrieve.
How it works
Five insight blocks, refreshable from the dashboard.
01
Availability
Fetch the homepage and record status, timing, redirect hops, and errors.
02
Crawl access
Read robots.txt rules and sitemap references that govern bot behavior.
03
Social signals
Capture title, description, canonical, Open Graph, Twitter, and robots meta.
04
Trust
Review certificate validity, HSTS, and which security headers are present.
05
Authority context
Summarize internal/external link samples and verification TXT records when available.
Fields you can review
Enough homepage evidence to brief SEO and engineering.
Each block lists missing signals so the next change is specific.
Response time
A lightweight TTFB-style signal for homepage speed under this check.
Redirect chain
See hops from the requested host to the final HTTPS URL.
robots rules
Rule count and sample directives that allow or disallow crawlers.
Sitemap reference
Whether robots or crawl access points at a sitemap.
og:image and twitter:image
Confirm share images exist for the homepage.
Certificate and HSTS
Validity window and Strict-Transport-Security presence.
What teams do next
Fix origin-level gaps before scaling content.
Collapse redirects
Point http and www variants at one HTTPS canonical with a single hop.
Complete social tags
Add missing Open Graph and Twitter fields so shares look consistent.
Turn on HSTS
Once HTTPS is solid, enable HSTS so browsers stay on the secure origin.
FAQ
SEO insights questions.
Short answers for teams that want homepage indexing and sharing signals in one dashboard.
What SEO insights does Crawlox show?
Crawlox groups homepage availability, robots.txt and sitemap crawl access, social metadata including Open Graph and Twitter tags, HTTPS trust headers, and authority context such as sample links.
Is this the same as the Pages SEO score?
No. Pages scores every crawled URL. SEO insights focus on origin and homepage signals that affect the whole domain.
Can I refresh one insight block?
Yes. Availability, crawl access, social, trust, and authority blocks can be refreshed independently from the dashboard.
Does Crawlox edit robots.txt for me?
No. Crawlox reads and summarizes robots.txt. You still publish changes on your origin.
Why do Open Graph tags matter for SEO?
They do not replace title tags, but they control unfurls in social products and many chat tools. Missing images and descriptions waste the homepage as a sharing surface.
Who should use SEO insights?
SEO leads, marketing site owners, and engineers responsible for redirects, robots.txt, certificates, and social metadata.
Open insights
See if crawlers and shares start from a healthy homepage.
Add an authorized domain and review availability, robots, Open Graph, and trust signals before you scale page-level SEO work.