Run a focused crawl and turn the findings into work

Selecting the crawl area

Fast, Standard and Deep presets are the everyday controls. The advanced setup adds a URL cap, crawl depth, worker count, sitemap discovery, parameter removal, robots handling and redirect behavior, with your plan limits and a clear summary displayed before launch. Scheduled crawls run daily, weekly, or monthly depending on the plan, and each site remembers its last configuration.

The JavaScript rendering available from Pro opens each example page in a real browser and compares the raw HTML with the rendered result. This way, the check captures content that only exists after scripts are executed, which is doubly important: once for Google and once for AI crawlers that never run your JavaScript.

Understanding reporting

The crawl matches what it finds with what your sitemap claims and what Search Console analyses as indexed, then highlights the discrepancies: sitemap URLs redirecting, indexable pages missing from the sitemap, canonical chains, robots conflicts, and pages that were silently deleted. Verifying ownership with a meta tag or file is optional; The crawler always respects robots.txt on unverified sites and verification unlocks the conscious option to ignore robots.txt on your own property.

Work with over 40 audit and intelligence reports

Reports are on a common track with search, grouping and a pager and include indexability, redirects, duplicates, titles and metas, internal linking, structured evidence, social tags, hreflang, accessibility, security headers, resources, core web vitals, page changes and more. Explorer segment by page and folder structure; Using segments and custom problems, you can save your own filters as first-class exams.

Each table filters, sorts, paginates and exports: CSV with the correct encoding, an XLSX workbook per site scan, printable views and Copy for AI, which converts a report into a clean markdown that you can insert into any wizard. Diagrams and counts always indicate their extent and each number refers to the lines behind it.

From discovery to a verified repair

Each issue type has a simple language explanation, the affected URLs, and a transparent impact rating based on severity, scope, and recency. The ways out, in ascending order of automation: Assign it in the Repair Workspace with an owner, due date and acceptance criteria; Ask AI to provide a repair plan based on your crawl data. Obtain a copy-paste patch for titles, metas, robots.txt, canonicals, or security headers. or publish the change to edge CDN with a one-click restore. Tasks can be forwarded to Jira, ClickUp, Asana or Trello, with Slack and Teams Cards for the team.

The loop closes itself: at the next crawl, resolved issues are re-reviewed and marked as confirmed, the All Issues report shows new and resolved issues per type, and the changelog stores history for a customer to review.

Report to people

Report Builder creates a branded, printable report with your logo and name, including charts, in plain language. Protected guest links come with an expiration date, optional password, and one-click revocation so stakeholders can see a clean, live report without logging in. The weekly email to executives delivers health motions as well as a direct “Focus Now” action per location.