# Crawl, SEO & site checks

Inspect the public responses that crawlers and sharing services can read.

Canonical: https://tamperbox.dev/categories/web

Updated: 2026-10-29

Reviewed: 2026-10-26

Inspect the public responses that crawlers and sharing services can read. Diagnose broken targets, robots rules, sitemaps and share metadata before making assumptions about indexing. A valid file or a passing preview cannot guarantee rankings or AI citations.

## Choose a check

Start with Website Down Checker when a URL fails to answer. Use Broken Link Checker on a page, Robots.txt & Sitemap Checker for discovery rules, and Open Graph Preview for share metadata. Keep advertising authorization in ads.txt and optional AI reading links in llms.txt separate from crawler permissions.

## Tools in this collection

- [Website Down Checker](https://tamperbox.dev/website-down-checker): **Can't open a site? See whether our server can reach it.**

  Check whether a site is down for everyone or just you, and where a failure happened.
- [Broken Link Checker](https://tamperbox.dev/broken-link-checker): **Catch dead links and missing page resources before your visitors do.**

  Find broken links, images and scripts on a page, with where each one sits.
- [Open Graph Preview](https://tamperbox.dev/open-graph-preview): **Make sure a shared link shows the title and image you intended.**

  Preview a link as social, chat and search cards, and check its Open Graph tags.
- [Robots.txt & Sitemap Checker](https://tamperbox.dev/robots-txt-checker): **Check whether your crawler rules block pages you want discovered.**

  Validate robots.txt and sitemaps, test URLs, and see which AI crawlers are blocked.
- [Ads.txt & App-Ads.txt Checker](https://tamperbox.dev/ads-txt-checker): **Check the published list of who is allowed to sell your ad space.**

  Validate ads.txt or app-ads.txt and check each seller against sellers.json.
- [llms.txt Checker & Generator](https://tamperbox.dev/llms-txt): **Give AI tools a starting guide to your site's useful pages.**

  Check a site's llms.txt, see what an AI agent reads, or draft one from its pages.

## Continue exploring

[API & HTTP tools](https://tamperbox.dev/categories/api) · [Email authentication tools](https://tamperbox.dev/categories/email) · [Domains, registration & hosting tools](https://tamperbox.dev/categories/domains) · [DNS tools](https://tamperbox.dev/categories/dns) · [Network & IP tools](https://tamperbox.dev/categories/network) · [Web security & TLS tools](https://tamperbox.dev/categories/security) · [Data format tools](https://tamperbox.dev/categories/data) · [Text & test data tools](https://tamperbox.dev/categories/text-testdata) · [Localization tools](https://tamperbox.dev/categories/localization) · [UI testing tools](https://tamperbox.dev/categories/ui-testing)