Robots.txt checker

Additional page content: Editable from the admin panel -> languages -> choose or create language -> translate app page.

Similar tools

Check the status code returned by a website for a generated missing page.

Checks if a webpage is set to noindex, preventing it from appearing in search engines.

Get all the HTTP headers that an URL returns for a typical GET request.

Find A, AAAA, CNAME, MX, NS, TXT, SOA DNS records of a host.

Get approximate IP details.

Check whether a website is using the new HTTP/2 protocol or not.

Check the total size of a web page, including all resources, for performance analysis.

Get all the HTTP headers that an URL returns for a typical GET request.

Get all possible details about a domain name.