There’s a fun — fun — thing you can do if you own and operate a website where you do something, like I said, fun with your 404 page — the page users reach when a server can’t find what was requested, ...

In a Webmaster Central Hangout, Google’s John Mueller discussed the reasons why Google crawls non-existent pages and what that meant for your crawl budget. Web publishers would like to see Google ...