.Google.com's Gary Illyes discloses Googlebot gathers hyperlinks as opposed to "observing" all of them, contradicting formal paperwork.Googlebot collects links rather than observing all of them in real-time.Gary Illyes discussed this relevant information in Google's 'Look Off The File' podcast.Google's records negates the actual crawler behavior.