.Google.com's Gary Illyes shows Googlebot picks up web links rather than "complying with" all of them, contradicting main records.Googlebot gathers web links rather than following them in real-time.Gary Illyes shared this info in Google.com's 'Browse Off The Record' podcast.Google's paperwork opposes the actual crawler actions.