.Google.com's Gary Illyes uncovers Googlebot gathers web links as opposed to "following" all of them, negating formal paperwork.Googlebot collects web links rather than observing them in real-time.Gary Illyes shared this details in Google's 'Browse Off The Report' podcast.Google's information opposes the true spider behavior.