The internet seems to be a vast and complex terrain. For humans, sometimes feels like a daunting task to browse its endless sites. But what about robots? Do they have the capacity to effectively navigate this digital universe? Certainly, robots are increasingly being deployed for web exploration. Driven with sophisticated algorithms, they can pr