Introduction

Web crawler, sometimes called robots and spiders. They continuously browse the web and analyzing web pages.