Web-Crawler

A recursive web crawler that can perform focused as well as non-focused search.

This particular Web Crawler is hardcoded to work on wiki links. We can generalize the urls and change the code to be specific to a domain.