[Solved] How to web crawl some sites [closed]

If you want to create your own web crawler in Java you may want to look at this

You could also take a look at jSpider and jsoup.

Edit : This could work too : crawler4j