I wish to determine if you will find any delegate solutions for any crawler which will parse just the links and pages form confirmed website, and can output:

1.The hyperlink tree 2.The web pages (where necessary)


Its not necessary any particular framework to do this task. What languages are you aware? Knowing Java you should use HttpClient or HttpUnit libs that will help you with moving tasks.

If you're python user, there's great framework known as Scrappy. You can examine it.