Simple command line web spider that crawls a provided url and reports any HTTP errors (404, 500, etc). Crawling is limited to the host of the provided start url. Can be used to smoke-test a website. |
Simple command line web spider that crawls a provided url and reports any HTTP errors (404, 500, etc). Crawling is limited to the host of the provided start url. Can be used to smoke-test a website. |