Support for Web Crawler and Scraper for Files and Links


XIO supports this item


Popular questions for this item

What file types can this scrape?

Any that is well known. This includes mp3, zip, rar, wav, doc, docx, pdf, txt, jpg, png, gif and hundreds of others.

What do I need to be able to run this application?

You only need to have .NET framework 4.0 installed.

Some links that I see on a website are not being scraped. Why?

The scraper has limited support for AJAX. If the website you are trying to scrape is mostly AJAX enabled, it might not be able to scan it. You could increase the timeout value to allow the crawler to pick up any additional AJAX requests.

I know there are files on the site, but they aren’t being downloaded. Can I fix this?

If the files are large, the requests might be timing out. Set the timeout value to a larger number.

Show more

Contact the author

This author provides limited support for this item through email contact form.

Item support includes:

  • Availability of the author to answer questions
  • Answering technical questions about item’s features
  • Assistance with reported bugs and issues
  • Help with included 3rd party assets

However, item support does not include:

  • Customization services
  • Installation services

View the item support policy