Description

This plugin does a search in archive.org and parses the results. It then uses the results to find new URLs in the target site. This plugin is a time machine !

Plugin type

Crawl

Options

Name Type Default Value Description Help
max_depth integer 3 Maximum recursion depth for spidering process The plugin will spider the archive.org site related to the target site with the maximum depth specified in this parameter.

Source

For more information about this plugin and the associated tests, there’s always the source code to understand exactly what’s under the hood:
github-logoPlugin source code
Unittest source code

Dependencies

This plugin has no dependencies.