diff options
-rw-r--r-- | README.md | 9 |
1 files changed, 4 insertions, 5 deletions
@@ -1,11 +1,10 @@ A very simple crawler ===================== -This is a fork of [crawl](https://git.autistici.org/ale/crawl) with -changes which make crawl more amenable to serve as a drop-in -replacement for [wpull](https://github.com/ArchiveTeam/wpull)/ -[grab-site](https://github.com/ArchiveTeam/grab-site). Notable changes -include: +This is a fork of [crawl](https://git.autistici.org/ale/crawl) with changes +which make crawl more amenable to serve as a drop-in replacement for +[wpull](https://github.com/ArchiveTeam/wpull)/[grab-site](https://github.com/ArchiveTeam/grab-site). +Notable changes include: * --bind, support making outbound requests from a particular interface * --resume, directory containing the crawl state to continue from |