| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 2022-02-10 | gen-ignores, ignore_patterns: update to exclude unsupported Perl syntax, ↵ | Jordan | |
| backreferences | |||
| 2015-06-28 | add ignore list from ArchiveBot | ale | |
 |
index : crawl | |
| A simple recursive web crawler which stores content in the WARC/1.0 format | Jordan |
| aboutsummaryrefslogtreecommitdiff |
path: root/gen-ignores.py