| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 2014-12-20 | make Scope checking more modular | ale | |
| 2014-12-20 | relax the CSS url() regexp | ale | |
| 2014-12-20 | move link extraction to a common location | ale | |
| 2014-12-20 | move the WARC code into its own package | ale | |
| Now generates well-formed, indexable WARC files. | |||
| 2014-12-19 | initial commit | ale | |
 |
index : crawl | |
| A simple recursive web crawler which stores content in the WARC/1.0 format | Jordan |
| aboutsummaryrefslogtreecommitdiff |