| Mode | Name | Size | |
|---|---|---|---|
| -rw-r--r-- | .travis.yml | 141 | logplain |
| -rw-r--r-- | LICENSE | 1293 | logplain |
| -rw-r--r-- | README.md | 381 | logplain |
| -rw-r--r-- | go.mod | 104 | logplain |
| -rw-r--r-- | parser.go | 17864 | logplain |
| -rw-r--r-- | selector.go | 14659 | logplain |
 |
index : crawl | |
| A simple recursive web crawler which stores content in the WARC/1.0 format | Jordan |
| aboutsummaryrefslogtreecommitdiff |