diff options
| author | ale <ale@incal.net> | 2019-01-19 14:57:40 +0000 |
|---|---|---|
| committer | ale <ale@incal.net> | 2019-01-19 14:57:40 +0000 |
| commit | cce28f44e7ad88900e6c53394a8e496f2955b784 (patch) | |
| tree | 5a8955c9254c095dd37956def96161342fd71a9d /cmd/crawl/crawl.go | |
| parent | c5ec7eb826bfd08aa6e8dd880efa15930f78ba19 (diff) | |
| download | crawl-cce28f44e7ad88900e6c53394a8e496f2955b784.tar.gz crawl-cce28f44e7ad88900e6c53394a8e496f2955b784.zip | |
Replace URLInfo with a simple URL presence check
The whole URLInfo structure, while neat, is unused except for the
purpose of verifying if we have already seen a specific URL.
The presence check is also now limited to Enqueue().
Diffstat (limited to 'cmd/crawl/crawl.go')
0 files changed, 0 insertions, 0 deletions