From ecc3c05b8ef4b19fdf4af0372dc59ea1ad9fea68 Mon Sep 17 00:00:00 2001 From: Jordan Date: Fri, 11 Feb 2022 03:49:27 +0000 Subject: jordan.im: add crawl repo link/desc --- jordan.im/index.7 | 2 ++ 1 file changed, 2 insertions(+) diff --git a/jordan.im/index.7 b/jordan.im/index.7 index da87ebe..9398fd3 100644 --- a/jordan.im/index.7 +++ b/jordan.im/index.7 @@ -26,6 +26,8 @@ Research literature archival and categorization web service Discord self-bot which caches and archives URLs at the Internet Archive .It Lk https://git.jordan.im/roka/ roka Listen to audiobooks with podcast apps via RSS +.It Lk https://git.jordan.im/crawl/ crawl +A simple recursive web crawler which stores content in WARC/1.0 .It Lk https://git.jordan.im/allium/ allium Tor relay metrics and statistics rendered from a single API request .It Lk https://git.jordan.im/ft-bypass/ ft-bypass -- cgit v1.2.3-54-g00ecf