summaryrefslogtreecommitdiff
path: root/searx
diff options
context:
space:
mode:
authorMarkus Heiser <markus.heiser@darmarit.de>2023-09-22 10:57:11 +0200
committerMarkus Heiser <markus.heiser@darmarIT.de>2023-09-23 14:00:03 +0200
commit597c68b4aad0338b87e5d3443764d7866c86bd6d (patch)
tree4116abc7105cc2e5ad23d6afc633b9b6b7b59180 /searx
parent75c9de02d1cf573fea176a85866d2218913ff9a0 (diff)
downloadsearxng-597c68b4aad0338b87e5d3443764d7866c86bd6d.tar.gz
searxng-597c68b4aad0338b87e5d3443764d7866c86bd6d.zip
[doc] move dosc of botdetection from developer to admin section
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
Diffstat (limited to 'searx')
-rw-r--r--searx/botdetection/__init__.py17
1 files changed, 17 insertions, 0 deletions
diff --git a/searx/botdetection/__init__.py b/searx/botdetection/__init__.py
index fcd8e5630..74f6c4263 100644
--- a/searx/botdetection/__init__.py
+++ b/searx/botdetection/__init__.py
@@ -2,6 +2,23 @@
# lint: pylint
""".. _botdetection src:
+The :ref:`limiter <limiter src>` implements several methods to block bots:
+
+a. Analysis of the HTTP header in the request / can be easily bypassed.
+
+b. Block and pass lists in which IPs are listed / difficult to maintain, since
+ the IPs of bots are not all known and change over the time.
+
+c. Detection of bots based on the behavior of the requests and blocking and, if
+ necessary, unblocking of the IPs via a dynamically changeable IP block list.
+
+For dynamically changeable IP lists a Redis database is needed and for any kind
+of IP list the determination of the IP of the client is essential. The IP of
+the client is determined via the X-Forwarded-For_ HTTP header
+
+.. _X-Forwarded-For:
+ https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/X-Forwarded-For
+
X-Forwarded-For
===============