summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2023-11-03[translations] update from Weblatesearxng-bot
acdcdace8 - 2023-11-01 - Ivan Gabaldon <admin@inetol.net> 31a1602a9 - 2023-10-29 - return42 <markus.heiser@darmarit.de> a1d1070d3 - 2023-10-29 - return42 <markus.heiser@darmarit.de>
2023-11-01Revert "[fix] limit maximum page number of a search query to page 50." (#2979)Markus Heiser
This reverts commit 7e2e335dd1e06ea20496028abe58b3ad8b255662.
2023-11-01[mod] document server:public_instance & remove it out of the botdetectionMarkus Heiser
- the option server:public_instance lacks some documentation - the processing of this option belongs in the limiter and not in botdetection module Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01[mod] isolation of botdetection from the limiterMarkus Heiser
This patch was inspired by the discussion around PR-2882 [2]. The goals of this patch are: 1. Convert plugin searx.plugin.limiter to normal code [1] 2. isolation of botdetection from the limiter [2] 3. searx/{tools => botdetection}/config.py and drop searx.tools 4. in URL /config, 'limiter.enabled' is true only if the limiter is really enabled (Redis is available). This patch moves all the code that belongs to botdetection into namespace searx.botdetection and code that belongs to limiter is placed in namespace searx.limiter. Tthe limiter used to be a plugin at some point botdetection was added, it was not a plugin. The modularization of these two components was long overdue. With the clear modularization, the documentation could then also be organized according to the architecture. [1] https://github.com/searxng/searxng/pull/2882 [2] https://github.com/searxng/searxng/pull/2882#issuecomment-1741716891 To test: - check the app works without the limiter, check `/config` - check the app works with the limiter and with the token, check `/config` - make docs.live .. and read - http://0.0.0.0:8000/admin/searx.limiter.html - http://0.0.0.0:8000/src/searx.botdetection.html#botdetection Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-31Check `public_instance` in simple themesev
Fix #2975
2023-10-29[fix] limit maximum page number of a search query to page 50.Markus Heiser
To test this PR run a local instance and try to query page 51: http://127.0.0.1:8888/search?q=foo&pageno=51 A parameter exception will be raised: searx.exceptions.SearxParameterException: Invalid value "51" for parameter pageno And the client will receive a HTTP 400 (Bad request). Closes https://github.com/searxng/searxng/issues/2972 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-29Update searx.data - update_engine_traits.pydalf
2023-10-29Update searx.data - update_wikidata_units.pydalf
2023-10-29Update searx.data - update_firefox_version.pydalf
2023-10-29Update searx.data - update_currencies.pydalf
2023-10-29Update searx.data - update_engine_descriptions.pydalf
2023-10-29Update searx.data - update_ahmia_blacklist.pydalf
2023-10-27[translations] update from Weblatesearxng-bot
4e5e5db44 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> e1a8d3508 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> 84bddfb89 - 2023-10-26 - return42 <markus.heiser@darmarit.de> d67a4114d - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> 62fe8e328 - 2023-10-26 - return42 <markus.heiser@darmarit.de> 6e37ab975 - 2023-10-26 - quenty_occitania <quentinantonin@free.fr> 2cdab3247 - 2023-10-25 - SomeTr <SomeTr@users.noreply.translate.codeberg.org> cf7ea7234 - 2023-10-23 - clsty <celestial.y@outlook.com> 0ea313893 - 2023-10-23 - return42 <markus.heiser@darmarit.de> 22151e440 - 2023-10-23 - return42 <markus.heiser@darmarit.de> e4eaf42b6 - 2023-10-22 - clsty <celestial.y@outlook.com>
2023-10-22[fix] HTMLParser: undocumented not implemented methodMarkus Heiser
In python versions <py3.10 there is an issue with an undocumented method HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed in Python 3.5. To be compatible to higher versions (>=py3.10) an error method is implemented which throws an AssertionError exception like the higher Python versions do [3]. [1] https://github.com/python/cpython/issues/76025 [2] https://bugs.python.org/issue31844 [3] https://github.com/python/cpython/pull/8562 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-20[translations] update from Weblatesearxng-bot
2325f1583 - 2023-10-20 - return42 <markus.heiser@darmarit.de> 5090c6a8e - 2023-10-18 - return42 <markus.heiser@darmarit.de> 3a38219d8 - 2023-10-18 - return42 <markus.heiser@darmarit.de> 94a9f4164 - 2023-10-16 - return42 <markus.heiser@darmarit.de> bdbeb4b30 - 2023-10-16 - return42 <markus.heiser@darmarit.de> f9b483f48 - 2023-10-16 - return42 <markus.heiser@darmarit.de> 7f1ca1997 - 2023-10-16 - return42 <markus.heiser@darmarit.de> c5a701dc4 - 2023-10-14 - alexgabi <alexgabi@disroot.org>
2023-10-13[build] /staticMarkus Heiser
2023-10-13[fix] search.js: crash on homepage when setting form listenersBnyro
2023-10-13fixing results parsing braveÉmilien (perso)
2023-10-13[translations] update from Weblatesearxng-bot
74e401e68 - 2023-10-09 - return42 <markus.heiser@darmarit.de> 897dd8db1 - 2023-10-09 - return42 <markus.heiser@darmarit.de> 6ed046a90 - 2023-10-09 - tentsbet <remendne@pentrens.jp> 815ecb336 - 2023-10-09 - return42 <markus.heiser@darmarit.de> 65d9a0c2f - 2023-10-07 - return42 <markus.heiser@darmarit.de> 3ec249ef9 - 2023-10-07 - return42 <markus.heiser@darmarit.de> 53dc6c108 - 2023-10-07 - return42 <markus.heiser@darmarit.de>
2023-10-13[fix] hackernews keyerror problemHackurei
2023-10-12[fix] imgur - incorrect wikidata idHackurei
2023-10-12[fix] ddg-lite & ddg-extra: don't send empty vqd valueMarkus Heiser
DDG's bot detection is sensitive to the vqd value. For some search terms (such as extremely long search terms that are often sent by bots), no vqd value can be determined. If SearXNG cannot determine a vqd value, then no request should go out to DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting SearXNG's IP on a block list. Requests from IPs in this block list run into timeouts. Not sure, but it seems the block list is a sliding window: to get my IP rid from the bot list I had to cool down my IP for 1h (send no requests from that IP to DDG). Since such issues can't reproduce in a local instance I tested this patch 24h on my public SearXNG instance: There are still errors (rare), but the reliability is still 100%. Related: - https://github.com/searxng/searxng/pull/2922 - https://github.com/searxng/searxng/pull/2923 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10[fix] ddg-lite vqd value: some search terms do not have a vqd valueMarkus Heiser
Some search terms do not have results and therefore no vqd value BTW: remove a leftover from 9197efa Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10[fix] duckduckgo lite engine: set HTTP header 'Referer'Markus Heiser
We have had problems with this before, the bot protection from ddg-lite seems to have included this referer in the rating [1][2]. From reverse engineering: - The Referer ``https://google.com/`` was set in commt 257dc7d6c4 --> DDG lite does not like this referer anymore! - The 'Referer' header is only set on second and follow up pages but not on the first page - The vqd value is not needed on the first page, the ddg-lite client sets this value only on follow up pages / this can help to reduce the vqd requests from SearXNG. Related to 'Referer' header & ddg requests: [1] https://github.com/searxng/searxng/pull/2161 [2] https://github.com/searxng/searxng/pull/2081 Closes: https://github.com/searxng/searxng/issues/2796 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-09[mod] yacy: use official instance by default and fix crashesBnyro
2023-10-09[mod] add hotkeys option to settings.ymlAlex Balgavy
The change in the hotkey mechanism introduced in 317db5b04 does not allow configuration via `settings.yml`. This commit adds that functionality. Closes: #2898
2023-10-09[feat] implement hackernews engine - news.ycombinator.comHackurei
2023-10-09[fix] matrixrooms add proper MRS integrationAine
Related: - https://github.com/searxng/searxng/issues/2918
2023-10-09[feat] duckduckgo: support for videos and newsBnyro
2023-10-07[fix] kickass: crash when no resultsBnyro
2023-10-07[mod] piped: always show video length if availableBnyro
2023-10-06[feat] engine: implementation of mastodonBnyro
2023-10-06[translations] update from Weblatesearxng-bot
68d743281 - 2023-10-05 - return42 <markus.heiser@darmarit.de> 42f091b7f - 2023-10-05 - return42 <markus.heiser@darmarit.de> 2479c0d7b - 2023-10-05 - ghose <correo@xmgz.eu> a4e6cd592 - 2023-10-05 - return42 <markus.heiser@darmarit.de> 9d4e5f5c3 - 2023-10-05 - return42 <markus.heiser@darmarit.de> b79d44775 - 2023-10-05 - gallegonovato <fran-carro@hotmail.es> 746291184 - 2023-10-06 - return42 <markus.heiser@darmarit.de> f24d7e8b1 - 2023-10-05 - return42 <markus.heiser@darmarit.de> 6140911f9 - 2023-10-05 - Fjuro <ifjuro@proton.me>
2023-10-05[mod] engine - simplify region & lang handling, make filters configurableMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-05[feat] engine: implementation of radio-browser.infoBnyro
2023-10-01[fix] limiter / botdetection: remove http_connection methodMarkus Heiser
Related: - https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01[typo] solved a typo in yahoo error message.Jinyuan Huang
2023-10-01[fix] Bug: Yahoo results for simplified Chinese search sometimes have the ↵Jinyuan Huang
first character cut off #2866 Co-authored-by: Blair Noctis <n@sail.ng>
2023-10-01[fix] emojipedia: fix engineBnyro
2023-10-01[fix] Revision of the Bing enginesMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01[fix] engine - bing fix search, pagination, remove safesearchjazzzooo
2023-09-30[feat] engine: implementation of pinterestBnyro
2023-09-30[fix] matrixrooms.info: pagination not working properlyBnyro
2023-09-30[fix] engine - moviepilot instead of thumbnail use img_srcMarkus Heiser
Instead of thumbnail use img_src in the result item, otherwise the "movies" categories looks clunky. Related: - https://github.com/searxng/searxng/commit/b4e0d2eedc94df2369a7661f9134fcfd8fd68af4#r128785388 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-30[mod] tagesschau: add option to only use tagesschau urlsBnyro
2023-09-30[feat] engine: implementation of matrixrooms.infoBnyro
2023-09-29[feat] engine: implementation of tootfinderBnyro
2023-09-29[mod] add movies category for tmdb, imdb and moviepilotBnyro
2023-09-29[mod] warn to info for failed ping limiterÉmilien (perso)
2023-09-29[mod] settings.yml: remove plugin settings for plugins that don't exist anymoreBnyro
7apu2bq3rhoylwmucxizk54afw5jyda7pho4j5zdcqpwkufke7zdzwad.onion