summaryrefslogtreecommitdiff
path: root/searx
AgeCommit message (Collapse)Author
2024-11-28[fix] crowdview engine: html tags in title and contentBnyro
2024-11-28[fix] wikicommons engine: remove HTML tags from result itemsMarkus Heiser
BTW: humanize filesize (Bytes) to KB, MB, GB .. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-27[fix] google engine: remove <script> tags from result itemsMarkus Heiser
In some results, Google returns a <script> tag that must be removed before extracting the content. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-27[fix] findthatmeme engine URLs have changedAustin-Olacsi
2024-11-26[chore] drop sjp engine: WEB side has changed a long time agoMarkus Heiser
The WEB page (PL only) has changed and there is now also a kind of CAPTCHA. There is currently no possibility to restore the function of this engine. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-26[chore] remove invalid base_url from settings.yml enginesMarkus Heiser
The engines do not have / do not need a property `base_url`, lets remove it from the settings.yml Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-26[fix] engine: Library of Congress - image & thumb linksMarkus Heiser
The properties `item.service_medium` and `item.thumb_gallery` are not given for every result item. It is more reliable to use the first (thumb) and last (image) URL in the list of of URLs in `image_url`. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-25[fix] duckduckgo extra: crashes and returns no resultsBnyro
2024-11-25[fix] openmetrics: value is None if there's no dataBnyro
2024-11-25[build] /staticBnyro
2024-11-25[mod] add CSS (LESS) to xsl style to view rss in browserMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-25[refactor] <type> element isn't a part of the RSS 2.0 spec [1]Markus Heiser
[1] https://cyber.harvard.edu/rss/rss.html Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-25[feat] rss: add xsl style to view rss in browserBnyro
2024-11-25[chore] rss: rename from searx to SearXNGBnyro
2024-11-24[fix] remove unknown_params from preferencesGrant Lanham
2024-11-24[feat] metrics: support for open metricsBnyro
2024-11-24[build] /staticBnyro
2024-11-24[chore] *: fix typos detected by typos-cliBnyro
2024-11-24[feat] engine: add adobe stock video and audio enginesMarkus Heiser
The engine has been revised; there is now the option ``adobe_content_types`` with which it is possible to configure engines for video and audio from the adobe stock. BTW this patch adds documentation to the engine. To test all three engines in one use a search term like:: !asi !asv !asa sound Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-24[feat] engine: add adobe stock photosBnyro
2024-11-23[clean] Internet Archive Scholar search API no longer existsMarkus Heiser
Engine was added in #2733 but the API does no longer exists. Related: - https://github.com/searxng/searxng/issues/4038 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-23[fix] engine Library of Congress: fix API URL loc.gov -> www.loc.govMarkus Heiser
Avoid HTTP 404 and redirects. Requests to the JSON/YAML API use the base url [1] https://www.loc.gov/{endpoint}/?fo=json [1] https://www.loc.gov/apis/json-and-yaml/requests/ Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-23[log] warning with URL in case of 'raise_for_httperror'Markus Heiser
In order to be able to implement error handling, it is necessary to know which URL triggered the exception / the URL has not yet been logged. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-22[l10n] update translations from Weblatesearxng-bot
6581d89b3 - 2024-11-21 - return42 <return42@users.noreply.translate.codeberg.org> a342903eb - 2024-11-21 - return42 <return42@users.noreply.translate.codeberg.org> 61d3236b9 - 2024-11-21 - return42 <return42@users.noreply.translate.codeberg.org> cd03e8cc5 - 2024-11-21 - return42 <return42@users.noreply.translate.codeberg.org> a2399e23a - 2024-11-20 - tentsbet <tentsbet@users.noreply.translate.codeberg.org> 9a5bcc06d - 2024-11-17 - cherrad <cherrad@users.noreply.translate.codeberg.org> 4364e5ef8 - 2024-11-16 - DiamondBrain113 <DiamondBrain113@users.noreply.translate.codeberg.org> e3a127ec8 - 2024-11-15 - KinoCineaste <KinoCineaste@users.noreply.translate.codeberg.org>
2024-11-17[fix] engine: duckduckgo - don't quote query stringMarkus Heiser
The query string send to DDG must not be qouted. The query string was URL-qouted in #4011, but the URL-qouted query string result in unexpected *URL decoded* and other garbish results as reported in #4019 and #4020. To test compare the results of a query like:: !ddg Häuser und Straßen :de !ddg Häuser und Straßen :all !ddg 房屋和街道 :all !ddg 房屋和街道 :zh Closed: - [#4019] https://github.com/searxng/searxng/issues/4019 - [#4020] https://github.com/searxng/searxng/issues/4020 Related: - [#4011] https://github.com/searxng/searxng/pull/4011 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-11-15[l10n] update translations from Weblatesearxng-bot
0216898a3 - 2024-11-14 - KhietVo <KhietVo@users.noreply.translate.codeberg.org> 3293db4c8 - 2024-11-14 - return42 <return42@users.noreply.translate.codeberg.org> 574e0d683 - 2024-11-13 - lrnz2 <lrnz2@users.noreply.translate.codeberg.org> a32d9d158 - 2024-11-08 - Aadniz <Aadniz@users.noreply.translate.codeberg.org>
2024-11-14[fix] engine: duckduckgo - only uses first word of the search termsNicolas Dato
during the revision in PR #3955 the query string was accidentally converted into a list of words, further the query must be quoted before POSTed in the ``data`` field, see ``urllib.parse.quote_plus`` [1] [1] https://docs.python.org/3/library/urllib.parse.html#urllib.parse.quote_plus Closed: #4009 Co-Authored-by: @return42
2024-11-10[fix] settings.yml - enabled_plugins: document to reflect default settingsLeo Liu
Remove 'Autodetect search language', which is no longer valid, from settings, and add 'Unit converter plugin', which is now default enabled, to settings.
2024-11-10Fix scheduler.luaLeo Liu
2024-11-08[l10n] update translations from Weblatesearxng-bot
8d90a7e6d - 2024-11-06 - sahussawud <sahussawud@users.noreply.translate.codeberg.org> 41ee8bb0d - 2024-11-02 - laaknor <laaknor@users.noreply.translate.codeberg.org> c1a30afab - 2024-11-02 - return42 <return42@users.noreply.translate.codeberg.org> 627ab7a8e - 2024-11-01 - zarlin <zarlin@users.noreply.translate.codeberg.org>
2024-11-01[fix] annas archive: crash when no thumbnail, differing results, pagingBnyro
2024-11-01[l10n] update translations from Weblatesearxng-bot
a4cdaaa26 - 2024-10-30 - Juno Takano <jutty@users.noreply.translate.codeberg.org> 46bad3a79 - 2024-10-29 - saltsnorter <saltsnorter@users.noreply.translate.codeberg.org> 6a4096da9 - 2024-10-27 - Eryk Michalak <gnu.ewm@protonmail.com> 64815d956 - 2024-10-28 - ljansen <ljansen@users.noreply.translate.codeberg.org> 851ae554d - 2024-10-26 - return42 <return42@users.noreply.translate.codeberg.org> 24f16d5e3 - 2024-10-26 - return42 <return42@users.noreply.translate.codeberg.org> 8278d1cb9 - 2024-10-26 - Atul_Eterno <Atul_Eterno@users.noreply.translate.codeberg.org>
2024-10-31[fix] google: display every result when keyword is contained in content fielduply23333
2024-10-29[fix] favicons: msgspec.ValidationError: Expected `Path`, got `str` - at ↵Markus Heiser
`$.favicons.cache.db_url` Closes: https://github.com/searxng/searxng/issues/3975 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-29[refactor] engine: duckduckgo - https://html.duckduckgo.com/htmlMarkus Heiser
The entire source code of the duckduckgo engine has been reengineered and purified. 1. DDG used the URL https://html.duckduckgo.com/html for no-JS requests whose response is also easier to parse than the previous https://lite.duckduckgo.com/lite/ URL 2. the bot detection of DDG has so far caused problems and often led to a CAPTCHA, this can be circumvented using `'Sec-Fetch-Mode'] = “navigate”` Closes: https://github.com/searxng/searxng/issues/3927 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-29[refactor] replace pydantic by msgspecMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-29[data] update searx.data - update_firefox_version.pyreturn42
2024-10-29[data] update searx.data - update_ahmia_blacklist.pyreturn42
2024-10-29[data] update searx.data - update_currencies.pyreturn42
2024-10-29[data] update searx.data - update_wikidata_units.pyreturn42
2024-10-29[data] update searx.data - update_engine_traits.pyreturn42
2024-10-29[data] update searx.data - update_engine_descriptions.pyreturn42
2024-10-28[fix] calculator: use locale from UI (not from selected language)Markus Heiser
Closes: https://github.com/searxng/searxng/issues/3956 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-28[fix] limiter: don't hard code settings folder to /etc/searxngMarkus Heiser
The location of the local settings depends on environment ``SEARXNG_SETTINGS_PATH`` and can be different from ``/etc/searxng``. Issue was reported on Matrix [1]. To get the location function ``searx.settings_loader.get_user_cfg_folder()`` should be used. [1] https://matrix.to/#/!vxScbLNEAmRvOraXBn:matrix.org/$_eLS0JpE9oVEWsiGJkqJnWcFWEeZClIMGDK6cWv_Q4g?via=matrix.org&via=tchncs.de&via=envs.net Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-26[fix] add missing tomli to the requirements.txtMarkus Heiser
Package ``tomli`` is needed for py < 3.11, BTW remove the no longer needed pytomlpp package. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-26[build] /staticMarkus Heiser
2024-10-26[mod] shrink new favicons in search resultsJJ
2024-10-26[l10n] update translations from Weblatesearxng-bot
21c063bf1 - 2024-10-20 - Priit Jõerüüt <jrtcdbrg@users.noreply.translate.codeberg.org>
2024-10-23[fix] favicons: don't hard code settings folder to /etc/searxngMarkus Heiser
The location of the local settings depends on environment ``SEARXNG_SETTINGS_PATH`` and can be different from ``/etc/searxng``. Issue was reported on Matrix [1]. To get the location function ``searx.settings_loader.get_user_cfg_folder()`` should be used. [1] https://matrix.to/#/!vxScbLNEAmRvOraXBn:matrix.org/$5xNMYvONGB-mPt2B3ttoL27QncRFhkjGkO-TISdmP08?via=matrix.org&via=tchncs.de&via=envs.net Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-10-19[fix] engine: duckduckgo - CAPTCHA detectionMarkus Heiser
The previous implementation could not distinguish a CAPTCHA response from an ordinary result list. In the previous implementation a CAPTCHA was taken as a result list where no items are in. DDG does not block IPs. Instead, a CAPTCHA wall is placed in front of request on a dubious request. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>