summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2023-03-24[mod] replace engines_languages.json by engines_traits.jsonMarkus Heiser
Implementations of the *traits* of the engines. Engine's traits are fetched from the origin engine and stored in a JSON file in the *data folder*. Most often traits are languages and region codes and their mapping from SearXNG's representation to the representation in the origin search engine. To load traits from the persistence:: searx.enginelib.traits.EngineTraitsMap.from_data() For new traits new properties can be added to the class:: searx.enginelib.traits.EngineTraits .. hint:: Implementation is downward compatible to the deprecated *supported_languages method* from the vintage implementation. The vintage code is tagged as *deprecated* an can be removed when all engines has been ported to the *traits method*. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24Merge pull request #2280 from searxng/dependabot/pip/master/linuxdoc-20230321Markus Heiser
Bump linuxdoc from 20221127 to 20230321
2023-03-24Merge pull request #2283 from ↵Markus Heiser
searxng/revert-2279-dependabot/pip/master/redis-4.5.3 Revert "Bump redis from 4.5.1 to 4.5.3"
2023-03-24Revert "Bump redis from 4.5.1 to 4.5.3"Markus Heiser
2023-03-24Merge pull request #2279 from searxng/dependabot/pip/master/redis-4.5.3Markus Heiser
Bump redis from 4.5.1 to 4.5.3
2023-03-24Merge pull request #2281 from searxng/dependabot/pip/master/pylint-2.17.1Markus Heiser
Bump pylint from 2.17.0 to 2.17.1
2023-03-24Bump linuxdoc from 20221127 to 20230321dependabot[bot]
Bumps [linuxdoc](https://github.com/return42/linuxdoc) from 20221127 to 20230321. - [Release notes](https://github.com/return42/linuxdoc/releases) - [Commits](https://github.com/return42/linuxdoc/commits) --- updated-dependencies: - dependency-name: linuxdoc dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
2023-03-24Merge pull request #2278 from searxng/dependabot/pip/master/yamllint-1.30.0Markus Heiser
Bump yamllint from 1.29.0 to 1.30.0
2023-03-24Bump pylint from 2.17.0 to 2.17.1dependabot[bot]
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.17.0 to 2.17.1. - [Release notes](https://github.com/PyCQA/pylint/releases) - [Commits](https://github.com/PyCQA/pylint/compare/v2.17.0...v2.17.1) --- updated-dependencies: - dependency-name: pylint dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2023-03-24Bump redis from 4.5.1 to 4.5.3dependabot[bot]
Bumps [redis](https://github.com/redis/redis-py) from 4.5.1 to 4.5.3. - [Release notes](https://github.com/redis/redis-py/releases) - [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES) - [Commits](https://github.com/redis/redis-py/compare/v4.5.1...v4.5.3) --- updated-dependencies: - dependency-name: redis dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
2023-03-24Bump yamllint from 1.29.0 to 1.30.0dependabot[bot]
Bumps [yamllint](https://github.com/adrienverge/yamllint) from 1.29.0 to 1.30.0. - [Release notes](https://github.com/adrienverge/yamllint/releases) - [Changelog](https://github.com/adrienverge/yamllint/blob/master/CHANGELOG.rst) - [Commits](https://github.com/adrienverge/yamllint/compare/v1.29.0...v1.30.0) --- updated-dependencies: - dependency-name: yamllint dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2023-03-24Merge pull request #2277 from searxng/translations_updateMarkus Heiser
Update translations
2023-03-24[translations] update from Weblatesearxng-bot
abfec8f4 - 2023-03-23 - return42 <markus.heiser@darmarit.de> f02ea21c - 2023-03-23 - return42 <markus.heiser@darmarit.de> 3fc6c653 - 2023-03-20 - chenghui-lee <chlee9926@gmail.com> 342bbf46 - 2023-03-20 - return42 <markus.heiser@darmarit.de>
2023-03-22Merge pull request #2274 from searxng/codespacesAlexandre Flament
Add GitHub Codespaces configuration
2023-03-22Merge pull request #2272 from Solirs/Wikidata_descMarkus Heiser
wikidata: Add description for results
2023-03-21Add GitHub Codespaces configurationAlexandre Flament
2023-03-21Pass black formatting testSolirs
2023-03-21WIKIDATA: Add description for resultsSolirs
2023-03-20Merge pull request #2268 from return42/editorconfigMarkus Heiser
[enh] add .editorconfig
2023-03-20[enh] add .editorconfigMarkus Heiser
EditorConfig [1] helps maintain consistent coding styles for multiple developers working on the same project across various editors and IDEs. The EditorConfig specification [2] support is pre installed in common IDEs [3] and plugins for many others are available [4]. [1] https://editorconfig.org [2] https://editorconfig-specification.readthedocs.io/ [3] https://editorconfig.org/#pre-installed [4] https://editorconfig.org/#download Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-20Merge pull request #2266 from return42/shuffle-cipherMarkus Heiser
[mod] Shuffle httpx's default ciphers of a SSL context randomly.
2023-03-19Merge pull request #2204 from return42/readmeMarkus Heiser
[readme] reworked / partial merge of #2200
2023-03-19Merge pull request #2238 from return42/fix-2027Markus Heiser
[fix] fix threshold in replace_auto_language
2023-03-19Merge pull request #2239 from return42/fix-eslintrcMarkus Heiser
[fix] remove duplicate key in simple theme ESLint configuration
2023-03-19[mod] Shuffle httpx's default ciphers of a SSL context randomly.Markus Heiser
From the analyse of @9Ninety [1] we know that DDG (and may be other engines / I have startpage in mind) does some kind of TLS fingerprint to block bots. This patch shuffles the default ciphers from httpx to avoid a cipher profile that is known to httpx (and blocked by DDG). [1] https://github.com/searxng/searxng/issues/2246#issuecomment-1467895556 ---- From `What Is TLS Fingerprint and How to Bypass It`_ > When implementing TLS fingerprinting, servers can't operate based on a > locked-in whitelist database of fingerprints. New fingerprints appear > when web clients or TLS libraries release new versions. So, they have to > live off a blocklist database instead. > ... > It's safe to leave the first three as is but shuffle the remaining ciphers > and you can bypass the TLS fingerprint check. .. _What Is TLS Fingerprint and How to Bypass It: https://www.zenrows.com/blog/what-is-tls-fingerprint#how-to-bypass-tls-fingerprinting Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> Closes: https://github.com/searxng/searxng/issues/2246
2023-03-17Merge pull request #2257 from Solirs/fix_bad_escapeMarkus Heiser
re.escape() the query in highlight_content to prevent a server side error.
2023-03-17[fix] server side error: escape backslashes in the query highlight_contentSolirs
Any backslash escapes in the replacement are processed [1], backslashes should be escaped [2]. [1] https://docs.python.org/3/library/re.html#re.sub [2] https://docs.python.org/3/library/re.html#re.escape closes: - https://github.com/searxng/searxng/issues/2256 - https://github.com/searxng/searxng/issues/2250
2023-03-17Merge pull request #2262 from searxng/translations_updateMarkus Heiser
Update translations
2023-03-17[translations] update from Weblatesearxng-bot
32926a19 - 2023-03-15 - return42 <markus.heiser@darmarit.de> 7aabc876 - 2023-03-16 - Linerly <linerly@protonmail.com> c0ed00f5 - 2023-03-14 - SonoAX <giovanniilgiovo@gmail.com> 6cf287f6 - 2023-03-13 - RhysJones <proladrhys123@outlook.com> 8c4c5f83 - 2023-03-12 - Cavemanly <k.adel.2m@protonmail.com> dffe61fa - 2023-03-10 - return42 <markus.heiser@darmarit.de> c7736cac - 2023-03-10 - BalkanMadman <zurabid2016@gmail.com> e831b8e3 - 2023-03-10 - BalkanMadman <zurabid2016@gmail.com> ef3c60af - 2023-03-10 - return42 <markus.heiser@darmarit.de> c046a677 - 2023-03-07 - BalkanMadman <zurabid2016@gmail.com> 142041d6 - 2023-03-05 - return42 <markus.heiser@darmarit.de> 119b51df - 2023-03-05 - return42 <markus.heiser@darmarit.de>
2023-03-15rollback testAlexandre Flament
2023-03-15testAlexandre Flament
2023-03-15Merge pull request #2214 from searxng/dependabot/pip/master/selenium-4.8.2Markus Heiser
Bump selenium from 4.8.0 to 4.8.2
2023-03-15Merge pull request #2244 from searxng/dependabot/pip/master/myst-parser-1.0.0Markus Heiser
Bump myst-parser from 0.18.1 to 1.0.0
2023-03-15Bump myst-parser from 0.18.1 to 1.0.0dependabot[bot]
Bumps [myst-parser](https://github.com/executablebooks/MyST-Parser) from 0.18.1 to 1.0.0. - [Release notes](https://github.com/executablebooks/MyST-Parser/releases) - [Changelog](https://github.com/executablebooks/MyST-Parser/blob/master/CHANGELOG.md) - [Commits](https://github.com/executablebooks/MyST-Parser/compare/v0.18.1...v1.0.0) --- updated-dependencies: - dependency-name: myst-parser dependency-type: direct:development update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com>
2023-03-15Merge pull request #2224 from searxng/update_data_update_currencies.pyMarkus Heiser
Update searx.data - update_currencies.py
2023-03-15Merge pull request #2222 from searxng/update_data_update_wikidata_units.pyMarkus Heiser
Update searx.data - update_wikidata_units.py
2023-03-15Merge pull request #2215 from searxng/dependabot/pip/master/markdown-it-py-2.2.0Markus Heiser
Bump markdown-it-py from 2.1.0 to 2.2.0
2023-03-15Merge pull request #2243 from searxng/dependabot/pip/master/pylint-2.17.0Markus Heiser
Bump pylint from 2.16.2 to 2.17.0
2023-03-15Merge pull request #2212 from searxng/translations_updateMarkus Heiser
Update translations
2023-03-10Bump pylint from 2.16.2 to 2.17.0dependabot[bot]
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.16.2 to 2.17.0. - [Release notes](https://github.com/PyCQA/pylint/releases) - [Commits](https://github.com/PyCQA/pylint/compare/v2.16.2...v2.17.0) --- updated-dependencies: - dependency-name: pylint dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
2023-03-05[fix] remove duplicate key in simple theme ESLint configurationMarkus Heiser
Partial merge of [PR-1736] [PR-1736] https://github.com/searxng/searxng/pull/1736 Suggested-by: @FunctionalHacker in [1] Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-05[fix] fix threshold in replace_auto_languageMarkus Heiser
[1] https://github.com/searxng/searxng/pull/2027#pullrequestreview-1322157677 [2] https://github.com/searxng/searxng/pull/1969#issuecomment-1345354529 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-03[translations] update from Weblatesearxng-bot
0d8ebfe1 - 2023-03-02 - AHOHNMYC <lqwh2h2cwa@protonmail.com> 1358dd6d - 2023-03-03 - mystery-z <07juwonc@kakao.com> 4d8c13db - 2023-03-01 - lhostfree951 <freeehost9191@gmail.com> 1ae581b6 - 2023-02-28 - tygyh <jonis9898@hotmail.com> 0003698f - 2023-02-28 - ewm <gnu.ewm@protonmail.com> 31c79617 - 2023-02-28 - gjveld <gjveld@gmail.com> 9015ec73 - 2023-02-28 - gallegonovato <fran-carro@hotmail.es> 03619a68 - 2023-02-25 - BalkanMadman <zurabid2016@gmail.com> fa90585b - 2023-02-25 - BalkanMadman <zurabid2016@gmail.com> c902c5e5 - 2023-02-26 - tentsbet <remendne@pentrens.jp>
2023-03-02Merge pull request #2231 from return42/fix-docs_prebuildAlexandre Flament
[fix] make docs: NameError: name 'DOC' is not defined
2023-03-02[fix] make docs: NameError: name 'DOC' is not definedMarkus Heiser
To reproduce the issue set base_url:: diff --git a/searx/settings.yml b/searx/settings.yml index 841457b5e..4e282cb61 100644 --- a/searx/settings.yml +++ b/searx/settings.yml @@ -72,7 +72,7 @@ server: bind_address: "127.0.0.1" # public URL of the instance, to ensure correct inbound links. Is overwritten # by ${SEARXNG_URL}. - base_url: false # "http://example.com/location" + base_url: "http://example.com/location" limiter: false # rate limit the number of request on the instance, block some bots and build the docs:: $ make docs SPHINX HTML ./docs --> file:///800GBPCIex4/share/SearXNG/dist/docs DOCS build build/docs/includes Traceback (most recent call last): File "searxng_extra/docs_prebuild", line 85, in <module> sys.exit(main()) File "searxng_extra/docs_prebuild", line 31, in main f.write(page.content) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "searxng_extra/docs_prebuild", line 81, in _instance_infosetset_ctx return DOC NameError: name 'DOC' is not defined Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-01Merge pull request #2220 from Solirs/gentoo_engine_timeoutAlexandre Flament
Increase timeout for gentoo wiki engine
2023-03-01Merge pull request #2227 from searxng/update_data_update_engine_descriptions.pyAlexandre Flament
Update searx.data - update_engine_descriptions.py
2023-03-01Merge pull request #2226 from searxng/update_data_update_ahmia_blacklist.pyAlexandre Flament
Update searx.data - update_ahmia_blacklist.py
2023-03-01Merge pull request #2223 from searxng/update_data_update_firefox_version.pyAlexandre Flament
Update searx.data - update_firefox_version.py
2023-03-01Update searx.data - update_engine_descriptions.pydalf