summaryrefslogtreecommitdiff
path: root/manage
AgeCommit message (Collapse)Author
2022-01-25[test.pyright] suppress warnings about intentional monkey patchingMarkus Heiser
The warnings: - "logger" is not defined' - "supported_languages" is not defined' - "language_aliases" is not defined' are very verbose and superfluous, since these messages are related to intentional monkey patching. [1] https://github.com/searxng/searxng/pull/783#issuecomment-1019818178 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-24[mod] introduce node.env.devtools functionMarkus Heiser
2022-01-23[fix] ensure that test.pyright installs pyrightMartin Fischer
nodejs.ensure only sets up NVM if there isn't a system-wide installation of Node that matches our NODE_MINIMUM_VERSION. The ubuntu image in the CI comes with an up to date node version, so pyright from .nvm_packages is never installed. This commit fixes this by introducing a package.json file.
2022-01-23[mod] add test.pyright to test & ci.test targetsMartin Fischer
Since we currently have many type checking errors, we for now only test with typeCheckingMode: off which makes pyright only check files that contain a comment: # pyright: basic to enable basic type checking, or # pyright: strict to enable strict type checking.
2022-01-23[enh] clarify why we run pyright in the pyenvMartin Fischer
2022-01-23[mod] manage test.pyright: a commandline to run pyright testsMarkus Heiser
This patch implements the command and Makefile target:: ./manage test.pyright make test.pyright Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-18[fix] issue reported by: make test.shellMarkus Heiser
$ make test.shell ./manage line 716: build_msg TEST "[reST markup] ${RST_FILES[@]}"" ^-------------^ SC2145: Argument mixes string and array. Use * or separate argument. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-17[mod] CI target test.rst: test reST markup of README.rstMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-11Merge pull request #686 from return42/lib_redisMarkus Heiser
Add redis DB and connector
2022-01-05[fix] debug console (pdb) in a session started by `make run`Markus Heiser
Commit c7f27404 moves the `python -m searx.webapp` process to the background. A background job can't open a simple python-debugger (pdb) console. This patch moves all processes to the background except the searx.webapp. Insert a break point somewhere in the webapp application:: import pdb pdb.set_trace() And start a debug session by:: make run and test you break point. To test that the entire 'make run' stops in the case of an error in the themes.live [1] background process try: make LIVE_THEME=typo-theme-name run [1] https://github.com/searxng/searxng/pull/664#discussion_r776419585 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-01-04Merge pull request #664 from return42/themes.liveMarkus Heiser
[mod] manage: add themes.live command (rebuild on modification)
2022-01-03[mod] script to build & install a redis instanceMarkus Heiser
A script to build & install a simple & isolated redis service, dedicated to SearXNG and connected via Unix socket. $ ./manage redis.help redis.: devpkg : install essential packages to compile redis build : build redis binaries at /800GBPCIex4/share/SearXNG/dist/redis/6.2.6/amd64 install : create user (searxng-redis) and install systemd service (searxng-redis) remove : delete user (searxng-redis) and remove service (searxng-redis) shell : start bash interpreter from user searxng-redis src : clone redis source code to <path> and checkput 6.2.6 useradd : create user (searxng-redis) at /usr/local/searxng-redis userdel : delete user (searxng-redis) addgrp : add <user> to group (searxng-redis) rmgrp : remove <user> from group (searxng-redis) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-29[mod] live build of a theme: LIVE_THEME=simple make runMarkus Heiser
Environment variable to get live builds while modifying CSS & JS of a theme:: LIVE_THEME=simple make run Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-29[fix] remove leftover from 59f4c792Markus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-29[mod] manage: add themes.live command (rebuild on modification)Markus Heiser
To have a live build while editing the HTML client of a theme. The first argument of the command is the theme name: ./manage themes.live simple Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[mod] test.black: show issues (diff) reported by python-blackMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-27[mod] replace pycodestyle by blackAlexandre Flament
"make test.black" checks for the code style "make format.python" format the python code
2021-12-24[fix] ./manage: upgrade geckodriver when GECKODRIVER_VERSION changeAlexandre Flament
2021-12-23[test.robot] update gecko driver / required by selenium 4.1.0Markus Heiser
Update gecko driver to v0.30.0 [1] [1] https://github.com/mozilla/geckodriver/releases/tag/v0.30.0 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-17[fix] weblate: separate commit description from commit bodyMarkus Heiser
It is a common convention to separate commit description from commit body by a empty line [1]. [1] https://www.conventionalcommits.org/en/v1.0.0/#summary Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-12-14[simple theme] activate - SearXNG JavaScript Style GuideMarkus Heiser
Add the 'SearXNG JavaScript Style Guide' as one quality gate in the build chain of the simple theme:: make themes.simple make themes.simple.test In the github CI the `themes.all` target enforce a `themes.simple`. BTW: Remove 'jshint' left overs from 0ee316f3d Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-28[mod] simple theme: use sharp instead of convert to create .png from .svgAlexandre Flament
define a custom grunt task, since grunt-sharp is too old (it can't be installed). in gruntfile.js, the image tasks are moved at the end the build chain. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-20[brand] initial - folder src/brand for searxng-wordmarkMarkus Heiser
Folder src/brand is intended to place logo, wordmark and more in. This commit moves the origin (source) of searxng-wordmark.svg from the simple theme into this folder About the new created src/ folder: On the long term we can move all the files from static/themes/<name>/src/* into a src/themes/<name>/* folder. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-18Merge pull request #508 from return42/arm64Markus Heiser
[mod] Tools to install and maintain golang binaries & packages.
2021-11-16[mod] Tools to install and maintain NVM versions manager for Node.jsMarkus Heiser
[1] https://github.com/nvm-sh/nvm Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-16[mod] Tools to install and maintain golang [1] binaries & packages.Markus Heiser
[1] https://golang.org/doc/devel/release#policy A simple *helloworld* test with user 'my_user' : sudo -H adduser my_user ./manage go.golang go1.17.3 my_user ./manage go.install github.com/go-training/helloworld@latest my_user ./manage go.bash my_user $ helloword Hello World!! Don't forget to remove 'my_user': sudo -H deluser --remove-home my_user Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-15[fix] make test.shell - ./manage line 80Markus Heiser
make test.shell reports an issue that has been added in [PR-500]:: In ./manage line 80: yamllint : lint YAML files: $YAMLLINT_FILES ^-------------^ SC2128: Expanding an array without an index only gives the first element. [PR-500] https://github.com/searxng/searxng/pull/500 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-13[fix] manage help - add description of test.yamllintMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-11-13[simple theme] create favicon.png from src/svg/searxng-wordmark.svgMarkus Heiser
new bash function convert_if_newer() / usage:: convert_if_newer <origfile> <outfile> [<options>, ...] convert_if_newer "path/to/origin.svg" "path/to/converted.png" -transparent white -resize 64x64 Run's ImageMagik' convert comand to generate <outfile> from <origfile>, if <origfile> is newer than <outfile>. The command line is to convert is:: convert <origfile> [<options>, ...] <outfile> PNG 'searx/static/themes/simple/img/favicon.png' has been created by:: $ make themes.simple CONVERT searx/static/themes/simple/src/svg/searxng-wordmark.svg -transparent white -resize 64x64 searx/static/themes/simple/img/favicon.png ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-30[brand] SearXNG - bash env PYLINT_SEARXNG_DISABLE_OPTIONMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-12SearXNG: dockerAlexandre Flament
2021-10-11[brand] SearXNG - reference /etc/searxng/settings.ymlMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-11SearXNG: partial update: reference /etc/searxng/settings.ymlAlexandre Flament
2021-10-04[fix] commit message of 'make weblate.push.translations'Markus Heiser
Fix `\n` issue in the commit message [1] by using multiple `-m` options [2]:: 7d9ffd680 translations [translations] update messages.pot and messages.po files\nFrom cebc0e39 - 2021-10-04 - Markus Heiser <markus.heiser@darmarIT.de> [1] https://github.com/searxng/searxng/pull/379#issuecomment-933242702 [2] https://git-scm.com/docs/git-commit#Documentation/git-commit.txt--mltmsggt Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-03[fix] make weblate.push.translationsAlexandre Flament
Even when there are changes, the function exit without pushing them.
2021-10-03Merge pull request #375 from dalf/searxng_extraAlexandre Flament
SearXNG: searx_extra
2021-10-02SearXNG: searxng_extraAlexandre Flament
2021-10-02SearXNG: SEARXNG_SETTINGS_PATHAlexandre Flament
2021-10-02SearXNG: environment variablesAlexandre Flament
2021-09-17[mod] manage - use pyenv.activate where it makes senseMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-17[mod] utils/lib.sh: add pyenv.activateAlexandre Flament
* initialize virtualenv (pyenv.install) * activate virtualenv close #310
2021-09-12[fix] manage help(): commands babel.* has been renamed to weblate.*Markus Heiser
In commit 97355672c the functions named babel.* has been renamed to weblate.* but it was forgotten to change it also in the help(). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07[fix] add 'categories' to PYLINT_ADDITIONAL_BUILTINS_FOR_ENGINESMarkus Heiser
androp no longer needed (see line 591 in 7b235a1):: # pylint: disable=undefined-variable Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914068609 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-06Merge pull request #293 from dalf/fix-290Alexandre Flament
[fix] translation: lock weblate only when there is an actual change of messages.pot
2021-09-06[mod] one logger per engineMarkus Heiser
Suggested-by: @dalf in https://github.com/searxng/searxng/issues/98#issuecomment-849013518 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-06[fix] translation: lock weblate only when there is an actual change of ↵Alexandre Flament
messages.pot Close #290
2021-09-02[mod] move searx/testing.py to the tests directoryAlexandre Flament
move robot tests to tests.robot manage calls "python -m tests.robot"
2021-08-16[translations] ./manage rename shell functions to integrate weblateMarkus Heiser
Functions implemented to run *Weblate* workflows should use prefix 'weblate.': - babel.setup.translations.worktree --> weblate.translations.worktree Create git worktree ${TRANSLATIONS_WORKTREE} and checkout branch 'translations' from Weblate's counterpart (weblate) of the SearXNG (origin):: remote weblate https://weblate.bubu1.eu/git/searxng/searxng/ - babel.weblate.to.translations --> weblate.to.translations Update 'translations' branch of SearXNG (origin) with last additions from Weblate. - babel.translations.to.master --> weblate.translations.commit Update 'translations' branch of SearXNG (origin) with last additions from Weblate. Copy the changes to the master branch, compile translations and create a commit in the local branch (master) - babel.master.to.translations --> weblate.push.translations Push *translation changes* from SearXNG (origin) to Weblate's counterpart (weblate). Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-16[translation] ./manage: add comments to new functions, rename jobMarkus Heiser
./mange Comment functions: - babel.setup.translations.worktree - babel.weblate.to.translations - babel.translations.to.master - babel.master.to.translations BTW: - changed some cd into pushd - removed obsolete `set -x` - remove not needed echo from `last_commit_message=$(echo ..` .github/workflows/translations-update.yml docs/dev/translation.rst Rename job to: "create PR for additons from weblate" Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-07[translations] web integrationAlexandre Flament
* make babel.translations.to.master: pull weblate updates * make babel.master.to.translations: push .pot and .po files to weblate