Paul Alcock
bb34685dfa
Add IMDB support ( #2980 )
...
Closes #1145
2021-10-02 13:41:38 +02:00
Flodur871
8ecc8c5745
[enh] Fix uppercase ip query ( #2991 )
...
## What does this PR do?
Fixes the self_info plugin to support uppercase ip queries.
## Why is this change important?
This PR solves the mild annoyance of retyping IP in lowercase.
## Related issues
Closes #2888
2021-10-02 13:35:22 +02:00
Noémi Ványi
1d5feed4c1
[fix] style of stackexchange engine
2021-10-02 13:25:50 +02:00
Markus Heiser
a1f9919587
[fix] engine stackexchange - decode HTML entities in title & content
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:49:12 +02:00
Markus Heiser
0b3488158b
[mod] engines - add superuser.com (Stack Exchange API)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:48:39 +02:00
Markus Heiser
a130c7c7a3
[mod] engines - add askubuntu.com (Stack Exchange API)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:47:11 +02:00
Markus Heiser
5e84d670a2
[mod] replace old stackoverflow engine by Stack Exchange API v2.3
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:43:51 +02:00
Markus Heiser
2cf9a61246
[mod] engines - add Stack Exchange API v2.3
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:41:36 +02:00
Noémi Ványi
3f05513601
[fix] DDG engine format and remove logger
2021-10-02 11:40:56 +02:00
Markus Heiser
8448079155
[upd] make data.languages
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:33:34 +02:00
Markus Heiser
9d9a89c6ef
[mod] engine duckduckgo - update supported_languages_url
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:33:21 +02:00
Markus Heiser
c218fb76b8
[mod] engine duckduckgo - use DuckDuckGo-Lite
...
Implement a scrapper for DuckDuckGo-Lite [1]. The existing DuckDuckGo [2]
engine does not support paging. DuckDuckgo-Lite is much faster, less verbose
and does have a paging option (reversed engineered from the input form of [1]).
[1] https://lite.duckduckgo.com/lite
[2] https://duckduckgo.com/
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-10-02 11:33:12 +02:00
Markus Heiser
3bc4077f33
[fix] typo in searx.webadapter.parse_lang
...
Closes #2961
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-19 17:37:35 +02:00
Markus Heiser
e88bea53eb
[enh] add suggestions to brave engine
...
Suggestions should be added too.
suggestion_xpath: //div[@class="text-gray h6"]/a
You can try it with:
!brave recurzuoin
Suggested-by: @allendema in https://github.com/searx/searx/issues/2857#issuecomment-904837023
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-13 21:27:04 +02:00
Markus Heiser
7075fc1324
[fix] brave engine: shows descriptions with their correct URLs
...
BTW add about section to the YAML configuration
It now shows descriptions with their correct URLs when there are videos in the
search results, pulling content_xpath from snippet-description instead of
snippet-content.
Suggested-by: @eagle-dogtooth https://github.com/searx/searx/issues/2857#issuecomment-869119968
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-13 21:27:02 +02:00
Markus Heiser
9afb845a00
[enh] add Brave-Search engine (XPath)
...
Add https://search.brave.com which was requested by @kaonashi696 [1].
This patch was suggested by @eagle-dogtooth [2].
[1] https://github.com/searx/searx/issues/2857
[2] https://github.com/searx/searx/issues/2857#issuecomment-867199241
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-13 21:26:05 +02:00
Markus Heiser
987b0d6f5b
[fix] remove minimum length of content for XPath engine
...
Instead of raising an exception and therefore hiding all results of the engine.
It make sense to remove that requirement in order to allow the implementation of
search engines that do not always have a description. In fact some search
engines that in 99% of the case have a description like Brave Search or Mojeek
crash completely if they for some reason included a result with no description.
To test this patch try Mojeek:
!mjk xyz
before and after the patch.
Suggested-by: 0xhtml in https://github.com/searx/searx/discussions/2933
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-13 21:24:26 +02:00
Noémi Ványi
4db5b973ea
Merge pull request #2955 from allendema/azlyrics
...
[enh] Add azlyrics.com
2021-09-09 21:26:56 +02:00
Marc Abonce Seguin
79eb2ac69e
fix proxy requests issues with httpx >= 0.18.x ( #2969 )
2021-09-09 21:25:39 +02:00
Allen
7e3a30940b
[mod] Change shortcut to azl
2021-09-05 20:52:11 +02:00
searx-bot
1ea573dc88
Update searx.data - update_currencies.py ( #2957 )
...
Co-authored-by: dalf <dalf@users.noreply.github.com>
Co-authored-by: Noémi Ványi <kvch@users.noreply.github.com>
2021-09-05 20:33:34 +02:00
Allen
8b6d5a0e5b
[enh] Add azlyrics.com
...
Upstream example query: https://search.azlyrics.com/search.php?q=The+verbal+acupunture&w=lyrics&p=1
2021-08-31 01:46:55 +02:00
Noémi Ványi
fd1e49c9b6
Merge branch 'master' into dependabot/pip/master/pylint-2.10.2
2021-08-22 21:11:12 +02:00
dependabot[bot]
e271d6d1e1
Bump pylint from 2.9.6 to 2.10.2
...
Bumps [pylint](https://github.com/PyCQA/pylint ) from 2.9.6 to 2.10.2.
- [Release notes](https://github.com/PyCQA/pylint/releases )
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog )
- [Commits](https://github.com/PyCQA/pylint/compare/v2.9.6...v2.10.2 )
---
updated-dependencies:
- dependency-name: pylint
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2021-08-22 20:53:12 +02:00
Markus Heiser
2484e7473a
[fix] /config add missing GIT_BRANCH value
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-08-22 18:58:03 +02:00
Noémi Ványi
23b3b56a06
add filter=0 to Google engine for more results
...
Closes #2944
2021-08-21 16:29:20 +02:00
dependabot[bot]
0810263bdd
Bump pylint from 2.8.2 to 2.9.6 ( #2934 )
...
* Bump pylint from 2.8.2 to 2.9.6
Bumps [pylint](https://github.com/PyCQA/pylint ) from 2.8.2 to 2.9.6.
- [Release notes](https://github.com/PyCQA/pylint/releases )
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog )
- [Commits](https://github.com/PyCQA/pylint/compare/v2.8.2...v2.9.6 )
---
updated-dependencies:
- dependency-name: pylint
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
* update preferences.py to comply with new pep8
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Noémi Ványi <kvch@users.noreply.github.com>
Co-authored-by: Noémi Ványi <sitbackandwait@gmail.com>
2021-08-12 21:50:48 +02:00
Finn
b1e5ff3cf7
[fix] Update xpaths for petalsearch.com ( #2932 )
2021-08-12 18:27:15 +02:00
Noémi Ványi
3d2a5061db
Fix unicode error when using saved preferences URL
...
Closes #2917
Closes #2856
2021-08-07 16:33:47 +02:00
Allen
be401469d2
[mod] Apply HTTPS where possible + fix small typo ( #2922 )
2021-08-07 14:56:01 +02:00
Allen
76606e7372
[enh] Add whaleslide.com ( #2861 )
...
Upstream example: https://whaleslide.com/search/web/runlevels
Co-authored-by: Noémi Ványi <kvch@users.noreply.github.com>
2021-08-03 21:31:08 +02:00
Noémi Ványi
dc99fec831
[fix] add new list element to petal so it does not overwrite previous engines
2021-08-03 21:21:28 +02:00
searx-bot
291b154a61
Update searx.data - update_currencies.py ( #2916 )
...
Co-authored-by: dalf <dalf@users.noreply.github.com>
2021-08-03 21:17:05 +02:00
Allen
ef246b7661
[enh] Add Petalsearch.com engine (xpath) ( #2897 )
...
* [enh] Add Petalsearch.com engine (xpath)
Upstream example query:
https://petalsearch.com/search?query=Felis%20lynx%20Linnaeus&sregion=de&pn=1
* Fix Petalsearch title_xpath
Fixes the title_xpath from Petalsearch which got changed in the meantime.
2021-08-03 21:15:34 +02:00
Allen
36cf794cfa
[enh] Add woxikon.de synonyme (xpath)
...
Upstream example query:
https://synonyme.woxikon.de/synonyme/test.php
2021-08-02 21:58:17 +02:00
Allen
e83c5fd0fd
[enh] Add gpodder.net (JSON)
...
Upstream query example:
https://gpodder.net/search.json?q=linux
2021-08-02 21:56:59 +02:00
Allen
ec4e48e5df
[enh] Add pagination support for Library Genesis
...
[enh] Add pagination support for Library Genesis and add it to "files" category too.
2021-08-02 21:52:12 +02:00
Émilien Devos
ee443d9739
Fix google images
...
Proposed fix in https://github.com/searx/searx/pull/2115#issuecomment-876716010
Closes #2914
2021-08-02 20:14:54 +02:00
Noémi Ványi
bb724cabf9
Merge pull request #2898 from allendema/ask.com
...
[enh] Add ask.com engine
2021-08-02 20:12:49 +02:00
Samuel Dudík
13a608b0b8
Fix Seznam engine ( #2905 )
...
## What does this PR do?
Fixes the Seznam engine by updating XPath strings.
## Why is this change important?
Without this PR Seznam returns no results.
Co-authored-by: Noémi Ványi <kvch@users.noreply.github.com>
2021-08-02 20:09:31 +02:00
Marc Abonce Seguin
a5839a66d6
Update onion engines to v3 ( #2904 )
...
downgrade httpx:
PR https://github.com/encode/httpx/pull/1522
made some breaking changes in AsyncHTTPTransport that affect
our code in https://github.com/searx/searx/blob/master/searx/network/client.py
remove not_evil which has been down for a while now:
https://old.reddit.com/r/onions/search/?q=not+evil&restrict_sr=on&t=year
2021-08-02 20:03:55 +02:00
Allen
1d60d4253a
[enh] Add Kaufland.de
...
thumbnail_xpath not working currently.
2021-07-29 13:34:58 +02:00
Allen
573f91143c
[enh] Add ask.com engine
2021-07-19 18:24:39 +02:00
Adam Tauber
a8988885a5
[fix] pep8
2021-07-05 19:57:53 +02:00
Adam Tauber
198aad43e0
[enh] add mongodb offline engine
2021-07-05 19:47:15 +02:00
Adam Tauber
b2ed65eb6d
[fix] initialize redis engine at the right time
2021-07-05 19:40:51 +02:00
Adam Tauber
2af7c60598
[mod] disable wikimini engine by default
2021-07-05 19:40:51 +02:00
Markus Heiser
cbc50a9bc5
[fix] google-news engine - KeyError: 'hl in request
...
Since we added
- 1c67b6aec [enh] google engine: supports "default language"
there is a KeyError: 'hl in request,error pattern::
ERROR:searx.searx.search.processor.online:engine google news : exception : 'hl'
Traceback (most recent call last):
File "searx/search/processors/online.py", line 144, in search
search_results = self._search_basic(query, params)
File "searx/search/processors/online.py", line 118, in _search_basic
self.engine.request(query, params)
File "searx/engines/google_news.py", line 97, in request
if lang_info['hl'] == 'en':
KeyError: 'hl'
Closes: https://github.com/searxng/searxng/issues/154
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-03 16:53:31 +02:00
Markus Heiser
98a63058e5
[fix] google answers: normalize space of the answers.
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-03 16:53:31 +02:00
Markus Heiser
412677d495
[mod] google engine: reduce mobile UI parameters to what is needed
...
Reverse engineering shows that not all of the parameters used by google's mobile
UI (aka "more results" button) are needed [1].
[1] https://github.com/searxng/searxng/pull/160#issuecomment-865013625
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-07-03 16:53:31 +02:00