[fix] FutureWarning from lxml

Just in case if content is None, the original code will skip extract_text(), and
just append the None value to 'content'. So just add allow_none=True, and this
will return None without raising a ValueError in extract_text().
This commit is contained in:
capric98 2022-04-15 20:14:09 +08:00 committed by Noémi Ványi
parent 27db4e33e4
commit b959c990df
1 changed files with 1 additions and 2 deletions

View File

@ -135,8 +135,7 @@ def response(resp):
content = eval_xpath_getindex(
result, './/div[contains(@class, "compText")]', 0, default=''
)
if content:
content = extract_text(content)
content = extract_text(content, allow_none=True)
# append result
results.append({'url': url,