Failed to fetch QNAP stats from the NAS #31994

andilge · 2020-02-19T18:51:32Z

The problem

Constant failures fetching QNAP stats from the NAS

Environment

Home Assistant release: 0.105.5
Operating environment: Hass.io
Python release: Python 3.7.6
Component/platform: QNAP

Problem-relevant `configuration.yaml`

- platform: qnap
  host: !secret qnap_lan_ip
  port: 446
  ssl: true
  verify_ssl: false
  username: !secret qnap_username
  password: !secret qnap_password
  monitored_conditions:
  - status
  - cpu_usage
  - memory_percent_used
  - volume_percentage_used
  - cpu_temp
  - system_temp
  - network_link_status
  - network_tx
  - network_rx
  - drive_smart_status
  - drive_temp
  - volume_percentage_used

Traceback/Error logs

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/qnap/sensor.py", line 191, in update
    self.data["system_stats"] = self._api.get_system_stats()
  File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 207, in get_system_stats
    force_list=("DNS_LIST")
  File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 67, in _get_url
    self._init_session()
  File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 49, in _init_session
    if self._login() is False:
  File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 57, in _login
    result = self._execute_post_url("authLogin.cgi", data, False)
  File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 98, in _execute_post_url
    return self._handle_response(resp, **kwargs)
  File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 110, in _handle_response
    data = xmltodict.parse(resp.content, force_list=force_list)['QDocRoot']
  File "/usr/local/lib/python3.7/site-packages/xmltodict.py", line 173, in parse
    handler = _DictSAXHandler(*args, **kwargs)
TypeError: __init__() got an unexpected keyword argument 'force_list'

Additional information

I've seen this error on with previous firmware QTS 4.4.1.1146 build 20191206 and now, after update to most recent with QTS 4.4.1.1216 build 20200214.

The text was updated successfully, but these errors were encountered:

probot-home-assistant · 2020-02-19T18:56:51Z

Hey there @colinodell, mind taking a look at this issue as its been labeled with a integration (qnap) you are listed as a codeowner for? Thanks!

springstan · 2020-02-19T18:57:06Z

Thanks for filling out the issue template! 👍

andilge · 2020-02-19T18:58:30Z

never mind, thx for pointing in the right direction.

forgot to put

Link to integration documentation on our website: https://www.home-assistant.io/integrations/qnap/
but the bot got it right away.

chezpaul · 2020-02-20T06:27:08Z

I have the same problem with Home Assistant release: 0.105.5
Operating environment: Hass.io on a Pi4

QNAP
sensor:

platform: qnap
host: 192.168.1.44
username: !secret qnap_username
password: !secret qnap_password
timeout: 15
verify_ssl: false
monitored_conditions:
- status
- cpu_usage
- memory_percent_used
- network_tx
- volume_percentage_used

I own a QNAP TS251 with latest firmware.

colinodell · 2020-02-20T16:48:29Z

This error is coming from the xmltodict functionality that the underlying qnapstats library uses.

TypeError: __init__() got an unexpected keyword argument 'force_list'

I don't understand why this would be suddenly failing. Is HASS now using a different version of xmltodict which no longer has this force_list feature? I'm currently on holiday without my laptop, so if anyone could help check into this I'd appreciate it!

springstan · 2020-02-20T21:31:38Z

Not as far as I can tell, it is not a requirement for HA.
It is for some integrations though:
https://github.com/home-assistant/home-assistant/blob/ce710f1e0bce31404bdd8627452504ee050ab40b/requirements_all.txt#L2097-L2103

However, this version conforms with the requirements for qnapstats (xmltodict>=0.10.0)

colinodell · 2020-02-24T19:46:54Z

Thanks for checking on that, @springstan. I re-ran the qnapstats test suite and can confirm all tests are passing with xmltodict version 0.12.0

I also tried to replicate this issue using @chezpaul's configuration but cannot - everything works as expected. (FWIW I'm using the alternative install method of HA Supervised on a generic Linux host myself, not on a Pi)

@chezpaul or @andilge - could one of you please run pip show xmltodict and pip show qnapstats to confirm which versions of both libraries your instance is running? You should have 0.12.0 and 0.2.7 respectively.

andilge · 2020-02-24T20:51:27Z

@colinodell on my RasPi 3+ pip isn't installed, I assume you want me to run the command on the QNAP, right?

Just tried enter QNAP with bash shell and got 3 times credential mismatch (no idea why). Now my laptop's IP is banned for 24 hours. I will have to retry tomorrow. I can't temporarily dis-activate the IP filter even with QNAP admin account, it refuses to accept this config @@ Somebody interested in buying that device, I get really pi***d off by it.

Like chezpaul, I use model TS-251.

aidbish · 2020-02-27T13:40:11Z

@colinodell

Hi I ran those commands on my install of HA (docker install) and got the following results which are different to what you believe it should be

bash-5.0# pip show xmltodict
Name: xmltodict
Version: 0.4
Summary: Makes working with XML feel like you are working with JSON
Home-page: https://github.com/martinblech/xmltodict
Author: Martin Blech
Author-email: [email protected]
License: MIT
Location: /usr/local/lib/python3.7/site-packages
Requires:
Required-by: qnapstats, pyvizio, pytfiac, pysonos, PyMetno, pymediaroom, pizzapi, meteoalertapi, ibmiotf, huawei-lte-api, greenwavereality, georss-client, buienradar, aio-georss-client
bash-5.0# pip show qnapstats
Name: qnapstats
Version: 0.3.0
Summary: Python API for obtaining QNAP NAS system stats
Home-page: https://github.com/colinodell/python-qnapstats
Author: Colin O'Dell
Author-email: [email protected]
License: MIT
Location: /usr/local/lib/python3.7/site-packages
Requires: xmltodict, requests
Required-by:
bash-5.0#

aidbish · 2020-02-27T13:52:00Z

further info

ran pip install qnapstats and this reinstalled qnapstats version 3 but upgraded xmltodict to version 0.12.0
did a restart and issue persisted

ran pip install qnapstats==0.2.7
restarted and now there are no error messages and stats from qnap are again working

But i understand on next upgrade this will be reverted

chezpaul · 2020-02-28T19:10:06Z

I also updated using pip to 0.3.0 and 0.12.0 but I still get an error.

2020-02-28 11:06:46 ERROR (SyncWorker_3) [homeassistant.components.qnap.sensor] Failed to fetch QNAP stats from the NAS Traceback (most recent call last): File "/usr/src/homeassistant/homeassistant/components/qnap/sensor.py", line 191, in update self.data["system_stats"] = self._api.get_system_stats() File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 207, in get_system_stats force_list=("DNS_LIST") File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 67, in _get_url self._init_session() File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 49, in _init_session if self._login() is False: File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 57, in _login result = self._execute_post_url("authLogin.cgi", data, False) File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 98, in _execute_post_url return self._handle_response(resp, **kwargs) File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 112, in _handle_response auth_passed = data['authPassed'] KeyError: 'authPassed' 2020-02-28 11:06:46 WARNING (MainThread) [homeassistant.components.sensor] Platform qnap not ready yet. Retrying in 60 seconds.

aidbish · 2020-02-29T01:48:49Z

@chezpaul that seems like a different error

i still had issues on 0.3.0 of qnapstats
try installing 0.2.7
pip install qnapstats==0.2.7

chezpaul · 2020-02-29T02:02:55Z

Nope the didn't do the trick.
I get the same error.

2020-02-28 17:59:33 ERROR (SyncWorker_9) [homeassistant.components.qnap.sensor] Failed to fetch QNAP stats from the NAS Traceback (most recent call last): File "/usr/src/homeassistant/homeassistant/components/qnap/sensor.py", line 191, in update self.data["system_stats"] = self._api.get_system_stats() File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 207, in get_system_stats force_list=("DNS_LIST") File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 67, in _get_url self._init_session() File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 49, in _init_session if self._login() is False: File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 57, in _login result = self._execute_post_url("authLogin.cgi", data, False) File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 98, in _execute_post_url return self._handle_response(resp, **kwargs) File "/usr/local/lib/python3.7/site-packages/qnapstats/qnap_stats.py", line 112, in _handle_response auth_passed = data['authPassed'] KeyError: 'authPassed' 2020-02-28 17:59:33 WARNING (MainThread) [homeassistant.components.sensor] Platform qnap not ready yet. Retrying in 30 seconds.

And I confirm that I have 0.12.0 and 0.2.7 respectively running

chezpaul · 2020-03-01T00:20:19Z

Is there anything I need to do on the Qnap side that I missed maybe?

aidbish · 2020-03-01T01:06:06Z

i didnt have to touch qnap

larserhardsen · 2020-03-04T09:52:59Z

I also see the issue on my docker based installation.
I can confirm that I have xmltodict 0.12.0 and qnapstats 0.2.7 and see the TypeError: __init__() got an unexpected keyword argument 'force_list' in the log.

larserhardsen · 2020-03-10T07:19:37Z

I think I found the reason. Some days ago I installed the hpprinter component from HACS, and today I updated it. The release notes stated that the upgrade consisted of an upgrade to the xmldict library, from 0.4 (or so) to 0.12 - after this, the QNAP sensors works again.

aidbish · 2020-03-10T10:15:25Z

@larserhardsen Good catch, can confirm this is the case here.
I also had the HP printer integration installed. did the update and all working ok

springstan · 2020-03-10T13:38:48Z

@andilge has this solved your problem as well?

andilge · 2020-03-10T16:35:45Z

Hi all,

I did have the hp printer integration installed from HACS when reporting. In the mean time I've reinstalled HA from zero, have now reactivated QNAP installation and it works fine. After adding HP printer integration form HACS again I see both integrations work fine.

Yes, my problem has been solved. I'll close this Issue.

chezpaul · 2020-03-11T03:13:21Z

Maybe I should just add the HP Printer integration even though I don't have an HP printer. ;-)
@larserhardsen you said you had 0.12 and then you said you upgraded from 0.4 to 0.12 so which was it?

andilge mentioned this issue Feb 19, 2020

Failed to fetch QNAP stats from the NAS #31985

Closed

springstan added the integration: qnap label Feb 19, 2020

andilge closed this as completed Mar 10, 2020

This was referenced May 5, 2020

QNAP component not working anymore after upgrading from 0.108.6 to 0.109.4 #35246

Closed

xmltodict requirement might be breaking QNAP integration elad-bar/ha-hpprinter#60

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Failed to fetch QNAP stats from the NAS #31994

Failed to fetch QNAP stats from the NAS #31994

andilge commented Feb 19, 2020

probot-home-assistant bot commented Feb 19, 2020

springstan commented Feb 19, 2020

andilge commented Feb 19, 2020

chezpaul commented Feb 20, 2020 •

edited

Loading

colinodell commented Feb 20, 2020

springstan commented Feb 20, 2020

colinodell commented Feb 24, 2020

andilge commented Feb 24, 2020

aidbish commented Feb 27, 2020

aidbish commented Feb 27, 2020 •

edited

Loading

chezpaul commented Feb 28, 2020

aidbish commented Feb 29, 2020

chezpaul commented Feb 29, 2020 •

edited

Loading

chezpaul commented Mar 1, 2020

aidbish commented Mar 1, 2020

larserhardsen commented Mar 4, 2020

larserhardsen commented Mar 10, 2020

aidbish commented Mar 10, 2020

springstan commented Mar 10, 2020

andilge commented Mar 10, 2020

chezpaul commented Mar 11, 2020 •

edited

Loading

Failed to fetch QNAP stats from the NAS #31994

Failed to fetch QNAP stats from the NAS #31994

Comments

andilge commented Feb 19, 2020

The problem

Environment

Problem-relevant configuration.yaml

Traceback/Error logs

Additional information

probot-home-assistant bot commented Feb 19, 2020

springstan commented Feb 19, 2020

andilge commented Feb 19, 2020

chezpaul commented Feb 20, 2020 • edited Loading

colinodell commented Feb 20, 2020

springstan commented Feb 20, 2020

colinodell commented Feb 24, 2020

andilge commented Feb 24, 2020

aidbish commented Feb 27, 2020

aidbish commented Feb 27, 2020 • edited Loading

chezpaul commented Feb 28, 2020

aidbish commented Feb 29, 2020

chezpaul commented Feb 29, 2020 • edited Loading

chezpaul commented Mar 1, 2020

aidbish commented Mar 1, 2020

larserhardsen commented Mar 4, 2020

larserhardsen commented Mar 10, 2020

aidbish commented Mar 10, 2020

springstan commented Mar 10, 2020

andilge commented Mar 10, 2020

chezpaul commented Mar 11, 2020 • edited Loading

Problem-relevant `configuration.yaml`

chezpaul commented Feb 20, 2020 •

edited

Loading

aidbish commented Feb 27, 2020 •

edited

Loading

chezpaul commented Feb 29, 2020 •

edited

Loading

chezpaul commented Mar 11, 2020 •

edited

Loading