Montage Dropping out on the hour, after a few hours, potential auth refresh issue #758
Labels
Comments
|
👋 Thanks for opening your first issue here! If you're reporting a 🐞 bug, please make sure you follow the issue template or I may not respond. |
|
Yes, I think these issues are related. Are you on windows desktop? |
|
Yup. Windows 10 Pro x64 Version 1803 (Build 17134.497) |
|
Can you give 1.3.035 a try |
|
Downloaded and running now... I will report back in a while to see if it happens. It takes about 2 hours for it to show itself. |
|
So its been going strong for |
|
Still good? |
|
I'll also wait for @knight-of-ni to confirm if his issue is solved. He has a similar issue, but gets a DB error. So far it looks like all of us have different errors but the end symptom is the same - the stream breaks. |
|
@pliablepixels - It ran all night without issue. Well over 14 hours. |
|
OOf... Bad news. I installed this version on my desktop, and the problem looks like it might still be there. Log below... |
|
This means zms cannot restart. Look at the ZM logs (apache error as well as syslog) |
|
So this is in my syslog, but I have nothing in my apache error logs. My apache error log LogLevel is set to "warn". Should I change it do something else to try to capture the issue? The log is actually empty. |
|
Yup, you will need to enable debug logs for zms. |
|
I get the feeling folks who are not using multi-port get this "unable to authenticate user" (you and Andy) while folks who do get the error I see. Either case looks like it is some sort of resource build up in ZM, or some auth issue related to time |
|
I'm not even sure what multi-port is? Can you shed some light on that? I will enable DEBUG in my Apache Server config for that site to see if I can capture something for you additionally. I will say though, that it's been running over 2 hours now on my desktop without issue. |
|
No, not debug in apache server. Debug in ZoneMinder. Enabled LOG_DEBUG, set a filter for Multi-port: https://medium.com/zmninja/multi-port-storage-areas-and-more-d5836a336c93 |
|
So I enabled the debug as you stated above and I now have an exponential growing number of zm_debug.log.. It's been enabled for about 2 minutes and I have 800. As for multiport, cool concept, but I don't think I need that. I don't mind the janky updates on montage. |
|
Okay, so it does looks like an auth problem at its core. Exactly at the time the streams fail, I see this in zms logs: So something is messing up auth, zms fails and stops streaming. Auth succeeds later, but for whatever reason zms doesn't start streaming till I change connkey (which is what my fix is doing) |
|
@JSylvia007 any update? My montage is working reliably. |
|
So I hadn't done any further testing due to the fact that debug mode started to fill up the server's hard drive space with debug logs. I did experience dropouts on my desktop, but my laptop runs just fine. They are basically identical machines (same windows version, same update level, etc.). I will reboot my desktop tonight when I get home from work, and will run zmNinja to determine if it still drops out. |
|
Ok thanks. Please turn Debug off - not needed now. |
|
Yea, I turned it off a while ago. So, is there a new version, or is
the 1.3.035 still the version I should be tesing on my desktop?
Like I said, it's definitely running fine on my laptop.
|
|
1.3.035 is the latest version.
|
|
Will do! To be honest, I really truly love the software so whatever I can
give back I will.
|
|
So I managed to run the desktop and still had drop-outs. I had no drop-outs on my laptop and both were running at the same time. My thought is that maybe my desktop has a configuration issue, so I plan to completely un-install and remove all configuration information and re-install tonight and rerun the test. The laptop has been rock solid. |
|
Morning @pliablepixels - Wanted to let you know that even with the newest version, 1.3.039, I still get the dropouts on my desktop. Interestingly enough, it COULD be timing (or time iteselt) related. I've included the log below. It happened at exactly 09:59:59. I've looked at server logs, I've looked at cron jobs, nothing out of the ordinary. What is the best way to ensure I wipe everything from my desktop for zmNinja? Like I said, I don't appear to be having these issues with my laptop, so it must be down to a configuration. |
|
So, summarizing your logs: The montage view reloads itself every 1hr 15 mins of running and you are saying that is when you have a problem I have no idea, but lets investigate:
|
|
So... The above settings were set already, I didn't change anything... Edit: New version installed and running @ 1134. |
|
Also are your desktop and laptop times/timezones the same? |
|
Yep. Desktop, Laptop, and Server timezone are all the same. |
|
Ok. Also, user data locations are here https://github.com/pliablepixels/zmNinja/wiki/Desktop-Tips#desktop-data-storage-locations if you want to completely remove and re-install |
Sounds good. It's running now since 1134, no dropouts. Still watching. |
|
@pliablepixels - SO right at 2pm on the dot, the problem happened. Logs below: |
|
|
|
Let's give it a shot. |
Done and Done. Been running for a few now with everything uninstalled, cleared out, and reinstalled. I re-went through the wizard. Let's see how that goes. |
|
Okay, next test (and I'm hopeful of this) Change this line in your |
Do you want me to do this now or should I wait the 2ish hours it takes for it to happen again? Also - I update via repository, so that change will get reverted at some point. |
|
Lets do this one by one
Yes, if this work, I'll do a server PR |
|
Sounds good! I will update in a bit... Edit: Happened like clockwork at 5:00p. I'm headed to dinner right now, but when I get back, I will make the change server side and re-test. |
So I just made the edit and rebooted the whole server.
|
|
@pliablepixels - I think we have a winner. Been running for 3+ hours without issue. |
|
Still good? |
pliablepixels
changed the title
pliablepixels
changed the title
|
I think we are. I closed it last night when I went to bed. I re-opened it at 0830 this morning. I will be around it all day. It "crashed" pretty regularly, (time > 2 hours, on the hour). I will give you a final "YAY" after a few more hours, but I think you've gotten it this time. |
|
ok I'll wait for the final word before I do a PR for ZM |
|
It's been going for 3 hours strong now, no issues. My plan is to let it run all day. I have an event from 1pm to 5pm here EST (it's noon now). My plan was to check in on it every now and then. If you can wait another 5-ish hours, then I'd certainly call it fixed at that point. If you don't want to wait that long, as evidence, it's never gone this long without dropping out on my desktop. |
|
yup no hurry - I'll push tomorrow |
|
Still running strong... Over 8 hours without an issue. Edit - Been almost 12 hours now. |
|
Thanks for testing/debugging - glad we finally figured it out. Closing as I think this resolves the issue. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Before you create an issue, please make sure you have read the FAQ. Common questions on API, no image etc are covered there. Please also read HOWTO REPORT ISSUES
Platform & OS Version
Windows 10 x64
The version of zmNinja you are reporting:
1.3.032 (desktop)
The version of ZoneMinder you are using:
1.32.2
Device details:
N/A - Desktop
What is the nature of your issue
BUG
Details
Basically, what happens, is after zmNinja being operational for a couple of hours, the monitors all drop out, fail to refresh, and it requires me to exit and re-open zmNinja. I am currently trying to get exact times, but I don't yet have them.
It happens on its own. Just leave zmNinja running and eventually it will happen.
I've posted a screenshot of what happens.
This could be a duplicate of #757 but I'm not sure. I looked through my web logs and I don't see any of those entries.
Debug Logs (if applicable)
Thanks!
The text was updated successfully, but these errors were encountered: