Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Leak and Extra Logging #23

Open
surfrock66 opened this issue Jan 15, 2018 · 0 comments
Open

Data Leak and Extra Logging #23

surfrock66 opened this issue Jan 15, 2018 · 0 comments

Comments

@surfrock66
Copy link
Owner

Diagnosing an issue. I noticed my UI got super slow, so I started looking at the dataset. I was considering splitting raw_logs into new tables by year just to improve lookup speed, when I noticed something...Here's the number of raw_logs per year:

  • 2014: 112,093
  • 2015: 781,507
  • 2016: 1,215,115
  • 2017: 13,541,123
  • 2018 (as of January 15): 1,028,641

Looking at a sample track, there's a clear issue:

image

So, it seems that there is an issue ending tracks. If I export the same track from the torque trip in the app, it's a csv with just the correct information.

I'm going to peruse the apache logs to see what the data upload looks like and see why the track is continuously logging despite CLEARLY being done. Also I'm gonna come up with some sort of delete command which will purge logs where the car is clearly off, stopped, and in the same location for more than, say, 30 seconds. I would hate to have to write a daemon for that, but if I can't find a root cause that may be the right solution.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant