Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove KV pairs with duplicate keys from logs #1509

Closed

Conversation

eugene-babichenko
Copy link
Contributor

slog do not take care of duplicate keys in KV list which leads to errors
in log parsing, DedupDrain deals with such keys.

Fix #1499

@eugene-babichenko eugene-babichenko added bug Something isn't working subsys-logging A-jormungandr Area: Issues affecting jörmungandr labels Jan 6, 2020
slog do not take care of duplicate keys in KV list which leads to errors
in log parsing, DedupDrain deals with such keys.
@eugene-babichenko eugene-babichenko force-pushed the remove-duplicate-kv-from-log-entries branch from 3a2a294 to 00c8f19 Compare January 6, 2020 20:25
Copy link
Contributor

@mzabaluev mzabaluev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's better to just remove the instances where this occurs than add extra CPU overhead to solve what are clearly programmer errors.

@eugene-babichenko
Copy link
Contributor Author

eugene-babichenko commented Jan 8, 2020

@mzabaluev I believe that this is an actual error/missing feature in the logging subsystem. There can be cases when we need to create a new task from the existing one and set an appropriate task name for the logger in this task.

We can use something like "task" => "task1", "subtask" => "task1.1" (I see this being done in a couple of places). Which do you think is better?

@eugene-babichenko
Copy link
Contributor Author

Closing in favor of #1533

@eugene-babichenko eugene-babichenko deleted the remove-duplicate-kv-from-log-entries branch February 11, 2020 09:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-jormungandr Area: Issues affecting jörmungandr bug Something isn't working subsys-logging
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Jormungandr - logs - poldercast / policy log task / sub_task
2 participants