Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a dashboard that tracks timestamp issues #21484

Open
miwent opened this issue Jan 29, 2025 · 1 comment
Open

Add a dashboard that tracks timestamp issues #21484

miwent opened this issue Jan 29, 2025 · 1 comment

Comments

@miwent
Copy link
Contributor

miwent commented Jan 29, 2025

What?

Add the ability to recognize events where the timestamp field is using the time the message was received by Graylog and does not reflect the time the event described in the message occurred. Additionally:

  • it would be helpful to have an indication in the message view, and log view if possible, that provides a visual cue to customers indicating the timestamp value does not reflect the event time. This could be a distinct icon next to the timestamp, a color-coded highlight, or other visual indication.
  • it may be helpful to have a dashboard that shows the status of the timestamp operation, by source.

Why?

This feature can reduce confusion during incident response and post-mortem analysis, helping teams trust their log data more fully.

When conducting an investigation it is often important to build a timeline of events, sometimes across multiple sources/log types.

The standard behavior in Graylog is that the timestamp value reflects the time the event occurs but that cannot be the case in all events. In some cases the receipt time is used, such as when the syslog input may not be able to parse the header or there is no timestamp in the header, or when it is just not practical to attempt an extraction with inputs such as the raw HTTP input.

This solution should be adjustable in processing time, allowing the indication to be removed for cases where messages can be parsed by pipeline rules, and the event time can be extracted and applied to the timestamp field.

Your Environment

  • Graylog Version:
  • OpenSearch Version:
  • MongoDB Version:
  • Operating System:
  • Browser version:
@miwent miwent added the feature label Jan 29, 2025
@tellistone
Copy link

The correction itself, and writing the timestamp pre-correction to a field, is covered in the issue here:
https://github.com/orgs/Graylog2/projects/60?pane=issue&itemId=94793802&issue=Graylog2%7Cgraylog2-server%7C21408

Can use this issue to track the request for default dashboard.

@tellistone tellistone changed the title Recognize and Indicate Messages Where timestamp Reflects Receipt Time (Not Actual Event Time) Add a dashboard that tracks timestamp issues Feb 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants