You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[SERVICE]
Flush 5
Daemon Off
Log_Level debug
Parsers_File parsers.conf
Plugins_File plugins.conf
HTTP_Server On
HTTP_Listen 0.0.0.0
HTTP_Port 2020
[INPUT]
name tail
path /fluent-bit/logs/siem-data.log
tag test_stream
# Read_from_head true
Parser json
Refresh_Interval 5
Buffer_Max_Size 5MB
Buffer_Chunk_Size 400k
[OUTPUT]
Name kinesis_firehose
Match test_stream
region us-west-2
delivery_stream my-localstack-firehose-stream
I using the Logger (Logging package for Python) in Django for producing logs into log file, using fluent-bit collect that log files and send it to firehose
Problem:
[2024/12/23 04:21:07] [debug] [input:tail:tail.0] scanning path /fluent-bit/logs/siem-data.log
[2024/12/23 04:21:07] [debug] [input:tail:tail.0] scan_blog add(): dismissed: /fluent-bit/logs/siem-data.log, inode 13
[2024/12/23 04:21:07] [debug] [input:tail:tail.0] 0 new files found on path '/fluent-bit/logs/siem-data.log'
[2024/12/23 04:21:12] [debug] [input:tail:tail.0] scanning path /fluent-bit/logs/siem-data.log
[2024/12/23 04:21:12] [debug] [input:tail:tail.0] scan_blog add(): dismissed: /fluent-bit/logs/siem-data.log, inode 13
[2024/12/23 04:21:12] [debug] [input:tail:tail.0] 0 new files found on path '/fluent-bit/logs/siem-data.log'
[2024/12/23 04:21:17] [debug] [input:tail:tail.0] scanning path /fluent-bit/logs/siem-data.log
[2024/12/23 04:21:17] [debug] [input:tail:tail.0] scan_blog add(): dismissed: /fluent-bit/logs/siem-data.log, inode 13
[2024/12/23 04:21:17] [debug] [input:tail:tail.0] 0 new files found on path '/fluent-bit/logs/siem-data.log'
[2024/12/23 04:21:22] [debug] [input:tail:tail.0] scanning path /fluent-bit/logs/siem-data.log
[2024/12/23 04:21:22] [debug] [input:tail:tail.0] scan_blog add(): dismissed: /fluent-bit/logs/siem-data.log, inode 13
[2024/12/23 04:21:22] [debug] [input:tail:tail.0] 0 new files found on path '/fluent-bit/logs/siem-data.log'
[2024/12/23 04:21:27] [debug] [input:tail:tail.0] scanning path /fluent-bit/logs/siem-data.log
Fluent bit can not detect the new log from log file
Some Additional information:
I try to manually paste log into the log files with editor (eg: VSCode) and it still worked
Do this problem relate to the offset make the Fluent bit can not detect the new logs
Could you help me to solve this problem and please help me explain how it is triggered
Thanks a lot guys.
The text was updated successfully, but these errors were encountered:
Bug Report
Describe the bug
This is my config
I using the Logger (Logging package for Python) in Django for producing logs into log file, using fluent-bit collect that log files and send it to firehose
Problem:
Fluent bit can not detect the new log from log file
Some Additional information:
I try to manually paste log into the log files with editor (eg: VSCode) and it still worked
Do this problem relate to the offset make the Fluent bit can not detect the new logs
Could you help me to solve this problem and please help me explain how it is triggered
Thanks a lot guys.
The text was updated successfully, but these errors were encountered: