Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setting ulimit for rsyslog #42

Merged
merged 1 commit into from
Feb 2, 2024

Conversation

benibr
Copy link
Contributor

@benibr benibr commented Jan 24, 2024

tl;dr

I experienced the problem that rsyslogd won't start inside the container. I spare you all the different workarounds, trial-on-errors, frustration and strace sessions. In the end it come down to ulimits. So this PR introduces a NOFILE=1024 for rsyslogd inside the docker containers.

The underlying problem is neither Migrid nor Docker but the fact that rsyslog preventively closes all possible file descriptors during startup. What the actual f**k!? On macOS and RHEL the limit usually equals ~1 billion. To try to close all those non open FDs it takes more that 60s, then rsyslogs kills itself because its child process doesn't respond. Well I guess that makes sense though.
See detailed explanation and upstream fix:
rsyslog/rsyslog#5158 (comment)
https://github.com/rsyslog/rsyslog/pull/5230/files

Should be fixed in rsyslog 8.2310.0. But on Rocky8 and Rocky9 8.2102.0 is used.

@jonasbardino jonasbardino merged commit e363e22 into ucphhpc:master Feb 2, 2024
1 check passed
@jonasbardino
Copy link
Contributor

We haven't run into this one ourselves, but thanks for tracking it down and providing a fix @benibr

@jonasbardino jonasbardino self-requested a review February 2, 2024 11:01
@jonasbardino jonasbardino self-assigned this Feb 2, 2024
@jonasbardino jonasbardino added the bug Something isn't working label Feb 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants