[Java] Prepend ":job_id:<jobid>" to java-worker-<jobid>-<pid>.log to make Java logging consistent with Python #33625
Labels
enhancement
Request for new feature and/or capability
java
P1
Issue that should be fixed within a few weeks
Description
In ray 2.3, there is PR #31772 to get real job id from log file content instead of log file name. You can check log_monitor.py. If there is no job id (pattern: ":job_id:") found from log file content, then job_id field of log message object is None. For log message without job_id set, ray just blindly prints it out in console.
To make Java logging consistent with the PR #31772, we can add some logic to the end of "setupLogging" method in LoggingUtil, to write a line with content, ":job_id: real job id\n", to log file.
Use case
To make Java logging consistent with PR #31772 which seems for lazy worker binding. Otherwise, we may print too many logs from different drivers in shell console, just like issue we experienced in raydp with ray 2.3. Too many spark executors logs get printed in console.
The text was updated successfully, but these errors were encountered: