Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

希望未来能导出一些Prometheus指标，监控worker或模型的负载 #908

Closed
zhanghx0905 opened this issue Jan 18, 2024 · 3 comments
Closed

希望未来能导出一些Prometheus指标，监控worker或模型的负载 #908

zhanghx0905 opened this issue Jan 18, 2024 · 3 comments
Milestone
v0.8.1

Comments

@zhanghx0905
Copy link
Contributor

vllm 就导出了一些有用的监控指标。

https://docs.vllm.ai/en/latest/serving/metrics.html

这个feature能提高分布式系统的可观测性。这些指标能被Prometheus捕获，由Grafana可视化。
@XprobeBot XprobeBot added this to the v0.8.1 milestone Jan 18, 2024
@qinxuye
Copy link
Contributor

qinxuye commented Jan 18, 2024

#906

有个 PR 已经在做了。

@zhanghx0905
Copy link
Contributor Author

#906

有个 PR 已经在做了。

感谢

@ChengjieLi28
Copy link
Contributor

Close this since #906 has been merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
v0.8.1
Development

No branches or pull requests
4 participants
@qinxuye @zhanghx0905 @ChengjieLi28 @XprobeBot