Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

55555 #19

Merged
merged 258 commits into from
Nov 27, 2024
Merged

55555 #19

merged 258 commits into from
Nov 27, 2024

Conversation

81549361
Copy link
Owner

Motivation

Modifications

Checklist

  • Format your code according to the Contributor Guide.
  • Add unit tests as outlined in the Contributor Guide.
  • Update documentation as needed, including docstrings or example tutorials.

zhaochenyang20 and others added 30 commits October 30, 2024 00:39
@zhaochenyang20
Imporve openai api documents (#1827)
539df95 
Co-authored-by: Chayenne <[email protected]>
@merrymercy
Update docs (#1839)
b548801
@merrymercy
Update README.md (#1840)
3184aa9
@Ying1123
[Production] Drain requests before exit when receive SIGTERM (#1838)
4e2af03
@HaiShaw
[Performance, Hardware] MoE weights padding to AMD MI300x GPUs (#1836)
5f65e2b
@zhaochenyang20
Fix suggest edit (#1842)
4ba815b 
Co-authored-by: Chayenne <[email protected]>
@HaiShaw
[Performance, Triton Kernel Args] _decode_grouped_softmax_reducev_fwd… (
2d4ce1b 
#1845)
@ByronHsu
Make decode log interval configurable (#1847)
a7a0a68
@merrymercy
Fix mixed chunked prefill (#1850)
f7102fb
@ByronHsu
Refactor tokenizer manager (#1846)
438526a
@merrymercy
Simplify documentation in README.md (#1851)
0ab7bca
@merrymercy
Fix warnings in doc build (#1852)
d913d52
@geeker-smallwhite
delete unused character (#1855)
8ce202a
@merrymercy @hnyls2002
Fix memory leak for chunked prefill 2 (#1858)
a2e0424 
Co-authored-by: Liangsheng Yin <[email protected]>
@HaiShaw
[Build, ROCm] Dockerfile.rocm for Instinct GPUs, with package updates (…
d8e9d61 
…#1861)
@hnyls2002 @merrymercy
Fix retraction + overlap (#1860)
b9fd178 
Co-authored-by: Lianmin Zheng <[email protected]>
@zhaochenyang20
change file tree (#1859)
61cf00e 
Co-authored-by: Chayenne <[email protected]>
@ispobock
Update vocab embedding deps and add TP switch (#1856)
16eb33f
@zhyncs
minor: add human eval (#1754)
d86a2d6
@zhaochenyang20
Add vlm document (#1866)
3bf3d01 
Co-authored-by: Chayenne <[email protected]>
@zhyncs
minor: update nightly eval (#1867)
104bf26
@yichiche
[3rdparty, document] Updated Documentation that covers performance tu…
d59a478 
…ning techniques for AMD Instinct GPUs. (#1871)

Co-authored-by: root <[email protected]>
@merrymercy
Improve docs and fix the broken links (#1875)
d1b31b0
@merrymercy
Add a FAQ documentation (#1877)
a54f278
@merrymercy
Fix links in the docs (#1878)
2134f08
@merrymercy
Update docs title (#1879)
066e8a4
@merrymercy
Update docs and workflow (#1881)
2565cb0
@merrymercy
Fix doc links (#1882)
660ecb7
@rchen19
Fix incorrect context length for llama3.2-11b (#1873)
146f613
@zhaochenyang20
add native api docs (#1883)
72e979b 
Co-authored-by: Chayenne <[email protected]>
merrymercy and others added 29 commits November 25, 2024 04:58
@merrymercy
[CI] Split test cases in CI for better load balancing (#2180)
254fd13
@dependabot
Bump rustls from 0.23.16 to 0.23.18 in /rust (#2182)
5ada33f 
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@Ying1123
[feat] Refactor session control interface and add CI (#2173)
e1e595d
@ByronHsu
[router] Replace print with logger (#2183)
4d62bca
@merrymercy
Use custom allreduce w/ torch.compile (#2185)
c4336b2
@HaiShaw
[Performance]: Process affinity to CPU cores with multiple sockets su…
10189d0 
…pport (#2171)
@merrymercy
Update CI threshold (#2186)
3c5538f
@Ubospica @gittb
Update XGrammar to the latest API (#2176)
7f076c2 
Co-authored-by: Ben Gitter <[email protected]>
@ByronHsu
[router] Rust e2e test (#2184)
1f76fc6
@RinRin-32
Input_embeds support (#2052)
1aea19f
@merrymercy
[CI] Minor fix for CI (#2187)
1605ae1
@merrymercy
Rename double sparsity config file (#2188)
ea34350
@merrymercy
Release v0.3.6.post1 (#2189)
ac5a0f0
@merrymercy
Update sampler.py to skip the success check (#2197)
ba4ee37
@WrRan
remove unused imports (#2195)
e4118b1
@apemost
Remove unresolved reference 'self' (#2198)
88c7763
@WrRan
using is not not != to test None (#2196)
867e092
@zhyncs
fix: add cuda-python for xgrammar (#2199)
bc1f6fd
@zhyncs
minor: update check_env (#2201)
30ce5b5
@binarycrayon
add sglang version to get_server_info (#2206)
19f33b3
@zhyncs
docs: update adoption (#2204)
de3b67b
@ByronHsu
Bump router to 0.0.9 with better logging (#2207)
2763c0a
@ByronHsu
Fix rust warning (#2208)
0b46b95
@merrymercy
Fix flasky tests (#2212)
c754652
@Ying1123
[feat] Support session control for vision language models (#2210)
37c8a57
@merrymercy
Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it o…
a0e5874 
…ff by default (#2217)
@merrymercy
Revert "Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; t…
6997e28 
…urn it off by default" (#2221)
@merrymercy
Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it o…
fb6e04a 
…ff by default (#2222)
@merrymercy @zhyncs
Release v0.3.6.post2 (#2214)
fed4c69 
Co-authored-by: Yineng Zhang <[email protected]>
@81549361 81549361 merged commit 29a0128 into 81549361:main Nov 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.