Add new Relax function to the batched model for evaluating query tokens over multiple time steps in parallel #156
Merged
masahi merged 7 commits intooctoml:batch-servingfrom masahi:model-multi-query-logitsJan 13, 2024
+365-61
Commits
Commits on Jan 11, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
