[Text Generation] Turn off the (currently) inefficient external KV cache logic when internal KV cache management enabled#1175
Merged
dbogunowicz merged 99 commits intomainfrom feature/damian/optimize_update_kv_cacheAug 28, 2023
+61-29
Commits
Commits on Jul 20, 2023
- committed
Commits on Jul 24, 2023
- authored
- committed
- committed
Commits on Jul 25, 2023
- committed
- committed
Commits on Jul 31, 2023
Commits on Aug 1, 2023
Commits on Aug 2, 2023
Commits on Aug 3, 2023
Commits on Aug 4, 2023
- committed
- committed
Merge remote-tracking branch 'origin/tests/damian/decoder_kv_cache' into tests/feature/nl_dec_engine
committed- committed
- committed
Commits on Aug 7, 2023
- authored
- committed
- committed
- committed
- authored
- authored
- authored
- authored
- authored
Commits on Aug 8, 2023
- authored
- authored
- committed
- committed
- committed
- committed
- committed
- authored
- committed
- authored
- authored
- authored
- committed
Commits on Aug 9, 2023
- committed
Merge branch 'feature/damian/backward_comp_no_causal_mask_models' of https://github.com/neuralmagic/deepsparse into feature/damian/backward_comp_no_causal_mask_models
committed- committed
- authored
- authored
- committed
- committed
- authored
- authored
- committed
- authored
- authored
Commits on Aug 10, 2023
- committed
- committed
- committed
- authored
- committed
- committed
- authored
- committed
Merge branch 'feature/damian/optimize_update_kv_cache' of https://github.com/neuralmagic/deepsparse into feature/damian/optimize_update_kv_cache
committed- authored
- committed
- committed
Commits on Aug 16, 2023
Commits on Aug 17, 2023
- committed
Commits on Aug 18, 2023
Commits on Aug 23, 2023
- authored
- authored
- authored
- committed
- authored
- authored
- committed
- authored
Merge branch 'feature/damian/optimize_update_kv_cache' of https://github.com/neuralmagic/deepsparse into feature/damian/optimize_update_kv_cache
committed