Adding streaming function to mistralrs server.

[Narsil]

No description provided.

[github-actions]

Code Metrics Report

  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 C Header                2           35           28            0            7
 Dockerfile              1           41           22           10            9
 JSON                   12          105          104            0            1
 Python                 63         2706         2339           70          297
 Shell                   1           57           22           18           17
 Plain Text              3         3723            0         2413         1310
 TOML                   18          598          532            2           64
 YAML                    2           21           19            2            0
-------------------------------------------------------------------------------
 Jupyter Notebooks       4            0            0            0            0
 |- Markdown             2           77           32           31           14
 |- Python               2          205          178            1           26
 (Total)                            282          210           32           40
-------------------------------------------------------------------------------
 Markdown               43         3324            0         2520          804
 |- BASH                 6          101           98            0            3
 |- JSON                 1           12           12            0            0
 |- Python               7          121          109            0           12
 |- Rust                12          406          344            0           62
 |- TOML                 2           75           63            0           12
 (Total)                           4039          626         2520          893
-------------------------------------------------------------------------------
 Rust                  286        87338        78450         1790         7098
 |- Markdown           138         1483           25         1350          108
 (Total)                          88821        78475         3140         7206
===============================================================================
 Total                 435        97948        81516         6825         9607
===============================================================================
  

[EricLBuehler]

Thank you for the PR! Can you please add a quick example of using this new API?

[Narsil]

I added it here: https://github.com/EricLBuehler/mistral.rs/pull/986/files#diff-f5353372481ead383ebfd7ee987dac8fa54f0cc82d81fcce2a03526de5e801bbR79-R88

Where else do you think it should be added ?

[EricLBuehler]

Can you please add it as an example here: https://github.com/EricLBuehler/mistral.rs/tree/master/mistralrs/examples ?

[Narsil]

Done

[EricLBuehler]

Thank you!