initial_prompt for tensorrt backend

[draganjovanovich]

Hi,

Can someone point parts of code that needs to be updated so initial_prompts can be used with tensorrt backend,
and if there are some limitations why it can't be done?

Thanks.

[mlecauchois]

By default in TRTBuilderConfig the max_input_len is equal to 4 which are the default prefix tokens without initial prompt. This param should be increased for prompts.