Accept variable-length batch prompts for Whisper #2895

Job	Run time
build-and-push-docker-images	26m 42s
build-python-wheels (ubuntu-20.04, auto64)	1m 52s
build-and-test-cpp-x86_64 (ubuntu-20.04, mkl)	2m 12s
build-python-wheels (windows-2019, auto64)	1m 58s
build-and-test-cpp-aarch64 (openblas)	3m 4s
build-and-test-cpp-x86_64 (ubuntu-20.04, dnnl)	2m 1s
check-python-style	9s
build-python-wheels (ubuntu-20.04, aarch64)	1m 57s
build-python-wheels (macos-12, arm64)	1m 37s
test-python-wheels	0s
build-and-deploy-docs	0s
publish-python-wheels-on-pypi	0s
	41m 32s

Provide feedback