HF Inference Endpoint - for openAI compatible audio streaming
#14
by sandorkonya - opened
Hi there,
great results!
It would be awesome to have a simple deployable HF inference endpoint (like the vllm demo, but on HF) that could provide an openAI compatible endpoint to stream to.
regards