Create a HuggingFaceLLM #249
Description
Create a HuggingFaceLLM rather than just use OpenAILLM for vLLM models, in such way we can provide HF's tokenizer. Currently we are just using tiktokens.
{{ message }}
Create a HuggingFaceLLM rather than just use OpenAILLM for vLLM models, in such way we can provide HF's tokenizer. Currently we are just using tiktokens.