Interface to interact with multiple LLMs

Hi community,

For easier benchmarking of different LLMs(I.e. Llama, gpt) I am thinking of developing a UI which user can select their preferred LLM model from drop down, assign certain features (I.e. token length). Also functions such as user can put their prompts and upload their input files on the interface and get their response to download on the interface again.
Before making such thing, I was wondering if there any any thing similar out there and if yes please let me know.

Hi @Arash-hk
You can take a look at LM-Studio

1 Like

Hi! Also I found backyard.ai which let you use models from HuggingFace