Auto-detection of models and manual model naming for Custom APIs.
Problem: Currently, the "Custom API" setup is restrictive because it doesn't allow the user to easily specify which model is running on their local server.
Proposed Solutions:
Manual Model Name Field: Replace the "Custom Model" dropdown selection with an editable text field when "Custom API" is selected, allowing users to type the exact string for their model.
Model Discovery (Fetch Models): Add a "Fetch Models" button next to the Base URL. When clicked, Vowen should call the API’s tags endpoint (e.g.,
/api/tagsfor Ollama) and populate the "Model" dropdown with the models actually available on the user's machine.Local Provider Presets: Add specific presets for Ollama, LM Studio, and LocalAI that pre-fill the default Base URL and port.

Log in to comment and vote
Comments3
Vowen
Feb 19
@Anoir Ben Tanfous Support for this has been rolled out in v0.1.16. Thanks for the feedback!
Anoir Ben Tanfous
Apr 10
Thank you!!!
Vowen
Jan 17
Hey @Anoir Ben Tanfous , thanks for the feedback. This will definitely help improve the “Custom API” section. We will be addressing the issues mentioned and releasing it soon. Thanks!