I’m not sure about getting this to run locally, I will get back to you once I dig deeper into how I can get it to work locally. But from the first look, it looks like the model is 8.6Gb is size so it be not ideal. However, Mistral’s Cloud API seems promising, I’ll work on adding support for that. Thanks!
Log in to comment and vote
Comments1
Vowen
Feb 5
I’m not sure about getting this to run locally, I will get back to you once I dig deeper into how I can get it to work locally. But from the first look, it looks like the model is 8.6Gb is size so it be not ideal. However, Mistral’s Cloud API seems promising, I’ll work on adding support for that. Thanks!