Upgrade auf unsere Diamond service und bauen wir Ihnen Ihre eigene app für Android oder iOS
Self, AIML, and scripting

implementation of local LLM on local install of Bot Libre Community Edition.

durch invzame gepostet May 29, 14:50

I have a local install of CE installed on docker. Its running great with no issues. My question is, in SELF, is there any way I can integrate a locally running LLM running on PyTorch to my bot? Another idea I had was to also try and make an inference API call on one of the pretrained models on huggingface and I haven't been able to get that to work either. I'm new to self and I'm kind of scratching my head with this problem. 


by admin posted May 30, 8:18
You will need to create a web API to expose your Python API such as using the Flask Python web server.
You can then call the web API from Self.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 171, today: 0, week: 2, month: 7

Id: 47685232
Gepostet: May 29, 14:50
Antworten: 1
Ansichten: 182, heute: 1, Woche: 4, Monat: 9
0 0 0.0/5