So I have both GPT4ALL and LM Studio installed locally on my computer but I can’t seem to get CSAI to access it from my website (even though I have a port forwarded specifically for that API call, to the computer running the LLMs locally).
GPT4ALL doesn’t even seem to get any “outside connections” (apparently that’s a known limitation of GPT4ALL so I don’t see how anyone can use it in CSAI unless their whole website is running locally) but I can connect to LM Studio… however I’m getting the error:
OpenAI Error : {“error”:"‘messages’ field is required"}
Any ideas on this? I would prefer to use a local LLM than pay for OpenAI’s API usage.
thanks!