examples of Deno+Llamacpp
Are there examples of Deno and Ollama/Llamacpp setups in typescript?
Its should t be hard since it just an api call to the instance with Docker.
Essentially I want to demonstrate if we can have a CUDA or MPS enabled image of llamacpp or ollama, as an api over the internet, and query it directly via a deno/fresh app running on Deno deploy or railway
Its should t be hard since it just an api call to the instance with Docker.
Essentially I want to demonstrate if we can have a CUDA or MPS enabled image of llamacpp or ollama, as an api over the internet, and query it directly via a deno/fresh app running on Deno deploy or railway
