Search results

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

• llama
• llama-cpp
• llama.cpp
• bindings
• ai
• cmake
• cmake-js
• prebuilt-binaries
• llm
• gguf
• metal
• cuda
• vulkan
• grammar
• View more

giladgd

published 3.0.3 • 9 days agopublished 3.0.3 9 days ago

custom-koya-node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

• llama
• llama-cpp
• llama.cpp
• bindings
• ai
• cmake
• cmake-js
• prebuilt-binaries
• llm
• gguf
• metal
• cuda
• grammar
• json-grammar
• View more

shakeebaftab-koya

published 0.1.0 • 2 months agopublished 0.1.0 2 months ago