contort

Contortionist

Control what LLMs can, and can't, say.

Install

npm install contortionist

Usage

import Contortionist from 'contortionist';
const grammar = 'root ::= "foo"';
const contortionist = new Contortionist({
  grammar,
  model: {
    protocol: 'llama.cpp',
    endpoint: 'http://localhost:4445',
  },
});

const result = await contortionist.execute(prompt, {
  n: 40,
  stream: true,
  callback: ({ partial }) => {
    output.textContent = partial;
  }
});