@pezzo/llm-toolkit

@pezzo/llm-toolkit

LLM Toolkit is a collection of llm providers and utilities.

Installation

npm install @pezzo/llm-toolkit

Usage

import { OpenAIToolkit } from "@pezzo/llm-toolkit";

Get model pricing

const { promptCostPer1000Tokens, completionCostPer1000Tokens } =
  OpenAIToolkit.gptModels["gpt-3.5-turbo"];

Calculate cost of a prompt

// the modelName parameter is fully typed, you'll be able to see a a list with the available models

const cost = OpenAIToolkit.calculateGptCost(
  promptTokens,
  completionTokens,
  modelName
);

Note: The model name is fully typed, you'll be able to see a list with the available models.

Available Providers

• OpenAI