llm-load-balancer

0.5.3 • Public • Published 13 days ago

A small npm package enabling load balancing LLM prompts between models, regions, hosting platforms and even individual model configurations.

Usage

npm install llm-load-balancer

npm i llm-load-balancer

0.5.3

MIT

48.1 kB

13 days ago

Try on RunKit

Report malware