nai-js-tokenizer - npm

❤

npm

nai-js-tokenizer

1.1.0 • Public • Published 9 months ago

The BPE tokenizer used for NovelAI frontend.

Readme

Keywords

Package Sidebar

Install

npm i nai-js-tokenizer

Repository

github.com/NovelAI/nai-js-tokenizer

Homepage

github.com/NovelAI/nai-js-tokenizer

Weekly Downloads

65

Version

1.1.0

License

MIT

Unpacked Size

19 kB

Total Files

5

Last publish

9 months ago

Collaborators

Try on RunKit

Report malware