❤
npm
Sign UpSign In

@just-moh-it/tiktoken-node
TypeScript icon, indicating that this package has built-in type declarations

0.1.31 • Public • Published

@just-moh-it/tiktoken-node

We use our own fork for now because we are making changes that may not be useful to everyone. For example, we add support for special tokens, and we also add support for running tokenization asynchronously with the computation happening on a different thread.

/@just-moh-it/tiktoken-node/

    Package Sidebar

    Install

    npm i @just-moh-it/tiktoken-node

    Weekly Downloads

    0

    Version

    0.1.31

    License

    none

    Unpacked Size

    40.8 kB

    Total Files

    13

    Last publish

    Collaborators

    • just-moh-it
    Try on RunKit
    Report malware