huggingface-tokenizers-bindings

0.1.0 • Public • Published

tokenizers-js

js-like interface on top of tokenizers-wasm.

The main inconvenience of binding rust to wasm is that rust traits can't be converted to js class inheritance. So this is a wrapper around the wasm bindings to get a more js-like API.

Readme

Keywords

Package Sidebar

Install

npm i huggingface-tokenizers-bindings

Weekly Downloads

1

Version

0.1.0

License

(MIT OR Apache-2.0)

Unpacked Size

13.1 kB

Total Files

5

Last publish

Collaborators

  • mbrunel