Search results

460 packages found

Input field with tagging/token/chip capabilities written in raw JavaScript

published 1.5.2 2 years ago
M
Q
P

Turns a string into tokens.

published 1.4.2 5 years ago
M
Q
P

Tokenize JavaScript

published 0.2.2 3 years ago
M
Q
P

String scanner.

published 0.2.0 9 years ago
M
Q
P

Rich text and markdown tokenization made easy.

published 1.0.13 10 months ago
M
Q
P

A text tokenizing library that handles strings, by tokenizing them into arrays, depending on intended format, like sentences, sub sentences, paragraphs, words...

published 1.1.2 4 days ago
M
Q
P

A CLI command for converting JSX files into standard JS.

published 2.2.1 a year ago
M
Q
P

This project is about to implement a simple javascript parser and visualize the ast

published 1.0.9 2 years ago
M
Q
P

Enhances comprehension for MindScript-powered models by tokenizing text.

published 0.0.1 10 months ago
M
Q
P

a lightweight no-dependency fork of transformers.js (only tokenizers)

published 1.0.6 24 days ago
M
Q
P
M
Q
P

A super fast html-parser stream that outputs tag, text and closing nodes.

published 1.2.0 5 years ago
M
Q
P

Takes in a text/file/stream and generates random sentences that sound like they could have been in the text

published 0.5.2 7 years ago
M
Q
P

Tokenizer of c-like languages.

published 2.1.0 2 years ago
M
Q
P

Create a string representation of an object or primative

published 0.1.0 10 years ago
M
Q
P

React-based typeahead and typeahead-tokenizer

published 2.0.0-alpha.8 6 years ago
M
Q
P

Toolkit to make streamable scanners and parsers.

published 0.0.5 9 years ago
M
Q
P

Tokenize a string.

published 0.2.1 4 months ago
M
Q
P

Split text into sentence strings or word arrays with Sentence Boundary Detection (SBD). Based on http://github.com/Tessmore/sbd by Fabiën Tesselaar.

published 2.0.2 7 years ago
M
Q
P

TypeScript definition for strtok3 token

published 0.3.0 3 years ago
M
Q
P