107 packages found

M
Q
P

Description

Tiny JavaScript tokenizer.

Keywords

Publisher

published 6.0.09 months ago
M
Q
P

Description

transform stream to tokenize html

Keywords

Publisher

published 2.0.110 months ago
M
Q
P

Description

A simple, Twitter-aware tokenizer.

Keywords

Publisher

published 2.1.36 months ago
M
Q
P

Description

String Tokenizer for Node.js using ICU's BreakIterators

Keywords

Publisher

published 1.0.1524 days ago
M
Q
P

Description

Multilingual tokenizer that automatically tags each token with its type

Keywords

Publisher

published 5.2.36 months ago
M
Q
P

Description

A NodeJS library to tokenize strings

Keywords

Publisher

published 0.1.42 months ago
M
Q
P

Description

A replacement library for JavaScript's standard JSON functions and more

Keywords

Publisher

published 0.1.3a month ago
M
Q
P

Description

WHATWG HTML5 specification-compliant, fast and ready for production HTML parsing/serialization toolset for Node.js

Keywords

Publisher

published 2.2.63 years ago
M
Q
P

Description

lexing json

Keywords

Publisher

published 1.1.14 years ago
M
Q
P

Description

Tokenize Excel formulas

Keywords

Publisher

published 2.3.19 months ago
M
Q
P

Description

personal tokenize util

Keywords

Publisher

published 2.0.09 months ago
M
Q
P

Description

NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.

Keywords

Publisher

published 2.0.67 months ago
M
Q
P

Description

Fork: HTML parsing/serialization toolset for Node.js. WHATWG HTML Living Standard (aka HTML5)-compliant. Fork from the HTMLParseErrorWG branch.

Keywords

Publisher

published 4.0.44 months ago
M
Q
P

Description

tokenize c/c++ source code

Keywords

Publisher

published 1.0.04 years ago
M
Q
P

Description

Lexical analyzer built in Javascript

Keywords

Publisher

published 1.0.43 years ago
M
Q
P
M
Q
P

Description

Transform stream that tokenizes CSS

Keywords

Publisher

published 1.0.16 years ago
M
Q
P

Description

Simple synchronous string tokenizer using Regex

Keywords

Publisher

published 2.0.03 years ago
M
Q
P

Description

A simple iterative lexer written in TypeScript

Keywords

Publisher

published 0.7.42 years ago
M
Q
P

Description

A fast tokenizer/lexer core that is well tested.

Keywords

Publisher

published 0.2.1a year ago