Search results

461 packages found

Tiny JavaScript tokenizer.

published 9.0.0 5 months ago
M
Q
P

A promise based streaming tokenizer

published 8.0.0 3 days ago
M
Q
P

A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations

published 2.3.1 2 years ago
M
Q
P

Tokenize CSS

published 2.4.1 14 days ago
M
Q
P

Chevrotain is a high performance fault tolerant javascript parsing DSL for building recursive decent parsers

published 11.0.3 a year ago
M
Q
P

General natural language (tokenizing, stemming (English, Russian, Spanish), part-of-speech tagging, sentiment analysis, classification, inflection, phonetics, tfidf, WordNet, jaro-winkler, Levenshtein distance, Dice's Coefficient) facilities for node.

published 7.1.0 12 days ago
M
Q
P

small commonmark compliant markdown parser with positional info and concrete tokens

published 4.0.0 a year ago
M
Q
P

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

published 2.2.1 a day ago
M
Q
P
M
Q
P

Tokenizes a string that represents a regular expression.

published 0.5.0 a year ago
M
Q
P

stream-json is the micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API. I

published 1.8.0 a year ago
M
Q
P

a lightweight no-dependency fork of transformers.js (only tokenizers)

published 1.0.9 10 days ago
M
Q
P

Streams CSV files.

published 1.0.5 a month ago
M
Q
P

Parse PHP code from JS and returns its AST

published 3.1.5 a year ago
M
Q
P

Rich text and markdown tokenization made easy.

published 1.0.13 a year ago
M
Q
P

Fork of css-tree with all but animatable CSS properties removed

published 1.0.20 4 months ago
M
Q
P

HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages

published 7.0.25 2 months ago
M
Q
P

TDOP parser

published 10.0.2 3 months ago
M
Q
P

Is given character suitable to be in an HTML attribute's name?

published 4.0.7 6 months ago
M
Q
P

Does an HTML tag start at given position?

published 4.0.19 4 months ago
M
Q
P