386 packages found

M
Q
P

Tiny JavaScript tokenizer.

published 8.0.1 2 months ago
M
Q
P

A tool set for CSS: fast detailed parser (CSS → AST), walker (AST traversal), generator (AST → CSS) and lexer (validation and matching) based on specs and browser implementations

published 2.3.1 3 months ago
M
Q
P

Tokenizes a string that represents a regular expression.

published 0.5.0 6 days ago
M
Q
P

stream-json is the micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API. I

published 1.7.5 4 months ago
M
Q
P

General natural language (tokenizing, stemming (English, Russian, Spanish), part-of-speech tagging, sentiment analysis, classification, inflection, phonetics, tfidf, WordNet, jaro-winkler, Levenshtein distance, Dice's Coefficient) facilities for node.

published 6.2.0 2 months ago
M
Q
P

Chevrotain is a high performance fault tolerant javascript parsing DSL for building recursive decent parsers

published 10.5.0 11 days ago
M
Q
P

small commonmark compliant markdown parser with positional info and concrete tokens

published 3.1.0 6 months ago
M
Q
P

A promise based streaming tokenizer

published 7.0.0 8 months ago
M
Q
P

Parse PHP code from JS and returns its AST

published 3.1.4 a day ago
M
Q
P

Tokenizing strings of text. Extracting arrays of words and optionally number, emojis, tags, usernames and email addresses from strings. For Node.js and the browser. When you need more than just [a-z] regular expressions.

published 7.1.2 7 months ago
M
Q
P

A parser generator with Bison's API

published 0.4.18 6 years ago
M
Q
P

Dot notation tokenizer

published 1.3.0 8 months ago
M
Q
P

JavaScript implementation of Japanese morphological analyzer

published 0.1.2 5 years ago
M
Q
P

Tokenize CSS

published 2.1.0 a month ago
M
Q
P

r/w stream of glsl tokens

published 2.1.5 4 years ago
M
Q
P

Tokenize paragraphs into sentences, and smaller tokens.

published 1.0.1 4 years ago
M
Q
P

Isomorphic utilities for GPT-3 tokenization and prompt building.

published 1.2.0 a day ago
M
Q
P

Collection of NodeJS NLP Library for Bahasa Indonesia.

published 1.11.0 7 years ago
M
Q
P

A tokenizer for Google-like search queries

published 2.1.1 6 years ago
M
Q
P