Search results

json-tokenizer

A streaming JSON tokenizer

• stream
• streaming
• json
• tokenizer
• tokenize

floby

published 1.1.0 • 7 years agopublished 1.1.0 7 years ago

trustami-ai

A connector for the Trustami.AI API.

• ai
• nlp
• trustami
• summarize
• sentiment
• language
• keywords
• named entities
• entities
• tokenize

trustami

published 1.0.4 • a year agopublished 1.0.4 a year ago

@laosb/dioscuri

A gemtext (`text/gemini`) parser with support for streaming, ASTs, and CSTs

• dioscuri
• castor
• pollux
• gemini
• gemtext
• document
• parse
• tokenize
• lexer
• stream
• ast
• cts

laosb

published 1.1.0-laosbpatch.0 • 3 years agopublished 1.1.0-laosbpatch.0 3 years ago

snapdragon-token

Create a snapdragon token. Used by the snapdragon lexer, but can also be used by plugins.

• ast
• capture
• compile
• compiler
• convert
• lex
• lexer
• parse
• parser
• render
• snapdragon
• token
• tokenize
• transform

jonschlinkert

published 4.0.0 • 6 years agopublished 4.0.0 6 years ago

hyntax

Straightforward HTML parser for Node.js and browser

• html
• parser
• html5
• html5 parser
• htmlparser
• html parser
• html tree-constructor
• html to JSON
• html to AST
• html tokenizer
• tokenize
• tokenizer
• stream parsing
• stream parser
• View more

garmash

published 1.1.9 • 4 years agopublished 1.1.9 4 years ago

excel-formula-tokenizer

Tokenize Excel formulas

• excel
• formula
• parse
• tokenize

psalaets

published 3.0.0 • 3 years agopublished 3.0.0 3 years ago

lexr

Lexical analyzer built in Javascript

• lex
• lexer
• lexical
• analysis
• scan
• scanner
• scanning
• token
• tokenize
• tokenizer
• flex
• language support
• built in
• javascript

zsmoore

published 1.0.4 • 6 years agopublished 1.0.4 6 years ago

snapdragon-scanner

Easily scan a string with an object of regex patterns to produce an array of tokens. ~100 sloc.

• ast
• compile
• compiler
• convert
• node
• parse
• parser
• render
• scan
• scanner
• snapdragon
• token
• tokenize
• tokenizer

jonschlinkert

published 1.0.0 • 6 years agopublished 1.0.0 6 years ago

token-sort

tokenize sort string

• sort
• tokenize
• token

icai

published 1.0.4 • 6 years agopublished 1.0.4 6 years ago

qb-json-tok

Fast (~300 MB/sec) and light (~1.3 kb) JSON/UTF-8 tokenizer for creating custom parsers

• JSON
• UTF8
• UTF-8
• parse
• tokenize
• fast
• partial files
• error
• repair
• recovery
• small

mvoss9000

published 2.2.2 • 7 years agopublished 2.2.2 7 years ago

qb-json-tok-writer

Quick writer for transforming tokenized JSON back into JSON/UTF-8 output (works with qb-json-tok)

• JSON
• UTF-8
• UTF8
• write
• tokenize

mvoss9000

published 2.1.1 • 8 years agopublished 2.1.1 8 years ago

tokenize-insa-station-name

Get search tokens from an INSA/NASA station name.

• normalize
• tokenize
• search
• insa
• saxony-anhalt
• public transport
• transit

derhuerst

published 1.1.0 • 5 years agopublished 1.1.0 5 years ago

ogden

Basic English tokenizer

• token
• tokenize
• tokenization
• words

avoidwork

published 1.0.6 • 8 years agopublished 1.0.6 8 years ago

extract-comment

Uses esprima to extract line and block comments from a string of JavaScript. Also optionally parses code context (the next line of code after a comment).

• ast
• block
• code
• comment
• comments
• context
• esprima
• extract
• glob
• javascript
• line
• parse
• tokenize
• tokens

thecatshidog

published 1.1.1 • 6 years agopublished 1.1.1 6 years ago

ppx-sedlex

Binary wrapper for Sedlex_ppx - A lexer generator for OCaml, similar to ocamllex, but supporting Unicode.

• BuckleScript
• ReasonML
• OCaml
• CLI
• bin
• binary
• PPX
• AST
• transpiler
• tool
• codegen
• syntax
• parsing
• parser
• View more

elliottcable

published 20.0.0 • 5 years agopublished 20.0.0 5 years ago

glsl-100-to-300

transpiles GLSL tokens from v100 to v300 es

• glsl
• es
• 300
• webgl2
• webgl
• gl
• stackgl
• glslify
• token
• tokenize

mattdesl

published 1.2.0 • 9 years agopublished 1.2.0 9 years ago

hyntax-yx

Straightforward HTML parser for Node.js and browser

• html
• parser
• html5
• html5 parser
• htmlparser
• html parser
• html tree-constructor
• html to JSON
• html to AST
• html tokenizer
• tokenize
• tokenizer
• stream parsing
• stream parser
• View more

yexi

published 1.0.9 • 2 years agopublished 1.0.9 2 years ago

tokenizer-of-html

A HTML tokenizer

• html
• tokenize

sunnylost

published 1.0.2 • 8 years agopublished 1.0.2 8 years ago

json-operations

json-operations allows you to work with JSON, parse in a standardized way, get tokenize JSON, etc...

• json
• util
• utilities
• operations
• token
• tokenize
• tokenizer
• parser
• JSON.parse
• JSON

hhoca

published 0.0.6 • 2 years agopublished 0.0.6 2 years ago

@sedeh/tagbox

Have you ever been in need of a tag box that can provide many built in functionalities that suites you needs? TagBox is built with Angular 4+ code and is developed specifically without needing to use ngModel to avoid an existing bug in Angular which makes

• angular 6+
• tags
• tagger
• tagging
• tokenize
• tokenizer
• widget
• autocomplete tagger
• image tagger
• audio tagger
• video tagger

msalehisedeh

published 3.0.0 • 7 months agopublished 3.0.0 7 months ago