Search results

lexerific

• lexer
• parser
• compiler
• tokens
• tokenizer

loverly

published 0.0.7 • 9 years agopublished 0.0.7 9 years ago

overview-js-tokenizer

Splits text into tokens in as many languages as possible, using libicu

• token
• word
• tokenize
• tokenizer
• natural
• language
• processing
• text
• icu
• libicu

adamhooper

published 0.1.0 • 9 years agopublished 0.1.0 9 years ago

clove-lang

A class-oriented programming-language

• clove
• parser
• tokenizer
• type-checking
• interpreter

timo-cmd

published 2.0.5 • 4 years agopublished 2.0.5 4 years ago

codemirror-textmate

Textmate based tokenization for CodeMirror

• codemirror
• textmate
• tm
• tokenizer
• highlighter

sweetslush

published 1.1.0 • 3 years agopublished 1.1.0 3 years ago

tokenstream

Asynchronous tokenizer (stream scanner) powered by Streams 2 Transform stream

• token
• tokenizer
• stream
• scanner

lengo-org

published 0.1.1 • 7 years agopublished 0.1.1 7 years ago

regexp-lexer

RegExp based lexer

• regexp
• lexer
• scanner
• tokenizer
• parsing
• parser

angrycoding

published 0.0.10 • 7 years agopublished 0.0.10 7 years ago

@sethfowler/css-tree

CSSTree is a tool set to work with CSS, including fast detailed parser (string->AST), walker (AST traversal), generator (AST->string) and lexer (validation and matching) based on knowledge of spec and browser implementations

• css
• ast
• tokenizer
• parser
• walker
• lexer
• generator
• utils
• syntax
• validation

sethfowler

published 1.0.0-alpha.41 • 5 years agopublished 1.0.0-alpha.41 5 years ago

natural-ff

Minor modifications to the original `natural` node package: General natural language (tokenizing, stemming (English, Russian, Spanish), part-of-speech tagging, sentiment analysis, classification, inflection, phonetics, tfidf, WordNet, jaro-winkler, Levens

• natural language processing
• artifical intelligence
• statistics
• Porter stemmer
• Lancaster stemmer
• tokenizer
• bigram
• trigram
• quadgram
• ngram
• stemmer
• bayes
• classifier
• phonetic
• View more

sudotong

published 0.6.3 • 5 years agopublished 0.6.3 5 years ago

bredon-validate

Validation Methods for CSS values

• css
• parser
• css-parser
• css-value-parser
• ast
• lexer
• tokenizer
• validation
• validator
• cssinjs
• bredon

rofrischmann

published 0.0.3 • 6 years agopublished 0.0.3 6 years ago

jeefo_tokenizer

jeefo tokenizer

• jeefo
• token
• tokenizer

je3f0o

published 0.0.37 • 5 years agopublished 0.0.37 5 years ago

kotlin-ace-worker

A Kotlin/JS wrapper for the Ace code editor - web worker environment classes.

• kotlin
• ace
• wrapper
• syntax highlighting
• tokenizer

daemontus

published 1.3.36 • 6 years agopublished 1.3.36 6 years ago

@silvestre/kuromoji

JavaScript implementation of Japanese morphological analyzer

• japanese
• morphological analyzer
• nlp
• pos
• pos tagger
• tokenizer

justinsilvestre

published 0.3.0 • 4 years agopublished 0.3.0 4 years ago

react-bootstrap-4-typeahead

React-based typeahead using the Bootstrap theme

• bootstrap
• bootstrap-tokenizer
• bootstrap-typeahead
• react
• react-bootstrap
• react-bootstrap-tokenizer
• react-bootstrap-typeahead
• tokenizer
• typeahead

alexanderkuzmin

published 0.9.0 • 7 years agopublished 0.9.0 7 years ago

unicode-tokenizer

Unicode Tokenizer for line breaking.

• tokenizer
• tokens
• unicode
• line breaking
• tr14
• natural language processing
• nlp

bramstein

published 1.1.0 • 12 years agopublished 1.1.0 12 years ago

mesosphere-react-typeahead

React-based typeahead component

• bootstrap
• bootstrap-tokenizer
• bootstrap-typeahead
• react
• react-bootstrap
• react-bootstrap-tokenizer
• react-bootstrap-typeahead
• tokenizer
• typeahead

daiyi

published 0.8.3 • 8 years agopublished 0.8.3 8 years ago

node-tokenizer

A tokenizer written in JavaScript.

• tokenizer
• token
• lex
• lexer
• lexical
• analysis

wangstabill

published 0.0.0 • 11 years agopublished 0.0.0 11 years ago

@exabugs/kuromoji

JavaScript implementation of Japanese morphological analyzer

• japanese
• morphological analyzer
• nlp
• pos
• pos tagger
• tokenizer

exabugs

published 0.2.27 • 6 years agopublished 0.2.27 6 years ago

twokenize

Nodejs port and update of Jason Baldrige's Twokenize with layers for common twitter patterns

• twitter
• tokenizer

nyxtom

published 0.1.0 • 11 years agopublished 0.1.0 11 years ago

nlpo3

Node.js binding for nlpO3 Thai language processing library

• thai
• tokenizer
• nlp
• rust
• word-segmentation

bact

published 0.2.1 • 3 years agopublished 0.2.1 3 years ago

@jeefo/tokenizer

JeefoTokenizer library for generating lexical tokens

• jeefo
• je3f0o
• token
• tokenizer

jeefo

published 0.0.6 • 4 years agopublished 0.0.6 4 years ago