Search results

eliza-jp

Japanese Script for Eliza Interpreter

• japanese
• nlp
• tokenizer
• eliza
• weizenbaum

chigix

published 1.2.0-beta.1 • 4 years agopublished 1.2.0-beta.1 4 years ago

universal-lexer

Universal lexer, where you can pass your rules for lexical analytics

• tokenizer
• token
• lexer
• universal
• lexical
• analysis
• parser
• expression

rangoo

published 2.0.6 • 6 years agopublished 2.0.6 6 years ago

jokenizer

Tokenize javascript expressions.

• expression
• parser
• tokenizer
• evaluator
• typescript

umutozel

published 0.4.5 • 4 years agopublished 0.4.5 4 years ago

atok

Fast, easy and dynamic tokenizer for Node Streams

• tokenizer
• token
• async
• stream

pierrec

published 0.4.3 • 12 years agopublished 0.4.3 12 years ago

meta-stopwords

Combine the stopwords from multiple packages

• NLP
• segmentation
• phrases
• split
• stopword
• stream
• tokenizer
• word
• English
• Chinese
• multi
• language

beenotung

published 1.0.2 • 3 years agopublished 1.0.2 3 years ago

json-operations

json-operations allows you to work with JSON, parse in a standardized way, get tokenize JSON, etc...

• json
• util
• utilities
• operations
• token
• tokenize
• tokenizer
• parser
• JSON.parse
• JSON

hhoca

published 0.0.6 • a year agopublished 0.0.6 a year ago

@tokenizer/range

Range-request tokenizer adapter

• xhr
• http
• strtok3
• tokenizer
• RFC-7233
• range
• chunk
• byte-serving
• https
• client
• meta
• metadata
• audio
• media

borewit

published 0.5.3 • 2 years agopublished 0.5.3 2 years ago

vietnamese-stopwords

Vietnamese stopwords

• vietnamses
• duyetdev
• stopwords
• nlp
• data
• mining
• nodejs
• tokenizer

duyetdev

published 0.0.2 • 9 years agopublished 0.0.2 9 years ago

jison-es

Fork of jison that emits parsers as ES modules

• jison
• bison
• yacc
• parser
• generator
• lexer
• flex
• tokenizer
• compiler

davidgovea

published 0.4.18 • 5 years agopublished 0.4.18 5 years ago

@msnraju/lexer

Lexer

• node
• javascript
• typescript
• lexer
• scanner
• token
• tokenizer
• compiler
• parser

msnraju

published 1.0.7 • 4 years agopublished 1.0.7 4 years ago

shield-lang

An interpreted dynamic class-based programming language

• shield
• parser
• tokenizer
• type-checking
• interpreter

timo-cmd

published 0.0.1 • 4 years agopublished 0.0.1 4 years ago

parse5-wxmp

HTML parsing/serialization toolset for Node.js. WHATWG HTML Living Standard (aka HTML5)-compliant.

• html
• parser
• html5
• WHATWG
• specification
• fast
• html parser
• html5 parser
• htmlparser
• parse5
• serializer
• html serializer
• htmlserializer
• sax
• View more

rememberwz

published 3.0.3 • 7 years agopublished 3.0.3 7 years ago

source-code-tokenizer

Source code tokenizer powered by vscode

• tokenizer

ikuyadeu

published 0.1.5 • 4 years agopublished 0.1.5 4 years ago

figmage

Flexibly generate design tokens from your Figma files

• cli
• figma
• figma api
• token
• tokenizer
• design
• system
• design system
• design tokens

taskuteemu

published 0.13.1 • a month agopublished 0.13.1 a month ago

bareun

Javascript client for bareun

• bareun
• nlp
• client
• tokenizer

baikal.ai

published 1.1.0 • a year agopublished 1.1.0 a year ago

bredon-plugin-color

Bredon plugin to normalize color values

• css
• parser
• css-parser
• css-value-parser
• ast
• lexer
• tokenizer
• cssinjs
• bredon

rofrischmann

published 1.0.0 • 7 years agopublished 1.0.0 7 years ago

ts-tokenizr

String Tokenization Library for TypeScript

• string
• token
• scanner
• lexer
• tokenizer

kevinkhill

published 1.1.1 • 4 years agopublished 1.1.1 4 years ago

nai-js-tokenizer

BPE tokenizer used for the NovelAI frontend.

• gpt
• gpt2
• pile
• sentencepiece
• nerdstash
• tokenizer
• novelai

ght901

published 1.0.1 • a year agopublished 1.0.1 a year ago

stream-json-ak

fork of stream-json

• scanner
• lexer
• tokenizer
• parser
• django
• stream
• streaming
• json

ak--47

published 1.7.511 • a year agopublished 1.7.511 a year ago

react-bootstrap-typeahead-portal

React typeahead with Bootstrap styling

• auto complete
• auto suggest
• auto-complete
• auto-suggest
• autocomplete
• autosuggest
• bootstrap
• bootstrap tokenizer
• bootstrap typeahead
• bootstrap-tokenizer
• bootstrap-typeahead
• react
• react autocomplete
• react autosuggest
• View more

wv-leifel

published 5.2.2-beta4 • 2 years agopublished 5.2.2-beta4 2 years ago