npm

codsen-tokenizer

HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages

• ast
• codsen
• css
• html
• lexer
• lint
• parse
• parsing
• processing
• token
• tokeniser
• tokenizer

royston

published 6.0.20 • 12 days agopublished 6.0.20 12 days ago

html-lexer

An HTML5 lexer

• html5
• compliant
• html
• lexer
• tokeniser
• tokenizer
• parser

alwinb

published 0.4.1 • 5 months agopublished 0.4.1 5 months ago

complexion

A fast tokenizer/lexer core that is well tested.

• tokenizer
• tokeniser
• tokenize
• tokenise
• lexer
• token
• lex
• parser
• fast

fidian

published 0.2.2 • a year agopublished 0.2.2 a year ago

is-char-suitable-for-html-attr-name

Is given character suitable to be in an HTML attribute's name?

• attribute
• character
• codsen
• emlint
• for
• html
• is
• lexer
• name
• parsing
• suitable
• tag
• tokeniser
• tokenizer

royston

published 3.1.1 • a month agopublished 3.1.1 a month ago

complexion-js

Tokenize JavaScript

• complexion
• javascript
• tokenizer
• tokeniser
• tokenize
• tokenise
• lexer
• token
• lex
• parser
• fast

fidian

published 0.2.2 • a year agopublished 0.2.2 a year ago

is-html-attribute-closing

Is a character on a given index a closing of an HTML attribute?

• attribute
• character
• codsen
• emlint
• end
• ending
• ends
• html
• is
• lexer
• parsing
• tag
• tokeniser
• tokenizer

royston

published 3.0.16 • 12 days agopublished 3.0.16 12 days ago

complexion-time-map

Time a JavaScript tokenizer

• complexion
• tokenizer
• tokeniser
• tokenize
• tokenise
• profile

fidian

published 1.1.0 • 5 years agopublished 1.1.0 5 years ago

happynodetokenizer

A simple, Twitter-aware tokenizer.

• tokenise
• tokenize
• tokenising
• tokenizing
• tokeniser
• tokenizer
• token
• twitter
• NLP
• language
• text
• strings
• stanford
• dlatk

phughes

published 5.0.2 • 8 months agopublished 5.0.2 8 months ago

regexp-stream-tokenizer

A regular expression (RexExp) stream tokenizer.

• streams
• through
• through2
• tokenizer
• tokeniser
• regexp
• regex

jramsay

published 0.2.2 • 6 years agopublished 0.2.2 6 years ago

tokenize2

Plugin which allows your users to select multiple items from a predefined list or ajax, using autocompletion as they type to find each item.

• tokenizer
• tokeniser
• tokenize
• tokenise
• tags
• taggify
• keywords

zellerda

published 1.3.5 • a year agopublished 1.3.5 a year ago

tkn

Simple word tokeniser that ignores punctuation.

• word
• tokeniser
• tokenizer
• nlp
• token

waltercarvalho

published 0.0.5 • 8 years agopublished 0.0.5 8 years ago

duckdown

Simple, lightweight Markdown-like language with extensible grammar.

• markdown
• language
• text
• duck
• duckdown
• ast
• compiler
• tokeniser
• feather
• feathers

Christopher Giffard

published 0.0.1 • 10 years agopublished 0.0.1 10 years ago

irctokens

RFC1459 and IRCv3 protocol tokeniser

• irc
• ircv3
• rfc1459
• tokeniser

swantzter

published 2.0.0 • 10 months agopublished 2.0.0 10 months ago

js-tokeniser

Tokenizes a text from left to right and returns the list of tokens with their types.

• token
• tokenizer
• tokeniser

jschirrmacher

published 1.1.2 • 5 years agopublished 1.1.2 5 years ago

pieciniser

Piecinise your strings!

• pieciniser
• tokeniser
• language
• esolang
• estoric

stephanmeijer

published 0.0.1 • 7 years agopublished 0.0.1 7 years ago