Search results
15 packages found
Time a JavaScript tokenizer
published 1.1.0 7 years ago
M
Q
P
HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages
published 7.0.24 a month ago
M
Q
P
Is given character suitable to be in an HTML attribute's name?
published 4.0.7 4 months ago
M
Q
P
Is a character on a given index a closing of an HTML attribute?
published 4.0.19 a month ago
M
Q
P
A fast tokenizer/lexer core that is well tested.
published 0.2.2 3 years ago
M
Q
P
Tokenize JavaScript
published 0.2.2 3 years ago
M
Q
P
A simple, Twitter-aware tokenizer.
- tokenise
- tokenize
- tokenising
- tokenizing
- tokeniser
- tokenizer
- token
- NLP
- language
- text
- strings
- stanford
- dlatk
published 7.1.0 2 months ago
M
Q
P
An HTML5 lexer
- html5
- compliant
- html
- lexer
- tokeniser
- tokenizer
- parser
- start-tag
- end-tag
- element
- attribute
- attribute-name
- attribute-value
published 0.0.9 9 months ago
M
Q
P
An HTML5 lexer
- html5
- compliant
- html
- lexer
- tokeniser
- tokenizer
- parser
- start-tag
- end-tag
- element
- attribute
- attribute-name
- attribute-value
published 0.5.0 a year ago
M
Q
P
Simple word tokeniser that ignores punctuation.
published 0.0.5 10 years ago
M
Q
P
A regular expression (RexExp) stream tokenizer.
published 0.2.2 8 years ago
M
Q
P
Simple, lightweight Markdown-like language with extensible grammar.
published 0.0.1 12 years ago
M
Q
P
RFC1459 and IRCv3 protocol tokeniser
published 2.0.0 3 years ago
M
Q
P
Tokenizes a text from left to right and returns the list of tokens with their types.
published 1.1.2 7 years ago
M
Q
P
Piecinise your strings!
published 0.0.1 9 years ago
M
Q
P