15 packages found
An HTML5 lexer
- html5
- compliant
- html
- lexer
- tokeniser
- tokenizer
- parser
- start-tag
- end-tag
- element
- attribute
- attribute-name
- attribute-value
Time a JavaScript tokenizer
HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages
Is given character suitable to be in an HTML attribute's name?
Is a character on a given index a closing of an HTML attribute?
A fast tokenizer/lexer core that is well tested.
Tokenize JavaScript
A simple, Twitter-aware tokenizer.
- tokenise
- tokenize
- tokenising
- tokenizing
- tokeniser
- tokenizer
- token
- NLP
- language
- text
- strings
- stanford
- dlatk
A regular expression (RexExp) stream tokenizer.
Simple word tokeniser that ignores punctuation.
Simple, lightweight Markdown-like language with extensible grammar.
RFC1459 and IRCv3 protocol tokeniser
Plugin which allows your users to select multiple items from a predefined list or ajax, using autocompletion as they type to find each item.
Tokenizes a text from left to right and returns the list of tokens with their types.
Piecinise your strings!