15 packages found
HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages
An HTML5 lexer
A fast tokenizer/lexer core that is well tested.
Is given character suitable to be in an HTML attribute's name?
Tokenize JavaScript
Is a character on a given index a closing of an HTML attribute?
Time a JavaScript tokenizer
A simple, Twitter-aware tokenizer.
- tokenise
- tokenize
- tokenising
- tokenizing
- tokeniser
- tokenizer
- token
- NLP
- language
- text
- strings
- stanford
- dlatk
A regular expression (RexExp) stream tokenizer.
Plugin which allows your users to select multiple items from a predefined list or ajax, using autocompletion as they type to find each item.
Simple word tokeniser that ignores punctuation.
Simple, lightweight Markdown-like language with extensible grammar.
RFC1459 and IRCv3 protocol tokeniser
Tokenizes a text from left to right and returns the list of tokens with their types.
Piecinise your strings!