Search results
149 packages found
simple text to word tokenizer. accepts a custom regex. returns an array of tokens
published 0.0.2 6 years ago
M
Q
P
StringScanner performs lexical scanning operations on a string.
published 0.0.3 12 years ago
M
Q
P
M
Q
P
This module covers some basic nlp principles and implementations. Every implementation in this module is written as stream to only hold that data in memory that is currently processed at any step.
- nlp
- porter
- stemmer
- tokenize
- tokenizer
- stopwords
- tfidf
- idf
- frequency
- stream
- frequency distribution
- cross validation
- term frequency
published 0.2.6 8 years ago
M
Q
P
Convenient lexical scanner inspired by Ruby's StringScanner
- x-scanner
- xscanner
- stringscanner
- scanner
- string
- text
- textscanner
- lex
- lexer
- lexical
- parse
- parser
- parsing
- analysis
- View more
published 0.4.9 2 years ago
M
Q
P
Parse regular expressions into an AST.
published 0.1.0-beta 6 years ago
M
Q
P
string/array poking for pet params
published 0.6.11 10 years ago
M
Q
P
Oh No, Another Markup Language. Based on YAML, but stores considerably more object metadata.
published 0.0.4 9 years ago
M
Q
P
Tokenizer that transforms a string of sentences into an array of white-space separated strings of tokens
published 0.0.3 10 years ago
M
Q
P