npm

printable-characters

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, 💩, etc.

• string width
• string length
• real string width
• real string length
• optical string width
• printed width
• unicode
• codepoints
• code points
• strlen
• zero width
• zero width symbols
• zero width characters
• visible characters
• View more

xpl

published 1.0.42 • 5 years agopublished 1.0.42 5 years ago

sentence-tools

Tools for manipulating sentences

• sentence
• parsing
• tokenization
• tokenizing

beaugunderson

published 4.0.0 • 4 years agopublished 4.0.0 4 years ago

printable-characters-plus-directional

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, etc.

• string width
• string length
• real string width
• real string length
• optical string width
• printed width
• unicode
• codepoints
• code points
• strlen
• zero width
• zero width symbols
• zero width characters
• visible characters
• View more

moonty

published 1.0.36 • 5 years agopublished 1.0.36 5 years ago

happynodetokenizer

A simple, Twitter-aware tokenizer.

• tokenise
• tokenize
• tokenising
• tokenizing
• tokeniser
• tokenizer
• token
• twitter
• NLP
• language
• text
• strings
• stanford
• dlatk

phughes

published 6.1.0 • 3 months agopublished 6.1.0 3 months ago

ksana-analyzer

convert text stream to tokens

• tokenizing
• segmentation

yapcheahshen

published 1.5.0 • 7 years agopublished 1.5.0 7 years ago