Search results

printable-characters

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, 💩, etc.

• string width
• string length
• real string width
• real string length
• optical string width
• printed width
• unicode
• codepoints
• code points
• strlen
• zero width
• zero width symbols
• zero width characters
• visible characters
• View more

xpl

published 1.0.42 • 6 years agopublished 1.0.42 6 years ago

happynodetokenizer

A simple, Twitter-aware tokenizer.

• tokenise
• tokenize
• tokenising
• tokenizing
• tokeniser
• tokenizer
• token
• twitter
• NLP
• language
• text
• strings
• stanford
• dlatk

phughes

published 7.1.0 • 7 months agopublished 7.1.0 7 months ago

@hgargg-0710/parsers.js

A JavaScript library for simplification the process of organization/creation of parsers/validators/code-generators of arbitrary complexity.

• parsing
• tokenizing
• validation
• generation
• maps

hgargg-0710

published 0.2.1 • 3 months agopublished 0.2.1 3 months ago

printable-characters-plus-directional

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, etc.

• string width
• string length
• real string width
• real string length
• optical string width
• printed width
• unicode
• codepoints
• code points
• strlen
• zero width
• zero width symbols
• zero width characters
• visible characters
• View more

moonty

published 1.0.36 • 7 years agopublished 1.0.36 7 years ago

sentence-tools

Tools for manipulating sentences

• sentence
• parsing
• tokenization
• tokenizing

beaugunderson

published 4.0.0 • 5 years agopublished 4.0.0 5 years ago

ksana-analyzer

convert text stream to tokens

• tokenizing
• segmentation

yapcheahshen

published 1.5.0 • 9 years agopublished 1.5.0 9 years ago