Search results
68 packages found
Sort by: Default
- Default
- Most downloaded this week
- Most downloaded this month
- Most dependents
- Recently published
An interface to the pruf network written in javascript
RWA Token SDK for the development of permissioned tokens on SVM blockchains.
Very fast Porter Stemmer implementation written in Javascript.
- porter
- stemmer
- nlp
- text-analysis
- language-processing
- linguistics
- information-retrieval
- tokenization
- algorithms
- text-search
- text-mining
- word-stemming
- javascript-nlp
- text-preprocessing
- View more
Tools for manipulating sentences
Basis Theory utility for decrypting Google Pay Tokens
Use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.
- text-distillation
- text-summarization
- text-compression
- token-management
- llm-distillery
- large-language-model
- LLM
- semantic-chunking
- text-processing
- AI-text-reduction
- openai-api
- tokenization
Salient is a natural language processing and sentiment analysis library
## How To Use
Here is a README generated from the code snippet:
- vectorizer
- machine-learning
- code-vectorization
- embedding
- ai
- artificial-intelligence
- nlp
- natural-language-processing
- code-embedding
- programming
- code-processing
- software-engineering
- tokenizer
- code-tokenizer
- View more
Taiwanese Hokkien Transliterator and Tokeniser
Basic English tokenizer
A simple iterative lexer written in TypeScript
Break down text into array of words.
A JSON parser implemented in TypeScript
- JSON
- json
- parser
- AST
- ast
- Abstract Syntax Tree
- JSON formatter
- JSON parser
- JSON tokenizer
- json formatter
- json parser
- json tokenizer
- syntax tree
- tokenization
- View more
Bedrock Tokenization Engine
Library that allows you to make payments and tokenize debit and credit cards with Niubiz.
TokenEX Node.js library for API
a wrapper around the LunaSec CLI enabling it to be used as an NPM package
A tokenizer and lemmatizer for canonical terms in text
Well typed, string transmutation via splicing, driven by definitions of regular expressions, priority match and recursive clauses