Search results
10 packages found
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
- BPE
- encoder
- decoder
- tokenizer
- GPT
- GPT-2
- GPT-3
- GPT-3.5
- GPT-4
- NLP
- Natural Language Processing
- Text Generation
- OpenAI
- Machine Learning
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 / Claude Instant / Claude 2
- BPE
- encoder
- decoder
- tokenizer
- GPT
- GPT-2
- GPT-3
- GPT-3.5
- GPT-4
- NLP
- Natural Language Processing
- Text Generation
- OpenAI
- Machine Learning
⏳ js-tiktoken on Cloudflare Pages
Build your own vocabulary from application-specific corpus using Byte pair encoding (BPE) algorithm.
- BPE
- byte pair encoding
- algorithm
- sqlite
- browser
- cross-platform
- isomorphic
- natural language processing
- NLP
- GPT
- tokenizer
- typescript
A lightweight tokenizer for OpenAI's GPT model series. Uses OpenAI's tiktoken python package
GPT Turbo plugin that calculates your conversation size and cost
- openai
- chatgpt
- chat
- gpt
- gpt3
- gpt-3
- gpt3.5
- gpt-3.5
- gpt4
- gpt-4
- completion
- chatcompletion
- conversation
- conversation ai
- View more
Javascript BPE Encoder Decoder for GPT-2 / GPT-3. The "gpt-3-encoder" module provides functions for encoding and decoding text using the Byte Pair Encoding (BPE) algorithm. It can be used to process text data for input into machine learning models, or to
- JavaScript
- BPE
- Encoder
- Decoder
- GPT-2
- GPT-3
- Natural Language Processing (NLP)
- Text Generation
- Machine Learning
Javascript BPE Encoder Decoder for GPT-2 / GPT-3. The "gpt-3-encoder" module provides functions for encoding and decoding text using the Byte Pair Encoding (BPE) algorithm. It can be used to process text data for input into machine learning models, or to
- JavaScript
- BPE
- Encoder
- Decoder
- GPT-2
- GPT-3
- Natural Language Processing (NLP)
- Text Generation
- Machine Learning
Lightweight trimmed down encoder/decoder/tokenizer/token counter for gpt3 that is compatible with both node and browser environments
- BPE
- encoder
- decoder
- tokenizer
- GPT
- GPT-2
- GPT-3
- GPT-3.5
- GPT-4
- NLP
- Natural Language Processing
- Text Generation
- OpenAI
- Machine Learning
n8n node for working with BPE Tokens with OpenAI's GPT models in mind.