gse-wasm

WebAssembly efficient text segmentation; support english, chinese, japanese and other.

简体中文

Based on go-ego/gse 。

Dictionary with double array trie (Double-Array Trie) to achieve, Sender algorithm is the shortest path based on word frequency plus dynamic programming, and DAG and HMM algorithm word segmentation.

Support common, search engine, full mode, precise mode and HMM mode multiple word segmentation modes, support user dictionary, POS tagging.

Support HMM cut text use Viterbi algorithm.

Install

npm install gse-wasm

Usage

example.js

Chinese Text Segmentation Demo

Japanese Text Segmentation Demo

Build

(Go 1.13 or above should be installed)

npm run build:all

Authors

• Xmader

• Contributors

License

Gse Wasm is primarily distributed under the terms of both the MIT license and the Apache License (Version 2.0), thanks to sego and jieba.