@gorhill/s14e-serializer

Structured-Cloneable to Unicode-Only serializer/deserializer

Serialize/deserialize JavaScript data to/from well-formed Unicode strings.

The resulting string is meant to be small. As a result, it is not human-readable, though it contains only printable ASCII characters -- and possibly Unicode characters beyond ASCII.

The resulting JS string will not contain characters which require escaping should it be converted to a JSON value. However it may contain characters which require escaping should it be converted to a URI component.

Note: strings are serialized as is, so if they contain non-printable ASCII characters or characters which requires escaping, then the result of the serialization will reflect this.

Characteristics:

• Serializes/deserializes data to/from a single well-formed Unicode string
• Strings do not require escaping, i.e. they are stored as-is
• Supports multiple references to same object
• Supports reference cycles
• Supports synchronous and asynchronous API
• Optionally supports LZ4 compression

Motivation

The browser does not expose an API to serialize structured-cloneable types into a single string. JSON.stringify() does not support complex JavaScript objects, and does not support references to composite types. Unless the data to serialize is only JS strings, it is difficult to easily switch from one type of storage to another.

Serializing to a well-formed Unicode string allows to store structured-cloneable data to any storage. Not all storages support storing binary data, but all storages support storing Unicode strings.

Data types	String	JSONable	structured-cloneable
document.cookie	Yes	No	No
localStorage	Yes	No	No
IndexedDB	Yes	Yes	Yes
browser.storage	Yes	Yes	No
Cache API	Yes	No	No

The above table shows that only JS strings can be persisted natively to all types of storage. The purpose of this library is to convert structure-cloneable data (which is a superset of JSONable data) into a single JS string.

Usage

See test/test.js for typical usage.

In Node.js:

import { serialize } from '@gorhill/s14e-serializer';

// ...

// Serialize data into string
const s1 = serialize(data1);

// Serialize and compress data into string
const s2 = serialize(data2, { compress: true });

// Write strings to some storage

// ...

import { deserialize } from '@gorhill/s14e-serializer';

// Read strings from some storage

// ...

// Restore data from string
const data1 = deserialize(s1);

// Restore data from string
const data2 = deserialize(s2);

// ...

In browser

Copy s14e-serializer.js into your project, then:

import {
    deserialize,
    deserializeAsync,
    serialize,
    serializeAsync,
} from './s14e-serializer.js';

// ...

Serializable types

• literals
  • array
  • bigint
  • boolean
  • number
  • object
  • regex
  • string
• null
• undefined
• ArrayBuffer
• Boolean
• DataView
• Date
• Map
• Number
• Object
• RegExp
• Set
• String
• TypedArray
  • Int8Array
  • Uint8Array
  • Uint8ClampedArray
  • Int16Array
  • Uint16Array
  • Int32Array
  • Uint32Array
  • Float32Array
  • Float64Array

Validation

The linter should return no errors or warnings:

npm run lint

The test suite should not fail:

npm run test

Future

Possible improvements:

• Add support for more built-in types
• Add support for checksums
• Add support for custom types
  • If so the name of the library might no longer make sense...

Contributions are welcome.