saxophone

    0.7.2 • Public • Published

    Saxophone 🎷

    Fast and lightweight event-driven streaming XML parser in pure JavaScript.

    npm version npm downloads build status coverage dependencies status

    Saxophone is inspired by SAX parsers such as sax-js and EasySax: unlike most XML parsers, it does not create a Document Object Model (DOM) tree as a result of parsing documents. Instead, it emits events for each tag or text node encountered as the parsing goes on, which makes it an online algorithm. This means that Saxophone has a low memory footprint, can easily parse large documents, and can parse documents as they come from a stream.

    The parser does not keep track of the document state while parsing and, in particular, does not check whether the document is well-formed or valid, making it super-fast (see the benchmark below).

    This library is best suited when you need to extract simple data out of an XML document that you know is well-formed. The parser will not report precise errors in case of syntax problems. An example would be reading data from an API endpoint.

    Installation

    This library works both on Node.JS and recent browsers. To install with npm:

    $ npm install --save saxophone

    Benchmark

    This benchmark compares the performance of four of the most popular SAX parsers against Saxophone’s performance while parsing a 21 KB document. Below are the results when run on a Intel® Core™ i7-7500U processor (2.70GHz, 2 physical cores with 2 logical cores each).

    Library Version Operations per second (higher is better)
    Saxophone 0.5.0 6,797 ±2.99%
    EasySax 0.3.2 7,919 ±1.21%
    node-expat 2.3.18 904 ±1.77%
    libxmljs.SaxParser 0.19.7 869 ±0.98%
    sax-js 1.2.4 634 ±2.01%
    $ git clone https://github.com/matteodelabre/saxophone.git
    $ cd saxophone
    $ npm install
    $ npm install --no-save easysax node-expat libxmljs sax
    $ npm run benchmark

    Tests and coverage

    To run tests and check coverage, use the following commands:

    $ git clone https://github.com/matteodelabre/saxophone.git
    $ cd saxophone
    $ npm install
    $ npm test
    $ npm run coverage

    Examples

    Simple example

    const Saxophone = require('saxophone');
    const parser = new Saxophone();
    
    // Called whenever an opening tag is found in the document,
    // such as <example id="1" /> - see below for a list of events
    parser.on('tagopen', tag => {
        console.log(
            `Open tag "${tag.name}" with attributes: ${JSON.stringify(Saxophone.parseAttrs(tag.attrs))}.`
        );
    });
    
    // Called when we are done parsing the document
    parser.on('finish', () => {
        console.log('Parsing finished.');
    });
    
    // Triggers parsing - remember to set up listeners before
    // calling this method
    parser.parse('<root><example id="1" /><example id="2" /></root>');

    Output:

    Open tag "root" with attributes: {}.
    Open tag "example" with attributes: {"id":"1"}.
    Open tag "example" with attributes: {"id":"2"}.
    Parsing finished.

    Streaming example

    Same example as above but with Streams.

    const Saxophone = require('saxophone');
    const parser = new Saxophone();
    
    // Called whenever an opening tag is found in the document,
    // such as <example id="1" /> - see below for a list of events
    parser.on('tagopen', tag => {
        console.log(
            `Open tag "${tag.name}" with attributes: ${JSON.stringify(Saxophone.parseAttrs(tag.attrs))}.`
        );
    });
    
    // Called when we are done parsing the document
    parser.on('finish', () => {
        console.log('Parsing finished.');
    });
    
    // stdin is '<root><example id="1" /><example id="2" /></root>'
    process.stdin.setEncoding('utf8');
    process.stdin.pipe(parser);

    Output:

    Open tag "root" with attributes: {}.
    Open tag "example" with attributes: {"id":"1"}.
    Open tag "example" with attributes: {"id":"2"}.
    Parsing finished.

    Documentation

    new Saxophone()

    Creates a new Saxophone parser instance. This object is a writable stream that will emit an event for each tag or node parsed from the incoming data. See the list of events below.

    Saxophone#on(), Saxophone#removeListener(), ...

    Manage event listeners just like with any other event emitter. Saxophone inherits from all EventEmitter methods. See the relevant Node documentation.

    Saxophone#parse(xml)

    Trigger the parsing of a whole document. This method will fire registered listeners, so you need to set them up before calling it. This is equivalent to writing xml to the stream and closing it.

    Note: the parser cannot be reused afterwards, you need to create a new instance.

    Arguments:

    • xml is an UTF-8 string or a Buffer containing the XML that you want to parse.

    This method returns the parser instance.

    Saxophone#write(xml)

    Parse a chunk of a XML document. This method will fire registered listeners so you need to set them up before calling it.

    Note: an event is emitted for a tag or a node only when it has been closed. If the chunk starts a tag but does not close it, the tag will not be reported until it is closed by a later chunk.

    Arguments:

    • xml is an UTF-8 string or a Buffer containing a chunk of the XML that you want to parse.

    Saxophone#end(xml = "")

    Write an optional last chunk then close the stream. After the stream is closed, a final finish event is emitted and no other event will be emitted afterwards. No more data may be written into the stream after closing it.

    Arguments:

    • xml is an UTF-8 string or a Buffer containing a chunk of the XML that you want to parse.

    Saxophone.parseAttrs(attrs)

    Parse a string list of XML attributes, as produced by the main parsing algorithm. This is not done automatically because it may not be required for every tag and it takes some time.

    The result is an object associating the attribute names (as object keys) to their attribute values (as object values).

    Saxophone.parseEntities(text)

    Parses a piece of XML text and expands all XML entities inside it to the character they represent. Just like attributes, this is not parsed automatically because it takes some time.

    This ignores invalid entities, including unrecognized ones, leaving them as-is.

    Events

    tagopen

    Emitted when an opening tag is parsed. This encompasses both regular tags and self-closing tags. An object is passed with the following data:

    • name: name of the parsed tag.
    • attrs: attributes of the tag (as a string). To parse this string, use Saxophone.parseAttrs.
    • isSelfClosing: true if the tag is self-closing.

    tagclose

    Emitted when a closing tag is parsed. An object containing the name of the tag is passed.

    processinginstruction

    Emitted when a processing instruction (such as <? contents ?>) is parsed. An object with the contents of the processing instruction is passed.

    text

    Emitted when a text node between two tags is parsed. An object with the contents of the text node is passed. You might need to expand XML entities inside the contents of the text node, using Saxophone.parseEntities.

    cdata

    Emitted when a CDATA section (such as <![CDATA[ contents ]]>) is parsed. An object with the contents of the CDATA section is passed.

    comment

    Emitted when a comment (such as <!-- contents -->) is parsed. An object with the contents of the comment is passed.

    error

    Emitted when a parsing error is encountered while reading the XML stream such that the rest of the XML cannot be correctly interpreted:

    • when a DOCTYPE node is found (not supported yet);
    • when a comment node contains the -- sequence;
    • when opening and closing tags are mismatched or missing;
    • when a tag name starts with white space;
    • when nodes are unclosed (missing their final >).

    Because this library's goal is not to provide accurate error reports, the passed error will only contain a short description of the syntax error (without giving the position, for example).

    finish

    Emitted after all events, without arguments.

    Contributions

    This is free and open source software. All contributions (even small ones) are welcome. Check out the contribution guide to get started!

    Thanks to:

    • Norman Rzepka for implementing the streaming API and the check for opening and closing tags mismatch.
    • winston01 for spotting and fixing an error in the parser when a tag sits astride two chunks.
    • MattGson for spotting another similar error.

    License

    Released under the MIT license. See the full license text.

    Install

    npm i saxophone

    DownloadsWeekly Downloads

    475

    Version

    0.7.2

    License

    MIT

    Unpacked Size

    47.3 kB

    Total Files

    12

    Last publish

    Collaborators

    • matteodelabre