Wondering what’s next for npm?Check out our public roadmap! »

    codsen-tokenizer
    TypeScript icon, indicating that this package has built-in type declarations

    5.5.7 • Public • Published

    codsen-tokenizer

    HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages

    Install

    npm i codsen-tokenizer

    Quick Take

    import { strict as assert } from "assert";
    import { tokenizer } from "codsen-tokenizer";
    
    const gathered = [];
    
    // it operates from a callback, like Array.prototype.forEach()
    tokenizer(`<td nowrap>`, {
      tagCb: (obj) => {
        gathered.push(obj);
      },
    });
    
    assert.deepEqual(gathered, [
      {
        type: "tag",
        start: 0,
        end: 11,
        value: "<td nowrap>",
        tagNameStartsAt: 1,
        tagNameEndsAt: 3,
        tagName: "td",
        recognised: true,
        closing: false,
        void: false,
        pureHTML: true,
        kind: null,
        attribs: [
          {
            attribName: "nowrap",
            attribNameRecognised: true,
            attribNameStartsAt: 4,
            attribNameEndsAt: 10,
            attribOpeningQuoteAt: null,
            attribClosingQuoteAt: null,
            attribValueRaw: null,
            attribValue: [],
            attribValueStartsAt: null,
            attribValueEndsAt: null,
            attribStarts: 4,
            attribEnds: 10,
            attribLeft: 2,
          },
        ],
      },
    ]);

    Documentation

    Please visit codsen.com for a full description of the API and examples.

    Contributing

    To report bugs or request features or assistance, raise an issue on GitHub.

    Licence

    MIT License

    Copyright (c) 2010-2021 Roy Revelt and other contributors

    ok codsen star

    Install

    npm i codsen-tokenizer

    DownloadsWeekly Downloads

    143

    Version

    5.5.7

    License

    MIT

    Unpacked Size

    558 kB

    Total Files

    11

    Last publish

    Collaborators

    • avatar