Niche Portobello Mushroom

    onex-parser

    0.1.0 • Public • Published

    Mercury Parser

    Mercury Parser - Extracting content from chaos

    CircleCI Greenkeeper badge Apache License MITC License Gitter chat

    The Mercury Parser extracts the bits that humans care about from any URL you give it. That includes article content, titles, authors, published dates, excerpts, lead images, and more.

    Mercury Parser powers the Mercury AMP Converter and Mercury Reader, a Chrome extension that removes ads and distractions, leaving only text and images for a beautiful reading view on any site.

    Mercury Parser allows you to easily create custom parsers using simple JavaScript and CSS selectors. This allows you to proactively manage parsing and migration edge cases. There are many examples available along with documentation.

    How? Like this.

    Installation

    # If you're using yarn 
    yarn add @postlight/mercury-parser
     
    # If you're using npm 
    npm install @postlight/mercury-parser

    Usage

    import Mercury from '@postlight/mercury-parser';
     
    Mercury.parse(url).then(result => console.log(result));
     
    // NOTE: When used in the browser, you can omit the URL argument
    // and simply run `Mercury.parse()` to parse the current page.
     

    The result looks like this:

    {
      "title": "Thunder (mascot)",
      "content": "<div><div><p>This is the content of the page!</div></div>",
      "author": "Wikipedia Contributors",
      "date_published": "2016-09-16T20:56:00.000Z",
      "lead_image_url": null,
      "dek": null,
      "next_page_url": null,
      "url": "https://en.wikipedia.org/wiki/Thunder_(mascot)",
      "domain": "en.wikipedia.org",
      "excerpt": "Thunder Thunder is the stage name for the horse who is the official live animal mascot for the Denver Broncos",
      "word_count": 4677,
      "direction": "ltr",
      "total_pages": 1,
      "rendered_pages": 1
    }

    If Mercury is unable to find a field, that field will return null.

    Mercury Parser also ships with a CLI, meaning you can use the Mercury Parser from your command line like so:

    # Install Mercury globally 
    yarn global add @postlight/mercury-parser
    #   or 
    npm -g install @postlight/mercury-parser
     
    # Then 
    mercury-parser https://postlight.com/trackchanges/mercury-goes-open-source

    License

    Licensed under either of the below, at your preference:

    Contributing

    For details on how to contribute to Mercury, including how to write a custom content extractor for any site, see CONTRIBUTING.md

    Unless it is explicitly stated otherwise, any contribution intentionally submitted for inclusion in the work, as defined in the Apache-2.0 license, shall be dual licensed as above without any additional terms or conditions.

    Install

    npm i onex-parser

    DownloadsWeekly Downloads

    1

    Version

    0.1.0

    License

    MIT

    Unpacked Size

    14.6 MB

    Total Files

    562

    Last publish

    Collaborators

    • onexdata