node package manager

nodejs-dist-indexer

nodejs-dist-indexer

An application to create nodejs.org distribution index files: index.json and index.tab

Output can be seen at:

And all subdirectories of https://nodejs.org/download/ and https://iojs.org/download/ containing downloadable tarballs and installers.

Data

For the purpose of cataloguing files within each versioned subdirectory, nodejs-dist-indexer is able to:

  • Determine the specific version of each directory (just the directory name!)
  • Determine the date the distributables were built
  • Decode filenames to determine the OS / architecture / packaging available
  • Determine the version of dependencies bundled with Node.js, including:
    • npm
    • V8
    • libuv
    • zlib
    • OpenSSL
  • Determine the NODE_MODULES_VERSION for compiled add-on compatibility
  • Determine whether the version is an LTS or not

All of this data is made available in JSON and tab-separated format.

OS / architecture / packaging specifiers used in the listings include:

  • aix-ppc64: normally .tar.gz and .tar.xz
  • headers: normally .tar.gz and .tar.xz, downloaded by node-gyp
  • linux-arm64: normally .tar.gz and .tar.xz (also known as AArch64 or ARMv8)
  • linux-armv6l: normally .tar.gz and .tar.xz
  • linux-armv7l: normally .tar.gz and .tar.xz
  • linux-ppc64le: normally .tar.gz and .tar.xz
  • linux-x64: normally .tar.gz and .tar.xz
  • linux-x86: normally .tar.gz and .tar.xz
  • osx-x64-pkg: OSX .pkg installer (64-bit only since io.js v1)
  • osx-x64-tar: normally .tar.gz and .tar.xz
  • src: normally .tar.gz and .tar.xz, full source used to build the distribution
  • sunos-x64: normally .tar.gz and .tar.xz
  • sunos-x86: normally .tar.gz and .tar.xz
  • win-x64-msi: Windows 64-bit .msi installer
  • win-x86-msi: Windows 32-bit .msi installer
  • win-x64-exe: Windows 64-bit bare node.exe, within a win-x64 directory
  • win-x86-exe: Windows 32-bit bare node.exe, within a win-x86 directory

Usage:

Create an index.json and index.tab from a given distribution directory that contains subdirectories that contain distributable files:

nodejs-dist-indexer \
  --dist /path/to/dist/directory/
  --indexjson /path/to/dist/directory/index.json
  --indextab /path/to/dist/directory/index.tab

List the type of distributable files contained within given directories:

nodejs-ls-types [-d] <directory>[ <directory> [<directory> ...]]

The -d argument is supplied if it is to only count files that have a corresponding .done file; this is used for promoting staged releases where the .done file indicates that an upload from a build server is complete.

Output looks like:

$ nodejs-ls-types latest*
latest: aix-ppc64 headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
latest-argon: headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
latest-v0.10.x: headers linux-x64 linux-x86 osx-x64-pkg osx-x64-tar osx-x86-tar src sunos-x64 sunos-x86 win-x86-exe win-x86-msi
latest-v0.12.x: headers linux-x64 linux-x86 osx-x64-pkg osx-x64-tar osx-x86-tar src sunos-x64 sunos-x86 win-x86-exe win-x86-msi
latest-v4.x: headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
latest-v5.x: headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi
latest-v6.x: aix-ppc64 headers linux-arm64 linux-armv6l linux-armv7l linux-ppc64le linux-x64 linux-x86 osx-x64-pkg osx-x64-tar src sunos-x64 sunos-x86 win-x64-msi win-x86-msi

Managed under the governance of the Node.js Build Working Group.

Copyright (c) 2016 Node.js Foundation. All rights reserved.

Licensed under MIT, see the LICENSE.md file for details