@mapbox/node-cpp-skel

0.2.0 • Public • Published

dancing skel Build Status codecov

A skeleton for building a C++ addon for Node.js. This is a small, helper repository that generates simple HelloWorld Javascript example constructors. The examples have a number of methods to demonstrate different ways to use the Node C+ API for building particular types of functionality (i.e. asynchronous functions). Use this repo as both a template for your own code as well as a learning tool if you're just starting to develop Node/C++ Addons.

Why port C++ to Node.js?. That's a great question! C++ is a high performance language that allows you to execute operations without clogging up the event loop. Node.js is single-threaded, which blocks execution. Even in highly optimized javascript code it may be impossible to improve performance. Passing heavy operations into C++ and subsequently into C++ workers can greatly improve the overall runtime of the code. Porting C++ code to Node.js is also referred to as creating an "Addon".

More examples of how to port C++ libraries to node can be found at nodejs.org/api/addons.html.

What's in the box? 📦

This repository itself can be cloned and edited to your needs. The skeleton prepares a C++ port to Node.js and provides the following for quick development:

  • Tests: created with Tape in the test/ directory. Travis CI file is prepared to build and test your project on every push.
  • Documentation: use this README as a template and customize for your own project. Also, this skeleton uses documentation.js to generate API documentation from JSDOC comments in the .cpp files. Docs are located in API.md.
  • Benchmarking: Easily test the performance of your code using the built-in benchmark tests provided in this skeleton.
  • Build system: node-pre-gyp generates binaries with the proper system architecture flags
  • Publishing: Structured as a node module with a package.json that can be deployed to NPM's registry.
  • Learning resources: Read the detailed inline comments within the example code to learn exactly what is happening behind the scenes. Also, check out the extended tour to learn more about Node/C++ Addon development, builds, Xcode, and more details about the configuration of this skeleton.

Installation

Each make command is specified in Makefile

git clone git@github.com:mapbox/node-cpp-skel.git
cd node-cpp-skel

# Build binaries. This looks to see if there were changes in the C++ code. This does not reinstall deps.
make

# Run tests
make test

# Cleans your current builds and removes potential cache
make clean

# Build binaries in Debug mode (https://github.com/mapbox/cpp/blob/master/glossary.md#debug-build)
make debug

# Cleans everything, including the things you download from the network in order to compile (ex: npm packages).
# This is useful if you want to nuke everything and start from scratch.
# For example, it's super useful for making sure everything works for Travis, production, someone else's machine, etc
make distclean

# This skel uses documentation.js to auto-generate API docs.
# If you'd like to generate docs for your code, you'll need to install documentation.js,
# and then add your subdirectory to the docs command in package.json
npm install -g documentation@4.0.0
npm run docs

NOTE: we are pinned to documentation@4.0.0 because 5.x removed C++ support: https://github.com/documentationjs/documentation/blob/master/CHANGELOG.md#500-2017-07-27

Customizing the compiler toolchain

By default we use clang++ via mason. The reason we do this is:

  • We want to run the latest and greatest compiler version, to catch the most bugs, provide the best developer experience, and trigger the most helpful warnings
  • We use clang-format to format the code and each version of clang-format formats code slightly differently. To avoid friction around this (and ensure all devs format the code the same) we default to using the same version of clang++ via mason.
  • We want to support LTO in the builds, which is difficult to do on linux unless you control the toolchain tightly.

The version of the clang++ binary (and related tools) is controlled by the mason-versions.ini, and uses mason-js uses to install the toolchain.

All that said, it is still absolutely possible and encouraged to compile your module with another compiler toolchain. In fact we hope that modules based on node-cpp-skel do this!

To customize the toolchain you can override the defaults by setting these environment variables: CXX, CC, LINK, AR, NM. For example to use g++-6 you could do:

export CXX="g++-6"
export CC="gcc-6"
export LINK="g++-6"
export AR="ar"
export NM="nm"
make

These environment variables will override the compiler toolchain defaults in make_global_settings in the binding.gyp.

Warnings as errors

By default the build errors on compiler warnings. To disable this do:

WERROR=false make

Sanitizers

You can run the sanitizers, to catch additional bugs, by doing:

make sanitize

The sanitizers are part of the compiler and are also run in a specific job on Travis.

Add Custom Code

Depending on your usecase, there are a variety of ways to start using this skeleton for your project.

Setup new project

Easily use this skeleton as a starting off point for a new custom project:

# Clone node-cpp-skel locally

git clone git@github.com:mapbox/node-cpp-skel.git
cd node-cpp-skel/

# Create your new repo on GitHub and have the remote repo url handy for liftoff
# Then run the liftoff script from within your local node-cpp-skel root directory.
#
# This will:
# - prompt you for the new name of your project and the new remote repo url
# - automatically create a new directory for your new project repo
# - create a new branch called "node-cpp-skel-port" within your new repo directory
# - add, commit, and push that branch to your new repo

./scripts/liftoff.sh

Add your code

Once your project has ported node-cpp-skel, follow these steps to integrate your own code:

  • Create a dir in ./src to hold your custom code. See the example code within /src for reference.
  • Add your new method or class to ./src/module.cpp, and #include it at the top
  • Add your new file-to-be-compiled to the list of target sources in ./binding.gyp
  • Run make and see what surprises await on your new journey

Adding dependencies

With updated versions of npm, a package-lock.json file is created, which is now included in node-cpp-skel. See npm-and-package-lock.md for more info on how to interact with this file and how to add new dependencies.

Interactive Debugging

Code coverage

Code coverage is critical for knowing how well your tests actually test all your code. To see code coverage you can view current results online at codecov or you can build in a customized way and display coverage locally like:

make coverage

Note

Use // LCOV_EXCL_START and // LCOV_EXCL_STOP to ignore from codecov remotely. However, this won't ignore when running coverage locally.

For more details about what make coverage is doing under the hood see https://github.com/mapbox/cpp#code-coverage.

Contributing and License

Contributors are welcome! This repo exists as a place to gather C++/Node Addon knowledge that will benefit the larger community. Please contribute your knowledge if you'd like.

Node-cpp-skel is licensed under CC0. Attribution is not required, but definitely welcome! If your project uses this skeleton, please add the node-cpp-skel badge to your readme so that others can learn about the resource.

badge

To include the badge, paste this into your README.md file:

[![badge](https://mapbox.s3.amazonaws.com/cpp-assets/node-cpp-skel-badge_blue.svg)](https://github.com/mapbox/node-cpp-skel)

See CONTRIBUTING and LICENSE for more info.

Readme

Keywords

none

Package Sidebar

Install

npm i @mapbox/node-cpp-skel

Weekly Downloads

1

Version

0.2.0

License

ISC

Unpacked Size

1.19 MB

Total Files

53

Last publish

Collaborators

  • mbx-npm-ci-production
  • mbx-npm-ci-staging
  • mbx-npm-advanced-actions-production
  • mbx-npm-advanced-actions-staging
  • mbx-npm-09-production
  • mbx-npm-08-production
  • mbx-npm-07-production
  • mbx-npm-06-production
  • mbx-npm-05-production
  • mbx-npm-04-production
  • mbx-npm-03-production
  • mbx-npm-02-production
  • mbx-npm-01-production
  • mbx-npm-02-staging
  • mapbox-npm-01
  • mapbox-npm-02
  • mapbox-npm-07
  • mapbox-npm-03
  • mapbox-npm-04
  • mapbox-npm-09
  • mapbox-npm-05
  • mapbox-npm-06
  • mapbox-npm-08
  • mapbox-npm-advanced-actions
  • mapbox-npm-ci
  • mapbox-npm
  • mapbox-admin
  • mapbox-machine-user