Naturally Processed Meals

    @narando/nest-xray
    TypeScript icon, indicating that this package has built-in type declarations

    2.0.0 • Public • Published

    @narando/nest-xray

    This module implements Distributed Tracing with AWS X-Ray for Nest.js services.

    Features

    • Supported Environments
      • HTTP (express.js)
    • Clients
      • HttpService/HttpModule
    • Manually create new Subsegments to trace custom functions

    Usage

    ⚠️ If you want to use @narando/nest-xray with NestJS Version 6 or 7, please use the v1 release.

    The v2 release is only compatible with NestJS Version 8 and @nestjs/axios package.

    Installation

    Install this module and aws-xray-sdk:

    $ npm i @narando/nest-xray aws-xray-sdk

    Initialization

    Register the TracingModule with your app module:

    import { TracingModule } from "@narando/nest-xray";
    
    @Module({
      imports: [TracingModule.forRoot({ serviceName: "your-service-name" })],
    })
    export class AppModule {}

    Environments

    An environment is responsible for automatically reading the trace metadata from the incoming request (if available), creating a segment for the processing that happens in the service and recording additional metadata about the request.

    There are multiple available environment candidates in Nest.js. By default most applications use the HTTP application model, where they define a @Controller and use express or fastify in the background.
    For this application type, the HttpEnvironment tries to read an existing trace segment from the X-Amzn-Trace-Id, and then creates a new segment and adds the URL and other information about the request to the segment. This segment is then made available throughout the request, Clients can now read the segment and add subsegment for the calls that are made through them.

    The HttpEnvironment is activated by default in @narando/nest-xray.

    Currently no other environments are supported.

    If you are interested in contributing:

    Building and supporting more environments would greatly improve the usefulness of this package.

    Potential environments could be:

    • @nestjs/graphql
    • @nestjs/websockets
    • @nestjs/microservices
    • AWS Lambda - where the trace metadata is presented in environment variables, see #67

    Http

    The HttpEnvironment checks whether the X-Amzn-Trace-Id header is set and valid, and then creates a segment that references this origin trace. When the request succeeds or fails, the environment adds the current time and the success/error status to the segment.

    This environment is mostly implemented through the express middleware of the official aws-xray-sdk

    Clients

    To trace calls made to a different service, you can either use a premade client, or use the TracingService#createSubSegment method to manually instrument the client of your choosing. The premade clients will automatically create a subsegment for all requests made, and track the duration and response code.

    HttpService

    This client is a drop-in replacement for the HttpService from @nestjs/axios.

    To use it, you must only replace the imports like this:

    - import { HttpModule } from "@nestjs/axios"
    + import { HttpTracingModule } from "@narando/nest-xray"
    
     @Module({
       imports: [
    -    HttpModule.registerAsync({
    +    HttpTracingModule.registerAsync({
           useFactory: async (config: ConfigService) => ({
             baseURL: config.get("api.base_url"),
             timeout: config.get("api.http_timeout"),
             headers: {
               "user-agent": config.get("api.http_user_agent")
             }
           }),
           inject: [ConfigService]
         })
       ],
       providers: [APIService],
       exports: [APIService]
     })
     export class APIModule {}

    Keep using HttpService as before, and all requests are traced as Subsegment and the necessary header for the downstream service is added to the the request.

    Custom Tracing

    If the premade clients are not sufficient or you want more control, you can use the TracingService.

    You can use it to create new subsegments and to access the currently set segment and subsegment.

    Once you have access to a segment/subsegment, you can add any data you want to it.

    import { TracingService } from "@narando/nest-xray";
    
    @Injectable()
    export class ExternalAPIClient {
      constructor(
        private readonly client: ExternalModule,
        private readonly tracingService: TracingService
      ) {}
    
      async doThing() {
        // Create Subsegment for any Function
        const subSegment = this.tracingService.createSubSegment("external-doThing");
    
        let response;
    
        try {
          response = await client.doThing();
        } catch (err) {
          subSegment.close(err);
          throw err;
        }
    
        subSegment.close();
      }
    }

    Implementation

    We use async_hooks to store the traces and aws-xray-sdk to interact with AWS X-Ray.

    async_hooks

    This module uses the Node.js API async_hooks to persist the Segment without having to explicitly pass it around to every function involved. It is what enables the "automatic" part of this module.

    This API is currently not considered stable, though I have not yet seen any issues (besides slightly worse performance) from using it. This stability is currently being worked on in nodejs/diagnostics#124.

    AsyncContext

    AsyncContext is an experimental integration of async_hooks into the Nest.js ecosystem. It was initially developed by Kamil Mysliwiec in nestjs/nest#1407 but not merged because async_hooks are not yet stable.

    I adopted his implementation into this module for following reasons:

    a) It implements all the hard parts with async_hooks and provides enough functionality for our use cases. b) It was developed by the Nest.js Maintainer and is proposed to be merged into Nest.js. If this happens, we may be able to switch to the official implementation without changing any usages of the module.

    TracingCoreModule

    The TracingCoreModule combines the AsyncContext with the official AWSXRay client. It exports the TracingService, that can be used by other modules to implement additional tracing behaviour (e.g. tracing outgoing http requests).

    Known Bugs

    • The XRay Daemon Address can only be configured through the environment variable.

    License

    This repository is published under the MIT License.

    Keywords

    none

    Install

    npm i @narando/nest-xray

    DownloadsWeekly Downloads

    1,835

    Version

    2.0.0

    License

    MIT

    Unpacked Size

    175 kB

    Total Files

    96

    Last publish

    Collaborators

    • apricote
    • brandolpho
    • marcmogdanz
    • narandosystem