@ovotech/apollo-datasource-s3
    TypeScript icon, indicating that this package has built-in type declarations

    1.1.2 • Public • Published

    Apollo S3DataSource

    CircleCI npm (scoped)

    S3DataSource is responsible for fetching data from a given S3 bucket using aws js API. Integrates with the cache and expires tags on S3, following the example of Apollo Data Sources. This useful if you want to read data from a private / restricted s3 bucket.

    Using

    yarn add @ovotech/apollo-datasource-s3

    This module ships with TypeScript types. It also has helper methods to deal with JSON objects directly.

    import { S3DataSource } from '@ovotech/apollo-datasource-s3';
    import { S3 } from 'aws-sdk';
     
    class MyS3DataSource extends S3DataSource {
      async get() {
        return await this.getObjectJson({ Bucket: 'bucket', Key: 'data.json' });
      }
     
      async put(data) {
        return await this.putObjectJson(data, { Bucket: 'bucket', Key: 'test' });
      }
    }
     
    const s3 = new S3();
    const ds = new MyS3DataSource(s3);

    You can also access the lower level api to load the raw data from s3, as well as list and delete items. Those request mimic the s3 api itself, but adds a layer of caching in front of it.

    class MyS3DataSource extends S3DataSource {
      async get() {
        return await this.getObject({ Bucket: 'bucket', Key: 'data.json' });
      }
     
      async put(data) {
        return await this.putObject({ Bucket: 'bucket', Key: 'test', Body: 'data' });
      }
     
      async list() {
        return await this.listObjects({ Bucket: 'bucket' });
      }
     
      async delete() {
        return await this.deleteObject({ Bucket: 'bucket', Key: 'data.json' });
      }
    }

    Running the tests

    The tests require a running s3 mock server, and we're using localstack for that. You'll need to start the s3 server:

    SERVICES=s3 localstack start

    After which you can run all the tests:

    yarn test

    Coding style (linting, etc) tests

    Style is maintained with prettier and tslint

    yarn lint
    

    Deployment

    To deploy a new version, push to master and then create a new release. CircleCI will automatically build and deploy a the version to the npm registry.

    Contributing

    Have a bug? File an issue with a simple example that reproduces this so we can take a look & confirm.

    Want to make a change? Submit a PR, explain why it's useful, and make sure you've updated the docs (this file) and the tests (see test/S3DataSource.spec.ts). You can run the tests with SERVICES=s3 localstack start and yarn test.

    Responsible Team

    • Boost Internal Tools (BIT)

    License

    This project is licensed under Apache 2 - see the LICENSE file for details

    Keywords

    none

    Install

    npm i @ovotech/apollo-datasource-s3

    DownloadsWeekly Downloads

    90

    Version

    1.1.2

    License

    Apache-2.0

    Unpacked Size

    27.1 kB

    Total Files

    29

    Last publish

    Collaborators

    • ovo-homeplan
    • rupson
    • oeptariffs
    • nisheeth
    • fgkramer-klz
    • tony.ross
    • bvjones
    • data.discovery.ovo
    • ralitsa
    • fraserhamiltonovo
    • accrecovo
    • luigi.riefolo
    • andy-heywood-ovo
    • rmcnovo
    • mgdigital-mike
    • sureshmandalapu
    • ggerikp
    • xnejp03
    • emmapr123
    • andrew-brook-rad
    • a.calderwood
    • sulgee.kim
    • sseccombe
    • samcooper720x
    • lughino
    • vlabinskyy-corgi
    • amayuk
    • jagreenwood1
    • mbayoumy
    • radek_tomasek
    • clarencedglee
    • ovocms
    • ovotech-sme-team
    • gjain-npm-ovo
    • kenneth-gray
    • philip-ovo
    • nevenablagoeva
    • pete-woodland
    • orion-migration-team
    • ovotech-sg
    • chanex
    • ovotech-qs
    • kelveden
    • ovotech-paym
    • ovotech-payments
    • ovotech-live
    • ovotech-payg
    • freddybushboy
    • sarahlikeshiny
    • r.midyk
    • ovotech-boost
    • agaovo
    • filose
    • tomverran-ovo
    • props
    • vanyakurdup
    • yesdaveovo
    • rob-ovo
    • ellafutkowska
    • ikerin
    • mwidurek
    • andreaborsos
    • tomshawovo
    • dmytro.kubatko
    • ovotech-identity
    • mike.panayotov
    • iuna4e
    • lcatallo
    • orex-team
    • ahvargas
    • cwkaluza
    • smart-heat-uat
    • smart-heat-prod
    • potsec
    • rosario-ovo
    • tech.international
    • tozzy
    • jvmovo
    • boost-smile
    • nicolasov
    • ovo.cms.devs
    • mkohlmyr
    • sketchingdev
    • mrkiplin
    • ovo-devices
    • sophiepoole
    • joepurnell-ovo
    • gmbovo
    • molbalazs
    • joewhittles
    • sampennington64
    • marcusgriff
    • amelia.ovo
    • juliabutterly
    • chris.smith
    • sophiesillmanovo
    • marcesquerra
    • pedoublety
    • ovo-engagement
    • tokict
    • marcuskielly
    • david.chellapah.ovo
    • kupxc
    • harrisonbaxter
    • apjm
    • shnist
    • mikemchugh
    • sarahbeharry
    • ursularodgers
    • inlustra
    • andrewjtn
    • tarlingovo
    • troyb95
    • david.ovo
    • ovoenergyapps
    • marina-ovo
    • tom-g-dane
    • homemoves
    • samwest
    • sophiefield
    • simonmclean-ovo
    • jamesbaum
    • robert-g-j
    • peterwilkins
    • paceteamkaluza
    • henrywoodsend
    • ovo-oot-bot
    • stuharv-ovo
    • eddiec86
    • richardjonesovo
    • csherwin
    • g-tibbs
    • puzzledbytheweb
    • adryanovo
    • lewright
    • pedro.caldeira
    • aidenscott2016
    • keirlawson
    • dwfullerton
    • gordok
    • darrenthomas-sse
    • seagullmouse
    • markwood23
    • timsteeleovo
    • jacktreble
    • gordon-rennie-ovo
    • adam-mcdevitt
    • jkiely
    • ovo-dc
    • orion-digital-support-experience
    • ovotech-smart-thermostat
    • yahmad
    • inbrewj
    • kelemensanyi
    • wtaylor-ovo
    • jrdavenport
    • dleyland-ovo
    • rob.desbois
    • sicrossley
    • joey.ciechanowicz
    • lewisdick-ovo
    • sjmann
    • stevemossovo
    • nbrites
    • eduardolaranjo
    • unibozu
    • cp-ui-tooling
    • lenardprattovo
    • dieman89
    • jensraaby-ovo
    • anthonysmithovo
    • jacobthwaitesovo
    • tom.sherman
    • tomlloyd
    • matyas-ovo
    • jamesnoble1
    • phil-pinkowski
    • ovo-aarongibbison
    • nebuladesignsystem
    • ovo-matt-hodges
    • luke-adams-ovo
    • ovolly
    • j_kapella
    • mike.walters
    • bgzstephen
    • matthewbursteinovo
    • kslat3r
    • petro.pavlenko
    • mtardugno-ovo
    • vslepkan
    • zoelanham
    • suhaelovo
    • jchoskins
    • vholovko
    • tom.mottram.kaluza
    • anhnguyenis
    • eddwilliamsovo
    • ewan-m
    • mishabruml
    • maciek-kaluza
    • mollyboyle
    • vmary
    • babickd
    • mugishau
    • vkobyletskyi_ovo
    • mykola.p
    • peterh-ovo
    • dvidg
    • ahmediieovo
    • nickfitton-ovo
    • apgoodier
    • dave.allison
    • tom-greenwood
    • oep-accounts-bot
    • cbousie
    • j.okeefe
    • kir_exp
    • ursula_rodgers
    • jgarciapaj
    • petegrace
    • retrojetpacks
    • benaston13
    • ovo-bit-tech
    • fulvio.ovo
    • blair.calderwood.radically
    • pedromss
    • petro.shevchuk.corgi
    • v.kolesnyk
    • simonlewissse
    • benm13563
    • joolskaluza
    • s.sosnytskyi
    • vlavrynenko-nix
    • jifarra-kaluza
    • jameswelshkaluza
    • kimnil
    • carolinelywood
    • mike-gregory-kaluza
    • vasil.dininski
    • olesiapaslavska
    • sir_hiss
    • humancatfood
    • javapyscript
    • csillabarna
    • luca.sale
    • friendigo
    • oroberts221
    • pedro.costa.kaluza
    • jelaxshan
    • onishchenko
    • kevin.gilmore
    • annebeth-ovo
    • kostyagromov92
    • quartin
    • crack.design
    • georgexcollins
    • kapikaluza
    • v.vasylets
    • iovana.pavlovici
    • filosganga
    • chris.brindley
    • engagement-insights
    • hentielouw
    • jaws-bot
    • leaski
    • elliekempster91
    • zoejm
    • rekaelek-ovo
    • nathanmarshovo
    • robturnerovo
    • dsingh07
    • ovo-james
    • jthomasovo
    • vitalii_khudenko