AtomPackagesArchive
This is a CLI application that can allow you to backup all exisitng packages from Atom.io
There are 9,241 packages or 416 pages paginated at 30 items of content.
Obviously I am using this to keep an archive myself. But HIGHLY recommend anyone else that has some disk space to spare to also archive this data. We don't want one possible failure causing this data to be lost.
Stats
Paginated data when complete creates a folder about 30MB large. With 832 files, comprising of the Paginated Content and Header Content of each page.
The Packages data creates a single file about 27MB large with all 9,241 packages in an array.
Usage
Install:
npm install -g @confused-techie/atompackagesarchive
Use:
atompackagesarchive
Additionally now AtomPackagesArchive supports the choice of what to backup.
This can be specified with the backup option.
atompackagesarchive --backup=OPTION
The following options are valid:
- ALL
Backs up everything its able to.
- PAGINATED
Backs up ONLY paginated files of all available packages.
- PACKAGES
Backs up ONLY the complete package file.
- WEB
Attempts to back up all web pages, and all web page resources.
! UNDER DEVELOPMENT !
Details
Paginated & Package Data
After making an initial request to determine the last page to grab it will request each page incremented by one until it has requested each page.
Once a page has been requested it will attempt to start saving data its received, and afterwards ask the new concocted packages data be written again. If this process fails it will wait 2 seconds multiplied by the number of failures until it has failed 50 times at which point the program exits. While saving data the output to the screen will show each page being saved very likely not in numerical order. It will show it in the order data is received.