Installation
Bash
$ npm install scrappepper
Features
- Friendly text, array manipulation (still under-developing)
- Simplified file exporting : CSV file
- Scalable for applying on the webscrapping application development
How to use
For JS,
var pepper = ;
generateCsv( json, exportFileConfig )
• Function(s): export to the CSV file
• fields: if valued as [], function will grap the json data structure by ownself. • nested: defaulted as true.
// [ Simply use ] var exportFileConfig = exportFullPath: 'exports/bigdata.csv' ; pepper; // [ Advanced use ] var exportFileConfig = exportFullPath: 'exports/bigdata.csv' fields: // OR [ANY fieldnames u liked, but should matched with the key(s) in JSON!!] nested: true pepper;
arrayChunk( array, counter )
• Function(s): Chunk 1D-array by counter, and returns 2D-array
• array: 1D-array • counter: number of values your want to group with and put them on the 2nd level array.
arrayDividend( array, partitionString )
• Function(s): Also return 2D-array, but the 1D-array chunked by the indication of "partitionString".
// [ Simply use ] var array = 'abc' 'def' 'partition' 'asdfaf' 'partition' 'akdslkasnm' 'mkljtor' console; // RESULT >> // [ ['abc', 'def'], ['asdfaf'], ['akdslkasnm', 'mkljtor'] ]
arrayMode( array )
• Function(s): Return the most frequent / mode value (string)
// [ Simply use ] var array = 'abc' 'def' 'partition' 'asdfaf' 'partition' 'akdslkasnm' 'mkljtor' console; // RESULT >> // 'partition'
arrayRemoveByValue( array, value )
• Function(s): Remain all array, except the value.
// [ Simply use ] var arr = 'a' 'b' 'c' 'd' 'a'; console; // RESULT >> // [ 'b', 'c', 'd' ]
strConvert( string )
• Function(s): Convert all sequence of characters
// [ Simply use ] console; // RESULT >> // 'cba'
strContain( fullString, comparingString )
• Function(s): Return ture or false
// [ Simply use ] console; console; // RESULT >> // true // false
strSanitized( str )
• Function(s): Remove HTML DOM entitles and decode the HTML names.
// [ Simply use ] console; // RESULT >> // 'abc & laksj'
strClassify2Arr( targetedString, regexType, spliter )
• Function(s): Get the string, return the array after the regexType classification.
• regexType: 'email' / 'url' / 'website' • spliter: default as ' '
// [ Simply use ] var str = 'abc ald@gmail.com akjs13 ask@gmail.com 123123'; console; // RESULT >> // ['ald@gmail.com', 'ask@gmail.com']
Release History
- v0.0.9 23 Mar 2016
- Update the Readme.md & 'stringHelper.strSanitized'
- v0.0.7, v0.0.8 12 Oct 2015
- Update the Readme.md & github ref
- v0.0.4 ~ v0.0.6 11 Oct 2015
- Update the Readme.md
- v0.0.2, v0.0.3 09 Oct 2015
- Update the Readme.md
- v0.0.1, 09 Oct 2015
- For "jsonExportHelper", added the function as below 'generateCsv'
- For "arrayHelper", added the functions as below 'arrayChunk', 'arrayDividend', 'arrayMode', 'arrayRemoveByValue'
- For "stringHelper", added the functions as below 'strConvert ', 'strContain', 'strSanitized', 'strClassify2Arr'