itpub-crawler

ITPUB 附件下载神器

ITPUB 附件下载神器

Getting Started

Install the module with: npm install itpub-crawler

var config = require('../itpub.json');
var ITPubClient = require('../lib/itpub-crawler.js');
var client = new ITPubClient(config);

Install with cli command

$ npm install -g itpub-crawler
$ itpub --help
 
Usage: itpub <cmd> [url|keywords]
    -h                     Show usage
    --help                 Show usage
    -v                     Show version
    -version               Show version
    ls  <url> <only>       List thread
    list  <url> <only>     Show forum threads
    listfrom  <filepath> <only> Show forum threads from file
    search  <keywords>     Search forum threads
    threads                Total threads
    typeid  <typeid>       Show pages of threads filtered by typeid
      
$ itpub --version

Documentation

支持从文件读取链接：

http://www.itpub.net/forum-61-1.html

# 精华

http://www.itpub.net/forum.php?mod=forumdisplay&fid=61&filter=typeid&typeid=385&page=[1-7]

# thread页面

Examples

列出forum所有thread中的附件

console.log('Parsing ...');

client.listForumThreads(null, function(err, results) {
  if (err) {
    throw err;
  }
  
  results.forEach(function(result) {
    console.log('%s - %s', result.link.href, result.link.text);
    result.links.forEach(function(link) {
      console.log('    %s - %s', link.href, link.text);
    });
  });
});

Contributing

In lieu of a formal styleguide, take care to maintain the existing coding style. Add unit tests for any new or changed functionality. Lint and test your code using Grunt.

License

Copyright (c) 2014 pingjiang
Licensed under the MIT license.