A crawler for various popular tech news sources. Read technology news from the comfort of your CLI.
Routers is a collection of web-crawlers for various popular technology news sources.
It exposes a command-line interface to these crawlers, allowing for the distinguishing tech-news enthusiast to avoid leaving the comfort of their terminal.
It Currently Supports:
Technology News Sources
Major Technology Blogs
Personal Technology Blogs
Mainstream News Sources
Other Random Stuff
(this categorization is loose, please feel free to shuffle stuff around.)
It is my hope that, by open-sourcing a collection of news scrapers, a community can be built around building a powerful set of real-time news aggregation tools.
npm install routers-news -g
Listing News Sources
Routers News Sources:news:major:NewYorkTimes: The New York Times Bits blog.LATimes: The business and culture of our digital lives, from the L.A. Times.USAToday: Power up with breaking news on personal technology, electronics, gaming and computers.tech:Wired.com: Wired magazine is a monthly US technology publication.ArsTechnica: Ars Technica is a technology news site catering to PC enthusiasts.TechCrunch: A network of technology-oriented blogs and other web properties.other:Github: Trending and featured repos on Github.com
 MacLemon / CongressChecklist dejan / rails_panel feross / md5-password-cracker.js shadowsocks / shadowsocks-go bcoe / routers-news andrew / 24pullrequests nkohari / jwalk lockitron / selfstarter twitter / bower Spaceman-Labs / SMPageControl
routers-news --source=github --article=5
bcoe / routers-news:A crawler for various popular tech news sources. Read technology news from the comfort of your CLI.— Read more---------
The news crawlers used by Routers come in two varieties:
Examples of both can be found in the lib/sources directory.
It's easy to add a new news source:
You can also help a ton by:
Help make our dreams of a collaborative web-crawler a reality :)
Copyright (c) 2012 Benjamin Coe and Joshua Hull and Gabriel Silk. See LICENSE.txt for further details.