文件名称:WebMagic_jb51
介绍说明－－下载内容均来自于网络，请自行研究使用
webmagic采用完全模块化的设计，功能覆盖整个爬虫的生命周期(链接提取、页面下载、内容抽取、持久化)，支持多线程抓取，分布式抓取，并支持自动重试、自定义UA/cookie等功能。 -The design of webmagic with completely modular, functional coverage throughout the reptile life cycle (link extraction, download page, content extraction, persistence), support multi-threaded crawling, distributed crawling, and supports automatic retry, custom UA/cookie and other functions.
(系统自动生成,下载前可以参看下载内容)
下载文件列表
webmagic-samples\README.md
.........extension\README.md
.........selenium\README.md
..........axon\README.md
.........core\README.md
.........scripts\README.md
README.md
webmagic-core\src\test\resources\html\mock-github.html
.........extension\src\test\resources\html\mock-github.html
..................\...\....\.........\....\mock-webmagic.html
.........core\src\main\java\us\codecraft\webmagic\scheduler\component\package.html
.............\...\....\....\..\.........\........\utils\package.html
.........extension\src\main\java\us\codecraft\webmagic\model\annotation\package.html
.........core\src\main\java\us\codecraft\webmagic\scheduler\package.html
.........extension\src\main\java\us\codecraft\webmagic\model\package.html
.........core\src\main\java\us\codecraft\webmagic\processor\package.html
.............\...\....\....\..\.........\........\.ipeline\package.html
.............\...\....\....\..\.........\........\package.html
.............\...\....\....\..\.........\........\downloader\package.html
.............\...\....\....\..\.........\........\selector\package.html
.............\...\....\resources\log4j.xml
.............\...\test\resources\log4j.xml
.........extension\src\main\resources\log4j.xml
..................\...\test\resources\log4j.xml
.........scripts\src\main\resources\log4j.xml
................\...\test\resouces\log4j.xml
..........amples\src\main\resources\log4j.xml
.........core\module_webmagic-core.xml
.........samples\pom.xml
..........elenium\pom.xml
.........extension\pom.xml
.........saxon\pom.xml
.........core\pom.xml
.........scripts\pom.xml
pom.xml
webmagic-extension\src\main\resources\spider-config-draft.xml
..................\...\....\.........\crawl.js
.........samples\src\main\resources\crawl.js
..........cripts\src\main\resources\js\defines.js
................\...\....\.........\..\github.js
................\...\....\.........\..\oschina.js
..........elenium\config.ini
.........core\src\main\java\us\codecraft\webmagic\downloader\AbstractDownloader.java
.............\...\....\....\..\.........\........\selector\AbstractSelectable.java
.........extension\src\main\java\us\codecraft\webmagic\model\AfterExtractor.java
.........samples\src\main\java\us\codecraft\webmagic\samples\AlexanderMcqueenGoodsProcessor.java
................\...\....\....\..\.........\........\.......\AmanzonPageProcessor.java
.........core\src\main\java\us\codecraft\webmagic\selector\AndSelector.java
.........samples\src\main\java\us\codecraft\webmagic\samples\AngularJSProcessor.java
.........extension\src\main\java\us\codecraft\webmagic\example\AppStore.java
..................\...\....\....\..\.........\........\.......\BaiduBaike.java
.........core\src\main\java\us\codecraft\webmagic\processor\example\BaiduBaikePageProcessor.java
.........samples\src\main\java\us\codecraft\webmagic\model\samples\BaiduNews.java
.........core\src\main\java\us\codecraft\webmagic\selector\BaseElementSelector.java
.........extension\src\test\java\us\codecraft\webmagic\model\BaseRepo.java
..................\...\main\java\us\codecraft\webmagic\model\formatter\BasicTypeFormatter.java
.........samples\src\main\java\us\codecraft\webmagic\model\samples\Blog.java
.........extension\src\main\java\us\codecraft\webmagic\scheduler\BloomFilterDuplicateRemover.java
..................\...\test\java\us\codecraft\webmagic\scheduler\BloomFilterDuplicateRemoverTest.java
..................\...\main\java\us\codecraft\webmagic\utils\ClassUtils.java
..................\...\....\....\..\.........\........\pipeline\CollectorPageModelPipeline.java
.........core\src\main\java\us\codecraft\webmagic\pipeline\CollectorPipeline.java
.........extension\src\main\java\us\codecraft\webmagic\model\annotation\ComboExtract.java
..................\...\....\....\..\.........\........\handler\CompositePageProcessor.java
..................\...\....\....\..\.........\........\.......\CompositePipeline.java
..................\...\....\....\..\.........\........\configurable\ConfigurablePageProcessor.java
..................\...\test\java\us\codecraft\webmagic\configurable\Configurable