文件名称:WebMagic_jb51

  • 所属分类:
  • 数据库编程
  • 资源属性:
  • [Java] [源码]
  • 上传时间:
  • 2017-03-09
  • 文件大小:
  • 6.58mb
  • 下载次数:
  • 0次
  • 提 供 者:
  • Da***
  • 相关连接:
  • 下载说明:
  • 别用迅雷下载,失败请重下,重下不扣分!

介绍说明--下载内容均来自于网络,请自行研究使用

webmagic采用完全模块化的设计,功能覆盖整个爬虫的生命周期(链接提取、页面下载、内容抽取、持久化),支持多线程抓取,分布式抓取,并支持自动重试、自定义UA/cookie等功能。 -The design of webmagic with completely modular, functional coverage throughout the reptile life cycle (link extraction, download page, content extraction, persistence), support multi-threaded crawling, distributed crawling, and supports automatic retry, custom UA/cookie and other functions.
(系统自动生成,下载前可以参看下载内容)

下载文件列表





webmagic-samples\README.md

.........extension\README.md

.........selenium\README.md

..........axon\README.md

.........core\README.md

.........scripts\README.md

README.md

webmagic-core\src\test\resources\html\mock-github.html

.........extension\src\test\resources\html\mock-github.html

..................\...\....\.........\....\mock-webmagic.html

.........core\src\main\java\us\codecraft\webmagic\scheduler\component\package.html

.............\...\....\....\..\.........\........\utils\package.html

.........extension\src\main\java\us\codecraft\webmagic\model\annotation\package.html

.........core\src\main\java\us\codecraft\webmagic\scheduler\package.html

.........extension\src\main\java\us\codecraft\webmagic\model\package.html

.........core\src\main\java\us\codecraft\webmagic\processor\package.html

.............\...\....\....\..\.........\........\.ipeline\package.html

.............\...\....\....\..\.........\........\package.html

.............\...\....\....\..\.........\........\downloader\package.html

.............\...\....\....\..\.........\........\selector\package.html

.............\...\....\resources\log4j.xml

.............\...\test\resources\log4j.xml

.........extension\src\main\resources\log4j.xml

..................\...\test\resources\log4j.xml

.........scripts\src\main\resources\log4j.xml

................\...\test\resouces\log4j.xml

..........amples\src\main\resources\log4j.xml

.........core\module_webmagic-core.xml

.........samples\pom.xml

..........elenium\pom.xml

.........extension\pom.xml

.........saxon\pom.xml

.........core\pom.xml

.........scripts\pom.xml

pom.xml

webmagic-extension\src\main\resources\spider-config-draft.xml

..................\...\....\.........\crawl.js

.........samples\src\main\resources\crawl.js

..........cripts\src\main\resources\js\defines.js

................\...\....\.........\..\github.js

................\...\....\.........\..\oschina.js

..........elenium\config.ini

.........core\src\main\java\us\codecraft\webmagic\downloader\AbstractDownloader.java

.............\...\....\....\..\.........\........\selector\AbstractSelectable.java

.........extension\src\main\java\us\codecraft\webmagic\model\AfterExtractor.java

.........samples\src\main\java\us\codecraft\webmagic\samples\AlexanderMcqueenGoodsProcessor.java

................\...\....\....\..\.........\........\.......\AmanzonPageProcessor.java

.........core\src\main\java\us\codecraft\webmagic\selector\AndSelector.java

.........samples\src\main\java\us\codecraft\webmagic\samples\AngularJSProcessor.java

.........extension\src\main\java\us\codecraft\webmagic\example\AppStore.java

..................\...\....\....\..\.........\........\.......\BaiduBaike.java

.........core\src\main\java\us\codecraft\webmagic\processor\example\BaiduBaikePageProcessor.java

.........samples\src\main\java\us\codecraft\webmagic\model\samples\BaiduNews.java

.........core\src\main\java\us\codecraft\webmagic\selector\BaseElementSelector.java

.........extension\src\test\java\us\codecraft\webmagic\model\BaseRepo.java

..................\...\main\java\us\codecraft\webmagic\model\formatter\BasicTypeFormatter.java

.........samples\src\main\java\us\codecraft\webmagic\model\samples\Blog.java

.........extension\src\main\java\us\codecraft\webmagic\scheduler\BloomFilterDuplicateRemover.java

..................\...\test\java\us\codecraft\webmagic\scheduler\BloomFilterDuplicateRemoverTest.java

..................\...\main\java\us\codecraft\webmagic\utils\ClassUtils.java

..................\...\....\....\..\.........\........\pipeline\CollectorPageModelPipeline.java

.........core\src\main\java\us\codecraft\webmagic\pipeline\CollectorPipeline.java

.........extension\src\main\java\us\codecraft\webmagic\model\annotation\ComboExtract.java

..................\...\....\....\..\.........\........\handler\CompositePageProcessor.java

..................\...\....\....\..\.........\........\.......\CompositePipeline.java

..................\...\....\....\..\.........\........\configurable\ConfigurablePageProcessor.java

..................\...\test\java\us\codecraft\webmagic\configurable\Configurable

相关说明

  • 本站资源为会员上传分享交流与学习,如有侵犯您的权益,请联系我们删除.
  • 本站是交换下载平台,提供交流渠道,下载内容来自于网络,除下载问题外,其它问题请自行百度更多...
  • 请直接用浏览器下载本站内容,不要使用迅雷之类的下载软件,用WinRAR最新版进行解压.
  • 如果您发现内容无法下载,请稍后再次尝试;或者到消费记录里找到下载记录反馈给我们.
  • 下载后发现下载的内容跟说明不相乎,请到消费记录里找到下载记录反馈给我们,经确认后退回积分.
  • 如下载前有疑问,可以通过点击"提供者"的名字,查看对方的联系方式,联系对方咨询.

相关评论

暂无评论内容.

发表评论

*主  题:
*内  容:
*验 证 码:

源码中国 www.ymcn.org