文件名称:lightinthebox
- 所属分类:
- Internet/网络编程
- 资源属性:
- [Java] [源码]
- 上传时间:
- 2012-11-26
- 文件大小:
- 1.67mb
- 下载次数:
- 0次
- 提 供 者:
- 长*
- 相关连接:
- 无
- 下载说明:
- 别用迅雷下载,失败请重下,重下不扣分!
介绍说明--下载内容均来自于网络,请自行研究使用
Light in the box 抓取程序。
使用HttpClient,正则表达式解析。xpp3方式存储xml数据。多线程支持,使用session,支持代理服务器列表。
由于抓取的是国外网站,因此速度上比较慢,稍加改动即可以成为比较顺手的工具。-Light in the box crawling process. The use of HttpClient, regular expression analysis. xml data stored xpp3. Multi-threading support, the use of session, support for proxy servers list. Because crawling is foreign websites, so the speed is relatively slow, a little change that can be a relatively easy tool.
使用HttpClient,正则表达式解析。xpp3方式存储xml数据。多线程支持,使用session,支持代理服务器列表。
由于抓取的是国外网站,因此速度上比较慢,稍加改动即可以成为比较顺手的工具。-Light in the box crawling process. The use of HttpClient, regular expression analysis. xml data stored xpp3. Multi-threading support, the use of session, support for proxy servers list. Because crawling is foreign websites, so the speed is relatively slow, a little change that can be a relatively easy tool.
(系统自动生成,下载前可以参看下载内容)
下载文件列表
lightinthebox
.............\.classpath
.............\.project
.............\bin
.............\...\com
.............\...\...\blogool
.............\...\...\.......\crawl
.............\...\...\.......\.....\ChangeLargeImageName.class
.............\...\...\.......\.....\DownloadImage$DownloadImageHandle.class
.............\...\...\.......\.....\DownloadImage.class
.............\...\...\.......\.....\DownloadPage$DownloadProductContentHandle.class
.............\...\...\.......\.....\DownloadPage.class
.............\...\...\.......\.....\GetAllItemPage$SaveFileContentHandle.class
.............\...\...\.......\.....\GetAllItemPage.class
.............\...\...\.......\.....\GetRealCount$ExitThread.class
.............\...\...\.......\.....\GetRealCount$HandleGetRealCount.class
.............\...\...\.......\.....\GetRealCount.class
.............\...\...\.......\.....\lib
.............\...\...\.......\.....\...\Cat.class
.............\...\...\.......\.....\...\Item.class
.............\...\...\.......\.....\ParseItem.class
.............\...\...\.......\.....\ParseItemContentHandle.class
.............\...\...\.......\.....\ParseItemHtml.class
.............\...\...\.......\.....\ParseLIB1.class
.............\...\...\.......\.....\Test.class
.............\...\...\.......\.....\Test1.class
.............\...\...\.......\.....\Util.class
.............\...\...\.......\export
.............\...\...\.......\......\DBUtil.class
.............\...\...\.......\......\ExportToDB.class
.............\...\...\.......\......\ExportToHtml.class
.............\...\...\.......\......\Test.class
.............\...\...\.......\......\TestLargeSmall.class
.............\...\...\.......\......\UpdateDB.class
.............\...\...\.......\......\UpdatePrize.class
.............\...\org
.............\...\...\apache
.............\...\...\......\commons
.............\...\...\......\.......\httpclient
.............\...\...\......\.......\..........\auth
.............\...\...\......\.......\..........\....\AuthChallengeException.class
.............\...\...\......\.......\..........\....\AuthChallengeParser.class
.............\...\...\......\.......\..........\....\AuthChallengeProcessor.class
.............\...\...\......\.......\..........\....\AuthenticationException.class
.............\...\...\......\.......\..........\....\AuthPolicy.class
.............\...\...\......\.......\..........\....\AuthScheme.class
.............\...\...\......\.......\..........\....\AuthSchemeBase.class
.............\...\...\......\.......\..........\....\AuthScope.class
.............\...\...\......\.......\..........\....\AuthState.class
.............\...\...\......\.......\..........\....\BasicScheme.class
.............\...\...\......\.......\..........\....\CredentialsNotAvailableException.class
.............\...\...\......\.......\..........\....\CredentialsProvider.class
.............\...\...\......\.......\..........\....\DigestScheme.class
.............\...\...\......\.......\..........\....\HttpAuthenticator.class
.............\...\...\......\.......\..........\....\HttpAuthRealm.class
.............\...\...\......\.......\..........\....\InvalidCredentialsException.class
.............\...\...\......\.......\..........\....\MalformedChallengeException.class
.............\...\...\......\.......\..........\....\NTLM.class
.............\...\...\......\.......\..........\....\NTLMScheme.class
.............\...\...\......\.......\..........\....\package.html
.............\...\...\......\.......\..........\....\RFC2617Scheme.class
.............\...\...\......\.......\..........\AutoCloseInputStream.class
.............\...\...\......\.......\..........\ChunkedInputStream.class
.............\...\...\......\.......\..........\ChunkedOutputStream.class
.............\...\...\......\.......\..........\CircularRedirectException.class
.............\...\...\......\.......\..........\ConnectionPoolTimeoutException.class
.............\...\...\......\.......\..........\ConnectMethod.class
.............\...\...\......\.......\..........\ConnectTimeoutException.class
.............\...\...\......\.....
.............\.classpath
.............\.project
.............\bin
.............\...\com
.............\...\...\blogool
.............\...\...\.......\crawl
.............\...\...\.......\.....\ChangeLargeImageName.class
.............\...\...\.......\.....\DownloadImage$DownloadImageHandle.class
.............\...\...\.......\.....\DownloadImage.class
.............\...\...\.......\.....\DownloadPage$DownloadProductContentHandle.class
.............\...\...\.......\.....\DownloadPage.class
.............\...\...\.......\.....\GetAllItemPage$SaveFileContentHandle.class
.............\...\...\.......\.....\GetAllItemPage.class
.............\...\...\.......\.....\GetRealCount$ExitThread.class
.............\...\...\.......\.....\GetRealCount$HandleGetRealCount.class
.............\...\...\.......\.....\GetRealCount.class
.............\...\...\.......\.....\lib
.............\...\...\.......\.....\...\Cat.class
.............\...\...\.......\.....\...\Item.class
.............\...\...\.......\.....\ParseItem.class
.............\...\...\.......\.....\ParseItemContentHandle.class
.............\...\...\.......\.....\ParseItemHtml.class
.............\...\...\.......\.....\ParseLIB1.class
.............\...\...\.......\.....\Test.class
.............\...\...\.......\.....\Test1.class
.............\...\...\.......\.....\Util.class
.............\...\...\.......\export
.............\...\...\.......\......\DBUtil.class
.............\...\...\.......\......\ExportToDB.class
.............\...\...\.......\......\ExportToHtml.class
.............\...\...\.......\......\Test.class
.............\...\...\.......\......\TestLargeSmall.class
.............\...\...\.......\......\UpdateDB.class
.............\...\...\.......\......\UpdatePrize.class
.............\...\org
.............\...\...\apache
.............\...\...\......\commons
.............\...\...\......\.......\httpclient
.............\...\...\......\.......\..........\auth
.............\...\...\......\.......\..........\....\AuthChallengeException.class
.............\...\...\......\.......\..........\....\AuthChallengeParser.class
.............\...\...\......\.......\..........\....\AuthChallengeProcessor.class
.............\...\...\......\.......\..........\....\AuthenticationException.class
.............\...\...\......\.......\..........\....\AuthPolicy.class
.............\...\...\......\.......\..........\....\AuthScheme.class
.............\...\...\......\.......\..........\....\AuthSchemeBase.class
.............\...\...\......\.......\..........\....\AuthScope.class
.............\...\...\......\.......\..........\....\AuthState.class
.............\...\...\......\.......\..........\....\BasicScheme.class
.............\...\...\......\.......\..........\....\CredentialsNotAvailableException.class
.............\...\...\......\.......\..........\....\CredentialsProvider.class
.............\...\...\......\.......\..........\....\DigestScheme.class
.............\...\...\......\.......\..........\....\HttpAuthenticator.class
.............\...\...\......\.......\..........\....\HttpAuthRealm.class
.............\...\...\......\.......\..........\....\InvalidCredentialsException.class
.............\...\...\......\.......\..........\....\MalformedChallengeException.class
.............\...\...\......\.......\..........\....\NTLM.class
.............\...\...\......\.......\..........\....\NTLMScheme.class
.............\...\...\......\.......\..........\....\package.html
.............\...\...\......\.......\..........\....\RFC2617Scheme.class
.............\...\...\......\.......\..........\AutoCloseInputStream.class
.............\...\...\......\.......\..........\ChunkedInputStream.class
.............\...\...\......\.......\..........\ChunkedOutputStream.class
.............\...\...\......\.......\..........\CircularRedirectException.class
.............\...\...\......\.......\..........\ConnectionPoolTimeoutException.class
.............\...\...\......\.......\..........\ConnectMethod.class
.............\...\...\......\.......\..........\ConnectTimeoutException.class
.............\...\...\......\.....