文件名称:Robot
介绍说明－－下载内容均来自于网络，请自行研究使用
网上机器人（Robot）又被称作Spider、Worm或Random，核心目的是为获取在Internet上的信息。机器人利用主页中的超文本链接遍历Web，通过URL引用从一个HTML文档爬行到另一个HTML文档。网上机器人收集到的信息可有多种用途，如建立索引、HTML文件的验证、URL链接验证、获取更新信息、站点镜象等。
-Internet Robot (Robot) also known as Spider, Worm, or Random, the core objective is to obtain information on the Internet. Home of the robot using hypertext links traversal Web, through the URL reference from a HTML document to another HTML document crawling. Online robot collected information can be a variety of purposes, such as indexing, HTML document verification, URL link verification, access to updated information, such as mirror sites.
-Internet Robot (Robot) also known as Spider, Worm, or Random, the core objective is to obtain information on the Internet. Home of the robot using hypertext links traversal Web, through the URL reference from a HTML document to another HTML document crawling. Online robot collected information can be a variety of purposes, such as indexing, HTML document verification, URL link verification, access to updated information, such as mirror sites.
(系统自动生成,下载前可以参看下载内容)
下载文件列表
Robot.txt
用C#语言构造蜘蛛程序 .txt
用C#语言构造蜘蛛程序 .txt