文件名称:Crawler
介绍说明－－下载内容均来自于网络，请自行研究使用
一个简单的python爬虫程序，基于youtube视频-web url crawler
(系统自动生成,下载前可以参看下载内容)
下载文件列表
Crawler\.idea\.name
.......\.....\Crawler.iml
.......\.....\misc.xml
.......\.....\modules.xml
.......\.....\workspace.xml
.......\domain.py
.......\..uban\crawled.txt
.......\......\queue.txt
.......\general.py
.......\link_finder.py
.......\main.py
.......\spider.py
.......\test.py
.......\.henewboston\crawled.txt
.......\............\queue.txt
.......\__pycache__\domain.cpython-34.pyc
.......\...........\general.cpython-34.pyc
.......\...........\link_finder.cpython-34.pyc
.......\...........\spider.cpython-34.pyc
.......\.idea
.......\douban
.......\thenewboston
.......\__pycache__
Crawler