我有抓取代码来抓取网站。我的代码如下。
from scrapy.spider import Spider
from scrapy.selector import Selector
class JustASpider(Spider):
name = "googlespider"
allowed_domains=["google.com"]
start_urls = ["http://www.google.com/search?hl=en&q=search"]
def parse(self,response):
sel = Selector(response)
sites = sel.xpath('//title/text()').extract()
print (sites)
#for site in sites: (I dont know why you want to loop for extracting the text in the title element)
#print site.extract()
使用$scrapy crawl test.py
运行此命令时出现错误
from scrapy.spider import Spider
ImportError: No module named 'scrapy.spider'
我也在尝试其他几个示例,但是所有人都遇到相同的错误。