我试图在此网站上进行分页:
https://www.coasttocoastaccents.com/shop/?accent%20Furniture=accent%20Tables%7CBar%20Servers%7CBookcases%7CCabinets%7CChests%7CConsole%7CCredenzas%7CCupboards%7CDesks%7CMedia%20Centers%7CMirrors%7CVanity%20Sink&orderBy=Id&context=shop&page=1
但是我不能成功。
当我查看Request URl时,它包含
"https://www.coasttocoastaccents.com/service/QueryProducts.json?JsConfig=ExcludeDefaultvalues&context=shop&fields=Id,ShortDescription,LongDescription,Price,WholesalePrice,Category,OptionGroup,MinimumOrderQty,PurchaseIncrement,AvailableQty,ProductTags,isnew,Availableon&orderBy=Id&retailerId=*&skip=24&tagCriteria=%7B%22accent+Furniture%22:%5B%22accent+Tables%22,%22Bar+Servers%22,%22Bookcases%22,%22Cabinets%22,%22Chests%22,%22Console%22,%22Credenzas%22,%22Cupboards%22,%22Desks%22,%22Media+Centers%22,%22Mirrors%22,%22Vanity+Sink%22%5D%7D&take=24"
但是它是JSON,我无法获取HTML页面。
我还尝试将查询字符串参数复制并粘贴到主URL的末尾,但仍然没有结果。
我想抓取这个网站,并使用带有飞溅的Scrapy。
请帮帮我。