Jump to content
Not connected, Your IP: 35.175.121.230

omarvaldez5

Members
  • Content Count

    1
  • Joined

    ...
  • Last visited

    ...
  1. Hi, Does anyone knows how to use Splash with Docker when using AirVPN_ As far as I understand, it is related to port forwarding but I have no idea of how to do it. This is what I have used in terminal: sudo docker run -p 5023:5023 -p 8050:8050 -p 8051:8051 scrapinghub/splash (This is a setup for localhost) Once I get connected to localhost, when I try to do the scraping I get the following error: 2020-01-28 17:54:51 [scrapy.core.engine] INFO: Spider opened 2020-01-28 17:54:51 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2020-01-28 17:54:51 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2020-01-28 17:55:19 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET http://quotes.toscrape.com/js/ via http://localhost:8050/render.html> (failed 1 times): 502 Bad Gateway 2020-01-28 17:55:47 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET http://quotes.toscrape.com/js/ via http://localhost:8050/render.html> (failed 2 times): 502 Bad Gateway 2020-01-28 17:55:51 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2020-01-28 17:56:15 [scrapy.downloadermiddlewares.retry] DEBUG: Gave up retrying <GET http://quotes.toscrape.com/js/ via http://localhost:8050/render.html> (failed 3 times): 502 Bad Gateway 2020-01-28 17:56:15 [scrapy.core.engine] DEBUG: Crawled (502) <GET http://quotes.toscrape.com/js/ via http://localhost:8050/render.html> (referer: None) 2020-01-28 17:56:15 [scrapy.spidermiddlewares.httperror] INFO: Ignoring response <502 http://quotes.toscrape.com/js/>: HTTP status code is not handled or not allowed I am using Ubuntu 18.04...And I stumbled upon a site where could be the solution (but it is MAC) https://www.shanestillwell.com/2016/04/11/a-hack-to-get-docker-working-while-on-vpn/ Does anoyone have any idea of how to solve this issue? Thanks in advance!
×
×
  • Create New...