I could not find it in Google, so I ask you. How to configure ideolog for scrapy?
Example log:
2020-03-12 11:36:07 [scrapy.utils.log] INFO: Scrapy 2.0.0 started (bot: yandex_market)
2020-03-12 11:36:07 [scrapy.utils.log] INFO: Versions: lxml 4.5.0.0, libxml2 2.9.10
My solution does not work
Spit on the minuses, maybe I'll help someone!
([^\[]+)\s\[([\w\.]+)\]\s([\w]+)\:(.+)
Related
I wrote a spider and I ran it on my windows PC. Everything was working fine. I wanted to switch now to my Raspberry Pi and I get the error:
"2022-08-06 14:23:16 [scrapy.middleware] WARNING: Disabled CustomImagePipelines: ImagesPipeline requires installing Pillow 4.0.0 or later
2022-08-06 14:23:16 [scrapy.middleware] INFO: Enabled item pipelines:
[]"
although I installed Pillow and image.
Has anyone an idea, what could be the problem? Is there any other hidden package, that needs to be installed that I missed? On myRaspberry I should have installed Pillow 9.2.
Okay, I solved the issue.
I had a look into the source code and it tries to import
"from PIL import Image". And this gave some error due to missing libraries.
I installed them, now everything is working fine.
I am trying to run the first program of appium. But getting the below mentioned error. I have downloaded the latest selenium 4 jars and java.client (appium jars.). Still it says noClassFoundException.
Any help would be appreciated.
Appium refers to a class in Selenium that was moved to a diffirent package in Selenium 4.
I get this compatibility table from appium conversation on github:
Appium
Selenium
8.0.0-beta
4.1.0
7.3.0
3.141.59
7.2.0
3.141.59
7.1.0
4.0.0-alpha-1
7.0.0
3.141.59
Hi everyone im having problem with running test on firefox. I did read that firefox is no longer support, but i am not sure. Does anyone know if it is true ?
Selenium build info: version: '3.6.0'
Firefox Version: 57.0
from Firefox 55 onwards, Selenium IDE will no longer work.
Please refer this link link
I'm not good at English to express, Sorry.
I want to know how to debug scrapy with vs2017.
I work well with vs2015,here is the way:
import os
os.system("run.cmd")
and run.cmd:
scrapy crawl weiqn --nolog
pause
Thanks.
Haha,now I found the way.
It is the same as Pycharm debugger.
Hear is pycharm:
enter image description here
I am getting the following NotConnectedException while trying to run Selenium Code:
org.openqa.selenium.firefox.NotConnectedException: Unable to connect to host 127.0.0.1 on port 7055 after 45000 ms. Firefox console output:
3a9e97384}","minVersion":"43.0.2","maxVersion":"43.0.2"}],"targetPlatforms":[]}
1451223178321 addons.xpi DEBUG getModTime: Recursive scan of {972ce4c6-7e08-4474-a285-3208198ce6fd}
I am using Firefox v43.0.2 and Selenium v2.48.2.
Please help me with this.
You need to downgrade Firefox or update Selenium.
I think answers and tips mentioned in this question can help you.
Thanks for your help. Issue is resolved now. Just downgraded the firefox version to 41.0 and now it is working fine.