Scrapy-splash can't load site - scrapy

I want to crawl a site(http://www.adl.com.tr/en/c/cengiz-abazoglu-koleksiyonu-4) by scrapy-splash. But couldn't load items who made with javascript. I tried increase splash.wait(0.5) to (10) and enable DOWNLOAD_DELAY=5. Nothing changed.
What do you recommend?

This website works for me in Splash 3.0, but not in Splash 2.3.2.
In Splash 3.0 WebKit was updated to a much more recent version, likely this fixed the incompatibility.

Related

How to disable phonegap autoreload (At least during dev)

Here is my issue:
I've installed phonegap and phonegap desktop.
http://code.riffzone.net/phonegap-install-msw/
Now, when I'm working on my application (Jquery Mobile), I'm testing it on a browser, but the application is reloading again and again after every 2 seconds and I can't even write something in the form input, reloading to fast..
I don't understand where this is coming from?
Here is the screen shot of my browser and the firebug console where you can see the page reloading over and over (1) and the api_auto_reload in the console (2).
Thanks a lot :)
The reload should be triggered only when some of your source files is changed. For some reason it does detect change on your files constantly. That reason is quite hard to find out without debugging more. You can, though, turn the auto reload off with --no-autoreload switch for phonegap serve like this
phonegap serve --no-autoreload
It was phonegap desktop beta (the minimalist server) and not phonegap (command line) which was causing this bug.
If you have the same issue, make sure you are not using it.

Worklight 6.1 - Sometime app stuck with splash screen in IOS

I observed so many times that app get stuck with splash screen and nothing happens in this case. We are getting below logs on Xcode console at that time.
2014-01-20 13:09:14.822 MyApp[4326:a0b] Resetting plugins due to page load.
2014-01-20 13:09:34.924 MyApp[4326:a0b] Failed to load webpage with error: The request timed out.
This is just a default application with index.html page and text Hello Worklight in it.
This is tested on IOS6 and IOS7 simulator and device both.
I found some similar posts at the following locations describing this issue with Phonegap/Cordova. Some of the solutions/suggestions may help:
Phonegap/Cordova 3.1 Resetting plugins due to page load
Resetting plugins due to page load - Issue
As well as a bug report in Cordova:
https://issues.apache.org/jira/browse/CB-2602
I found a bug in worklight 6.2 + iOS 6(with a fix) that might also solve your problem, if you're having the same issue.
IBM Worklight - App hang at splash screen after applying FixPack

Javafx webkit loading HTML content

I have a javafx application which is loading HTML content using webkit. I have created a stage and a scene and do webEngine.load(html). It works fine. But when I minimize the application and then again maximize it after sometime, the stage shows black screen for 2-3 seconds before loading the html again.
My question is why is this happening and how can I avoid this?
Thanks,
Nitin
You are using very old JavaFX. Can you try with latest version 2.2.21 which can be found here:
http://www.oracle.com/technetwork/java/javase/downloads/index.html
It's cobundled with jdk 7u21, just download and install jdk and you get JavaFX with it.

PhoneGap InAppBrowser not loading pdf

I am using PhoneGap InAppBrowser to load pdf in my app. It is loading pdf in IOS, but there is no location bar shown, and on Android pdf is never loaded.
Here is my code to load pdf
iabRef = window.open('sample.pdf', '_blank', 'location=yes');
Not sure if this counts as an answer, but I believe this is a known bug. It is marked as fixed in the 2.4.0 RC here.
Ran into the same with 2.4.0. I switched to using the _system browser in my open call. It's not ideal, as it opens a browser that simply downloads the file, but at least it works.

Sencha 2.0 App file size issue -

I have developed a small Sencha Touch 2.0 app. Here is the url:
http://apps.swarnendude.com/sencha/iphonetest/iphoneTest.html?url=http://apps.innofied.com/sencha/gts
The app works in perfectly fine in Android 2.3, iPad, iPhone, Blackberry Playbook. But the app crashes while I test in Blackberry Torch (OS: 6.0) giving this error:
"The page you requested could not be loaded. It is too large for this device"
The production version of the file sizes are:
sencha-touch.js: 90.5Kb
app-all.js: 401.4Kb
app-all.css: 151.5Kb
Other resources: 10Kb
So, total around 650Kb. I think the sizes can be reduced more but I am not getting any other options. I am using the least css configs in SASS file and in JS too (only which are required). Is there anyone getting the same problem? Any solution?
It seems that you attempted to minimize your app, so in this case, there's not much you could do.
I'm using Blackberry Bold and occasionally see this when I use native browser. But in some cases, Opera Mini and Bolt Browser are good suggestions to pass those errors.