I am using crawler4j to pull some data from Google play store (https pages). However, I checked my downloaded html content and found that it is slightly different from the page source I see in the browser. Why? Is it because Google detected that I am using a bot client (so my http request is handled differently)?
Can anyone help me? Thanks a lot!
I have solved the problem. THANKS for all the help :)
Related
I'm working in a highly secured environment. I can only use IE11 by company's policy. I'm trying to implement test automation on my project.
I'm using Selenium and IEDriver.
Currently I'm trying to implement basic scenario by just opening application page.
When I'm trying to do it via IEDriver, the page is not getting opened and the message "This page cannot be displayed" is shown.
But when I open the page manually by just typing in the url to the address bar everything works fine.
I guess it has something to do with the cookies that are coming with the request I'm making manually. Seems like those cookies contain some signature.
Can someone advise me how can I track the problem to resolve it?
Thanks.
Be sure top follow the required configuration section on this site: https://github.com/SeleniumHQ/selenium/wiki/InternetExplorerDriver
I had some issues with IE acting the same way until following this setup.
So the issue was fixed by setting proxy.
Seems like there was a change in security rules recently.
HI trying to run an import io api on a php page and no data is detected.
Is it possible to obtain data from here
or similar web pages?
Thanks
Yes, you can create an API to a PHP page. I have created an API for this website, without any issue.
https://import.io/data/mine/?id=628e1406-9674-4196-b2e2-43a5f49262f4
You can also paginate nicely with this website, as the URL pattern is consistent and you do not need cookies.
http://www.charityperformance.com/charity-search.php?start=20&cat=&search=
http://www.charityperformance.com/charity-search.php?start=40&cat=&search=
If you would like to chat about a specific issue or website, I would suggest contacting support#import.io for further help.
Thanks,
Meg
This happens both on local deserver and when deployed. I was successfully able to use the API explorer with the guestbook tutorial, but now that I've made my own project and am trying to access the first API I have written it never appears. The yellow "Loading..." box next to the search bar never disappears.
I've looked at various solutions online but none have done the trick.
Does anyone have any suggestions for me to try?
Sorry for the broad question!
It turns out that I only got this issue when I typed in the URL myself, if I visit localhost:8080 where I am hosting the application and click on the link to the API Explorer then they all load.
I am trying to translate text on my basic webpage that I created on localhost However, I always keep receiving the Access Not Configured. Please enable the Google API error. I have already enabled the Translate API in my Google Developer account, I created both a server and browser API key (any suggestions on what I should add in my referers would be great thanks, my screen dump link underneath may help you with the option).
I was wondering if there is any alternative way I can get this API v2 to work on my localhost machine? Please see screen dump link for error.
Here on the website, I am trying to translate the UK word on google.com, with the Translate API V2 enabled and the browser key running in the background of the application I am using for this process, the UK word should translate to a language of my choice, however, as shown below, an error pops up.
Here is the link that shows screen dump
Any one that can help me with this issue, or if you have any further questions please let let me know? Your assistance is much appreciated.
Thanks
I have posted some other smaller questions regarding the problem I describe below and got some feedback but now I will try to explain it in more depth hoping to get through the problem.
I built a desktop application using JavaFX 2.2 which uses a WebEngine to access a website built using Oracle ADF Pages. The application tracks the users actions on the pages and stores data to a database. All fine so far until the point where I need show a PDF file on a user click.
On the actual website the user clicks a button and a new popup window opens up that displays the PDF.
My problem is that due to the lack of PDF support in JavaFX I cannot display the pdf. The actual link to the PDF is dynamic and it doesn't have a .pdf at the end of it so I can't use the actual URL to send it to an external bowser or something to display it. Additionally the connection is secure so I can't open the URL with Chrome for example.
Possible solutions I thought about are to read the binary data of the response from WebView and create the PDF file locally and then open it using Adobe of Chrome or something. Is that possible at all?
Another solution I thought about (while I am writing this question) is maybe to open the URL which the users default browser but how can I go about sending the secure connection cookie from the application to the browser.
Is any of the above even possible? Am I missing something?
Any help, clues, links, ideas would be very much appreciated.
Thanks
I think the best way to do what you want is to download the PDF and display it locally.
Downloading using WebView sounds like it could work but I'm not familiar with the user experience. As an alternative try using curl or wget. You can pass in the authorization cookie to those tools and use them to download the file