I'm wondering if anyone knows how I can access all information on Google Shopping?
As an ordinary user, when I search for a product on Google Shopping, sometimes I get more information than other times, eg I will always get the brand and product name and image but sometimes I will also see a description, size & fit, colours, material etc. I want to be able to access all product information without scraping data from every brand's site... any ideas about how I can do this?
I've contacted Google Shopping and they advised me that even if I was to connect to Google's API, I would only be able to access the same information that an ordinary user can see, which is not ideal as I want to have consistent information across all of the listings.
Related
My Data Science team is trying to pull Hubspot info into their data visualization platform via Hubspot's API.
They're telling me that they can't find the information fora contact's pageview anywhere. I've searched the documentation for the API, contacted Hubspot Support (who told me they can't help with the API), and spent hours googling but I can't find any information on this.
Does the API simply not provide that information? I know it's collected, because I can see page views in a specific contact's timeline...so why can't I access it via API?
Has anyone overcome this challenge in the past or does anyone have any advice?
I should mention that I'm about 10% literate when it comes to anything code related...so I could just be missing something.
Assuming you are using PHP in your API, then you should be able to find the number of page views here:
$objHubSpot->properties->hs_analytics_num_page_views->value
(where $objHubSpot is the name of the HubSpot object returned through API)
If you want to know the actual URL of the visited pages, then keep in mind that HubSpot only keeps a record of the last few URLs.
I am developing a web app for client requirement in that i am using Google API for finding nearby place
https://maps.googleapis.com/maps/api/place/nearbysearch/json?location=.....
I was able to get all the required details. Name, rating, etc but only description is missing. will i be able to get it from anywhere, i tried
https://maps.googleapis.com/maps/api/place/textsearch/json?query=...
but not getting required result only country or place is getting here not restaurant or venue description. Please help me to get details for each item in nearby search result. Or any other suggestions
Based on the documentation of both Google Places API Nearby Search Requests and Google Places API Text Search Requests, description property is not included in the returned results. You could rather file for a Feature Request to include description to each returned places in the results here at Google Public Issue Tracker.
Issue Tracker is a tool used internally at Google to track bugs and
feature requests during product development. It is available outside
of Google for use by external public and partner users who need to
collaborate with Google teams on specific projects.
You can learn more about Issue Tracker through this link.
I would also like to suggest to read Google Places API Place Details. It returns more comprehensive information about the indicated place such as its complete address, phone number, user rating and reviews.
Hope this help!
I have a project where I'm required to predict future user location so that we can provide him with location specific services as well as collect data from his device that would be used to provide a service for another user etc...
I have already developed an android app that collects some data but as social media is the richest in terms of information, I would like to make use of that. For example, if the user checks in in a restaurant and gives it a good review (on fb for example) then he is likely to go back there. Or if he tweets a negative tweet about a place then he is unlikely to go back there... these are just examples I thought of.
So my main issue is: how do I even get access to that information? I mean it's not like the user is going to send me a copy of every social media activity they have so how do I get it and is that even possible? Because I know fb, twitter and other social medias have security policies so I initially thought it couldn't be done and that only facebook gets access to their users' information to predict their likes and dislikes and show them adds and sponsored posts accordingly but when googling it, I found a lot of tools that claim to be able to provide that sort of data. How did they even acquire it and is it possible for me to do the same?
Facebook, Twitter, etc. have well-documented APIs that may or may not allow you to access the data.
For the APIs, see the official documentation of each, because anything I write here will likely be outdated in a year or two, as their APIs change.
Don't rely on web scraping. The web sites change design more often than the API, and you will likely violate the terms-of-service.
Here is what I'm trying to accomplish:
Three different products-- each one consists of online content, housed within a unique folder.
The customer purchases one of the three products, and receives a username/password (or it could be some sort of dynamic link that expires) for that product.
I am not a programmer, but I know enough to get myself in trouble. I thought I could find a simple script where I would just have to change a couple of parameters and be good to go. Surely this has been done before, right?
I need something that will somehow send the info to a payment processor (PayPal is preferable, but Google Checkout could be an option too), generate a unique password or code and email it to the buyer, and of course communicate to the folder where the product lives so that the password/code will work.
Am I crazy? Is this something that I need advanced development skills to pull off? I have been looking at open-source shopping carts to see if one of them has this functionality built in, but haven't been able to find anything.
There is a PayPal script that is supposed to do this, but I have tried working with it before and it is a real pain...I'm not even sure ultimately that it will work the way I want it too.
Any suggestions are most welcome!
From your description it looks like you are trying to sell digital content.
Both Google Checkout and Paypal have frameworks in place that allow you to securely sell and deliver digital goods.
Please have a look at the doc below for Google Checkout Digital Delivery:
http://code.google.com/apis/checkout/developer/Google_Checkout_Digital_Delivery.html
Are all these types of sites just illegally scraping Google or another search engine?
As far as I can tell ther is no 'legal' way to get this data for a commercial site.. The Yahoo! api ( http://developer.yahoo.com/search/siteexplorer/V1/inlinkData.html ) is only for noncommercial use, Yahoo! Boss does not allow automated queries etc.
Any ideas?
For example, if you wanted to find all the links to Google's homepage, search for
link:http://www.google.com
So if you want to find all the inbound links, you can simply traverse your website's tree, and for each item it finds, build a URL. Then query Google for:
link:URL
And you'll get a collection of all the links that Google has from other websites into your website.
As for the legality of such harvesting, I'm sure it's not-exactly-legal to make a profit from it, but that's never stopped anyone before, has it?
(So I wouldn't bother wondering whether they did it or not. Just assume they do.)
I don't know what hubspot do, but, if you wanted to find out what sites link to your site, and you don't have the hardware to crawl the web, one thing you can do is monitor the HTTP_REFERER of visitors to your site. This is, for example, how Google Analytics (as far as I know) can tell you where your visitors are arriving from. This is not 100% reliable as not all browsers set it, particularly in "Privacy Mode", but you only need one visitor per link to know that it exists!
This is ofter accomplished by embedding a script into each of your webpages (often in a common header or footer). For example, if you examine the source for the page you are currently reading you will find (right down at the bottom) a script that reports back to Google information about your visit.
Now this won't tell you if there are links out there that no one has ever used to get to your site, but let's face it, they are a lot less interesting than the ones people actually use.