Can someone provide me the steps to push data from Funnel,Adjust and Facebook Ads to google big query ??
We are not interested in third party softwares like stitch.
Thanks
Welcome to StackOverflow!
Assuming you mean Funnel.io here? If so, isn't this what Funnel already does for you? If you are looking to migrate away from that product and do this yourself, you'r going to need to find importers for each of the data sources which Funnel connects too individually. It may be, actually, that you just want to stick with Funnel to make life easier?
BigQuery offers several connectors to external data sources via their Data Transfer Service, while Facebook Ads is not one of the official connectors, Google recently opened up the platform to third-party connections via the Google Cloud Platform Marketplace, which does contain a connector for Facebook Ads.
However, this means you are once again using a third party connection, so may not be what you are looking for.
If you don't want to use third party connections, and there isn't a Google built solution, then your remaining option is to build your own data importer, usually via the data sources API.
Related
I want to make an app for gamers that uses statistics from the games they play. I want to link Riot/ubisoft/steam/epic games/ account to my app and use the user's game data (with permission of-course). Is there a way to access that information? I was not able to find much on my own. Steam has web apis that might be able to get that information but I don't understand how much information I can get from there as well.
You need to use one of their internal APIs. Ubisoft uses its own demux API. There are several examples on GitHub on how to do that. In my case ,I am grabbing data from tracker.gg and Ubisoft. Here's a repo for my API Server .
https://github.com/alexanderthegreat96/dth-division2-api
I'm trying to build a data collection web endpoint.The Use case is similar to Google Analytics collect API. I want to add this endpoint(GET method) to all pages on the website and on-page load collect page info through this API.
Actually I'm thinking of doing this by using Google Cloud services like Endpoints, BQ(for storing the data).. I don't want to host it in any dedicated servers. Otherwise, I will be end up doing a lot for managing/monitoring the service.
Please suggest me how do I achieve this with Google Cloud Service? OR direct me to right direction if my idea is wrong
I suggest focussing on deciding where you want to code to run. There are several GCP options that don't require dedicated servers:
Google App Engine
Cloud Functions/Firebase Functions
Cloud Run (new!)
Look here to see which support Cloud Endpoints.
All of these products can support running code that takes the data from the request and sends it to the BigQuery API.
There are various ways of achieving what you want. David's answer is absolutely valid, but I would like to introduce Stackdriver Custom Metrics to the discussion.
Custom metrics are similar to regular Stackdriver Monitoring metrics, but you create your own time series (Stackdriver lingo described here) to keep track of whatever you want and clients can sent in their data through an API.
You could achieve the same thing with a compute solution (Google Cloud Functions for example) and a database (Google BigTable for example) and writing your own logic.. but Custom Metrics is an already built solution that includes dashboards and alerting policies while being a more managed solution.
I have an idea for a web app project, however, due to not having any programming knowledge, I'm first asking here for directions. Essentially, I wonder if the idea is realistic and what the most effective way could be for me to tackle it.
I want to combine several open-data sources, some in the form of API's (e.g. Google maps), others in the form of statistics in Excel sheets. Like a Mashup of different sources? The idea is to use the data to perform some data crunching and in effect provide some insights from this data in an aggregated way. I have previously played around with dashboards during an internship and I am attracted by the idea to maybe produce a Single page application for my idea with some visualisation. Any thoughts on this?
I have looked at the following services online, but I have no idea if they can help me produce a web app which aggregates different data sources and that allows for nice presentation:
Zoho Creator,
QlikSense,
Sproutcore,
Caspio
Any thoughts on this are highly appreciated!
Best regards
If you’re not a developer and would like to get started immediately, then you could get started by signing up with Zoho Creator. Its intuitive yet easy to use builder lets you setup web app in minutes.
Regarding your query for aggregation from different data sources, Zoho Creator provides REST API that allows you to access external data sources to interface with your web applications.
Zoho Creator allows you to setup the perfect web-app on a secure cloud with admin level access to handle the necessary permissions and manage data.
You can customize the Reports in your Zoho Creator application using Report Settings to suit your needs. Web-App can be created by converting a CSV/Excel into a full-featured Web DB / app in seconds.
You can check out our help videos or register for our upcoming webinar to know more about Zoho Creator.
Happy Building!!
Disclaimer: I work for Zoho Creator
Long time ago, I took and passed the Google Analytics IQ certification test. At the time, I don't believe there were such things as Core Reporting API, Management API, and Metadata API (and probably some other Google Analytics related API's that I don't know about). Now that I am going through the Google Analytics IQ certification training course again (provided by Google, presented by Justin Curtoni?? I believe that's his name), I found that they now have Core Reporting API, Management API, and Metadata API.
I am a computer programmer by trade; so, I have no problem with programming using these API's. However, what I don't understand is, what do these API's buy me that the Google Analytics UI cannot offer? There is no reason to write a program that utilizes these API's simply because I can do it. To me, the existing Google Analytics UI has a lot of tools, reports, and other features that quite extensive. I am hoping that some of you can help me see something that I am probably missing.
The APIs are primarily for programmatic access. For example, if you need to create 1000 accounts all with the same property/view structure and then maybe add a few view filters to each of those accounts, you'll probably want to use the Management API. Doing that by hand would be a nightmare.
The same thing is true for the reporting API. Maybe you want to set up task that runs every monday morning and reports on the previous weeks data. And maybe you want to display that data on an internal dashboard for your company using some fancy charting library. You'd have to use the API to get the data.
Dashboards (executive summaries; managers often want nice visualizations instead of boring drill-downs)
Custom reports for user groups that do not have a Google Account or are not supposed to have access to full reports (e.g. Affiliates)
advanced filtering and aggregation (GA report cannot do everything)
You can combine analytics data with external data (e.g. you are not allowed to store personally identifiable information within GA; but you might store a custom key that allows you to link analytics data to customer data from you CRM or fulfillment system)
Machine-to-machine communication; I once did tracking for an airline that needed trend data on what people where searching for and what they where actually booking; that data was used to allocate/withdraw resources from busy/lame flights, and part of this was done by hooking up GA to their backend system
Take a look at the GA Partner Page. I would say the primary reason is to "liberate" GA Data from outside of GA itself. As Eike mentions, you can create dashboards and combine this data with other sources for a complete "View" of your online presence.
HI I guess there is no definite answer. Here are some things you can do with the APIs:
Automating AdWords CRO based on keyword ad and campaign performance.
Scoring leads based on Analytics data (Engagement with different items) and external data from a CRM.
Collecting unsampled data using multiple daily queries
Filtering using several dimension.
Tracking conversions for periods longer than supported by AdWords.
Looking at a funnel via segments
Analyzing funnels with non-linear structures
Create more robust alerts
Export data to BigQuery and analyse it together with data from other systems.
Create Machine learning apps for behavioural customizing your site.
Create a dashboard with data from multiple views
Use product recommendation to implements "better together" in an online store.
Automate creation of accounts and properties + their integration in a Hosting provider's console.
Cheers!!
We're creating a custom table in SAP comprising all of the information we need and the customer needs the report from this table uploaded to Google Docs. We do not use Business By Design. Is there any other quicka nd easy way to upload our report?
I don't know much about SAP but the Documents List API has methods to programmatically upload a document to Google Docs: https://developers.google.com/google-apps/documents-list/.
For instance, if you can export the SAP table as a csv file, that can be automatically converted into a Google Spreadsheet during the upload process.
You could also go with a no-programming required solution and install the Google Drive app on a machine with access to the files for automatic sync up to Google Drive:
http://support.google.com/drive/bin/answer.py?hl=en&answer=2374989
suggest you take a look at the SAP Developer Network (SDN) / SAP Community Network (SCN) where there is a project called ABAP2GAPPS that has done this.
Note the ABAP2GAPPS example is a bit difficult to figure out (but you can learn a lot from it), and it also uses the OAuth2 'authorization code flow" OAuth2.0 flow/pattern, which requires an end-user 'consent' in an browser pop-up...so if you want to push up a file from ABAP automatically from a background job without end-user interaction then ABAP2GAPPS is not the full answer (but again, ABAP2GAPPS is a great example, suggest you look at it.)
We recently were able to achieve an interface from SAP ABAP to the Google Fusion Table API using OAuth2, with only about a 100 lines of ABAP...and the techniques we employed could be used on any of the Google API's...here's a link to the video:
Link to YouTube video interface ABAP to Google API
hope you find this helpful