I have a Firebase application which is uploading events with parameters. I need to be able to view those events in order to debug some issues we're having in production. I can only see the tables which are generated nightly in BigQuery. I can find references online saying that BigQuery allows viewing real time data. What I can't find is any straightforward instructions on how to create those views.
Is it possible? If so, can someone give me instructions that even a complete newb could follow?
We have decided to use the BigQuery APIs for information we want to see immediately in the database.
Related
I'm trying to figure out at what time people request content from a website (such as 'www.netflix.com'), do any of the avalible reports contain this data? If so how would I access it?
I've had a look around and can't see a table that has this data. Would anywhere else store it?
If you meant reports that available in BigQuery, I would suggest exploring BigQuery Public Datasets. At the moment I do not see any website access datasets but might still be useful for your reference.
We use the BigQuery Sandbox integration in Firebase to pull all of our app reporting. For one of our projects, it looks like a number of historic event tables are missing. I've checked the logs in GCP and it doesn't appear that anyone has deleted them.
Could someone offer assistance on what could cause this to happen and how to retrieve the missing files?
Thanks!
I would like to improve the quality of existing data by using the Google BigQuery API to help validate the accuracy of existing data.
I dont see information on the types of data elements contained in the BigQuery and dont understand how to use an API if I just want to see what types of data are contained in there.
I tried looking for instructions and data elements in the Google Health Care API and Google BigQuery documentation and only saw how to set up a payment option.
I am a newbie at programming and wanted to do some preliminary research on these data sets prior to bringing them to our technical team.
I expect to see a list of relevant results based on a custom query.
You can see the data types supported
by Google BigQuery here and the conversion between different types here.
Also you can try out the BigQuery APIs in the OAuthPlayGround.
Not great at programming so not all that confident of being able to pull data from the Google API.
Basically what I'm trying to do is pull everything from Google Analytics, all data and dump it into a table on a SQL Server (2008 R2). What would be the best way of achieving this?
Would like to automate the process so that it could be scheduled say once a month.
Cheers
There an existing add-on specifically for accessing Google Analytics.
Haven't used it but from what I read seems like it will exactly what you are looking for
http://www.google.com/analytics/apps/about?app_id=1325007
There is a specific SSIS DataSource Component for that – https://analyticssource.codeplex.com
It is open source and free.
I am using BigQuery for SEO reasons. I am a search TC and I am a little confused why you are not using the Google Forum as I thought that was standard. What I want to use BigQuery for is to pull when my competitors change data on their website and which pages that were changed. So I need the URL that was changed and when it was changed (date) so I can also pull the page title and description to see what they are doing different than I am.
Is there anyone that knows how to use BigQuery to pull:
Date the page was changed
URL
Title
Description
We've switched to using Stack Overflow for support for many of our developer products, such as BigQuery. There's a great community here on StackOverflow, and the interface for formatting technical questions and interacting with the community is fantastic.
BigQuery does not collect the data for you-- it's a cloud service for performing ad hoc queries on massive datasets. Before first performing the queries, you need to upload the data to the service (as a CSV format).
So, if you have a job which collects this data -- URL, title, description, date and perhaps a hash of the webpage, you could potentially ingest a CSV file of this data into BigQuery and use it to understand when webpages have changed.
Of course, there are also 3rd-party services (such as Changedetection.com) which may be easier to use for your purposes.