Google Analytics for Firebase link to BigQuery.
My Firebase Project send the app log data over 950,000 records to BigQuery in a day.
BigQuery has two intraday tables for the past two days.
And yesterday intraday table has disappear around noon and archived for events table.
The document shows that intraday table is shown only today.
https://support.google.com/firebase/answer/7029846?hl=en&ref_topic=7029512
But why BigQuery has two intraday tables for the past two days? Do my setting is something wrong?
Or does it just takes a time to process the daily log which is large?
I would like to know it is right behavior for BigQuery.
If not so, I think my linking setting Firebase to BigQuery is something wrong.
I Attached two intraday tables for the past two days.
enter image description here
Best Regards,
Related
I've been running the GA4 to BigQuery Streaming export for over a month now because the amount of daily events is bigger than the daily export limit (currently around 1.5 million events per day).
Google docs (https://support.google.com/analytics/answer/7029846#tables): If the Streaming export option is enabled, a table named events_intraday_YYYYMMDD is created. This table is populated continuously as events are recorded throughout the day. This table is deleted at the end of each day once events_YYYYMMDD is complete.
According to the docs I should have events_YYYYMMDD tables for previous days and events_intraday_YYYYMMDD table for current day. But that's not the case - all I'm stuck with are events_intraday_YYYYMMDD tables for previous days.
This is the same issue reported in the following posts (I actually copied and pasted from the first post):
BigQuery events_intraday_ tables are being generated daily but no daily events_ table is created
Firebase Analytics doesn't export events table to Bigquery, even though streaming export is enabled
GA4 exports only intraday tables to BigQuery
Unfortunately, none of these posts have a solution and I don't yet have enough reputation here on SO to post a comment to them. I'm currently not paying for Google support because I'm still evaluating GA4, so I’m hoping someone here can provide an answer (and maybe then I can share it with the other's that had the same problem).
I'm trying to export my Google Analytics data from Firebase into Bigquery.
About 3 weeks ago the connector in Firebase was enabled with the "Streaming" export setting.
Just recently I decided to check BigQuery to start making some views and noticed that there is only 3 weeks' worth of "intraday" tables, which I understand are staging tables of sorts.
However, as per the documentation, there should also be another another table containing all the data simply called "events_", but these are completely missing:
"You should query events_YYYYMMDD rather than
events_intraday_YYYYMMDD"
https://support.google.com/analytics/answer/9358801?authuser=0
Where is the "events_" table? Is it safe to use the event_intraday tables instead despite what the documentation says?
I recently linked my GA4 property to bigquery to better look at the analytics data. That was initially on daily, so every day the data was exported from Google Analytics to Bigquery. However, I decided that streaming is necessary so I switched from daily to streaming in the BigQuery Linking section of GA4's admin tab. However, that streaming data is not showing up after a few hours. I'm wondering if anyone has done this with similar problems. Do I need to recreate an entire bigquery project?
If you look at your configuration options for GA to BigQuery, you will see a message under the streaming option.
This option will take effect after the next date boundary (tomorrow) for this property.
This property = the "Data exported continuously" option (streaming)
You will probably see your data tomorrow.
I am using Firebase to collect event data from my apps, and integrated my Firebase project to BigQuery. Everyday I download daily data from BigQuery to my database. But a few days ago, due to the expiry of my credit card (even Firebase is not charging anything from my card yet), seems like the services stopped. so today I found that I am missing 2 days of data (8-9 May). Is there any possible ways for me to retrieve back those data? Thanks!
Can you check if you can find the data for the two days and load them as batch instead using dataflow?
I have some simple weekly aggregates from Google analytics that i'd like to store somewhere. The reason for storing is because if I run a query against too much data in google analytics, it becomes sampled and I want it to be totally accurate.
What is the best way to solve this?
My thoughts are:
1) Write a process in bigquery to append the data each week to a permanent dataset
2) Use an API that gets the data each week and stores the data in a google spreadsheet (appending a line each time)
What is the best recommendation for my problem - and how do I go about executing it?
Checking your previous questions, we see that you already use Bigquery.
When you run a query against the Google Analytics tables that is not sampled, as that has all the data in it. There is no need to store as you can query every time you need.
In case if you want to store, and pay for the addition table, you can go ahead store in a destination table.
If you want to access quickly, try creating a view.
I suggest the following:
1) make a roll-up table for your weekly data - you can do that either by writing a query for it and running manually or with a script in a Google Spreadsheet that uses the same query (using the API) and is scheduled to run every week. I tried a bunch of the tutorials out there and this one is the simplest to implement
2) depending on the data points you want, you can even use the Google Analytics API without having to go through BigQuery for this request, try pulling this report of yours from here . If it works there are a bunch of Google Sheets extensions that can make it a lot quicker to set up a weekly report. Or you can just code it yourself
Would that work for you?
thks!