I have set up a daily upload of data from GA4 to BigQuery. Normally the data is loaded a day before, but in the last few days I noticed that the loading process for the 2 days before was happening (on 27 September the data from 25 September was loaded) and now there was no loading process at all. Has anyone else had a problem like this? What could be the reason for this? I have already set up billing so there is no problem with storage.
Thank you.
Related
We use python to programmatically grant authorized view / routine access to a large number of views to various datasets.
However since this week we have been receiving the following error :
Dataset time travel window can only be modified once in 1 hours. The previous change happened 0 hours ago
This is preventing our current deployment process.
And so far we have not been able to find a work around to resolve this error. Note that we do not touch the time travel configurations at all as a part of our process.
This seems to be an issue with the BigQuery API.
Google have said that they will be rolling back the breaking change to restore functionality within the day
I have a View which is populated by a SQL request to a regular dataset. As far as I know, not a soul is looking at that view (at least not very often). But if I go to the View and click on Project History then there is an IAM service account which is running the query every 15 seconds. Each query is shuffling 2.55 MB and reading 70,000 records, so I'd really prefer that it didn't do this.
The dataset source to create the view shows that it's last modified date was 3 days ago, so the service account is not being trigged by a change in the source. I checked the job scheduler and nothin there. So what is triggering it and how can I tell it to calm down?
I am using Firebase to collect event data from my apps, and integrated my Firebase project to BigQuery. Everyday I download daily data from BigQuery to my database. But a few days ago, due to the expiry of my credit card (even Firebase is not charging anything from my card yet), seems like the services stopped. so today I found that I am missing 2 days of data (8-9 May). Is there any possible ways for me to retrieve back those data? Thanks!
Can you check if you can find the data for the two days and load them as batch instead using dataflow?
Can someone help me on this?
Am working on a portal(Website) where all the data comes from another application. I load those data into my application's database table using a SQL Job on hourly basis everyday. The real problem is when the job runs and the data gets started to load into the portal. My portal's behavior is bad. i.e. when a user opens the portal when the job is running he see data mismatch/slow performance etc. But everything becomes normal once the job runs successfully.
Job takes 7 minutes to get complete and the real problem occurs during that 7 mins.
Please help, Thank you in advance.
Project number :149410454586
We are facing the same issue mentioned below
BigQuery streaming insert data availability delay
We are getting the success response from BigQuery , but the data is not visible
while querying it.It is strange that it seemed to happen over a night, till then
it was working fine.
We were supposed to go to deployment for UAT tomorrow and we never expected this
heppen and now helpless, kindly if you could help out on this.
Face the same issue one hour ago. Any streamed in data are not available for queries and it is not a warm-up issue.
Project Number: 272433143339
It seems to be related to https://status.cloud.google.com/incident/bigquery/18010