BigQuery + Data Studio (pricing, upload limits, formatting)

Опубликовано: 10 Октябрь 2024
на канале: Cacheworthy
2,482
22

Questions (from Mihaela):
1. If I pull the data from BiqQuery, will Google charge me or not for sending the data to Data Studio?
2. Is there any limit (in Mb) when uploading a CSV into BigQuery?
3. When uploading a CSV in BigQuery, data field has a specific format. When connecting the table to Data Studio, the field is not recognized as a date ( because the format is not YYYYMMDD). Do you have any idea how to deal with it?

Answers:
1. Google charges per query with BigQuery, and Data Studio connections
are subject to standard BigQuery pricing - minimum query size is 10mb.

Highly recommend only querying tables (rather than views) to limit your query size from Data Studio."
https://cloud.google.com/bigquery/pri...

2. 10MB / 16,000 rows is the limit when loading a local CSV file.
https://cloud.google.com/bigquery/doc...
You can load much more data using the CIFL Sheets to BigQuery connector template (128MB I believe) - grab it from the Vault at:
https://trello.com/c/Va746r6h/9-the-s...

3. I'd create a data model (a new table) in BigQuery that transforms dates to 'YYYY-MM-DD' format to be readable by Data Studio.
"At CIFL we use DBT to build these models and their tool Sinter to run them on a schedule:
https://getdbt.com and https://sinterdata.com