Jan 02, 2022
Rahul Sharma
<aside>
💡 These are my notes from BigQuery for Data Engineers course on Udemy.
</aside>
I. Introduction
BQ is a fully managed, serverless, highly scalable, and cost-effective cloud data warehouse solution designed for business agility.
Features at a glance
- Both batch and streaming data ingestion, up to 100k rows/s
- ML with BQML, integrates with VertexAI
- Fully managed, no maintenance required
- Pay separately for storage and compute
- Results are cached, no extra charge for repeated queries
- Fully-managed data transfers
- Transfer data from Teradata and S3
- Uses IAM to control access
- Assign permissions by projects
- Supports GIS (PostGIS, WKB, WKT)