티스토리 수익 글 보기
BigLake
Build your Apache Iceberg lakehouse with BigLake
Build an open, managed and high-performance Iceberg lakehouse to enable advanced analytics and data science, with automated data management and built-in governance.
Features
Interoperable across transactional and analytical data
BigLake metastore is a serverless metastore for all your Iceberg tables. Engines like Apache Spark, BigQuery, and third party platforms can use it to create and manage tables, giving you a consistent view of your data and unified access controls. BigLake Metastore now supports the Apache Iceberg Rest Catalog for easy integration with OSS and third party engines. Iceberg tables are also data accessible in AlloyDB (Preview), to gain interoperability between transactional and analytical platforms.
Unified data management and governance
BigLake extends Google Cloud Storage management capabilities, enabling you to use storage auto-class for efficient cold data tiering and apply customer-managed encryption keys (CMEK) to your storage buckets. BigLake metastore natively integrates into Dataplex Universal Catalog, ensuring that governance policies defined centrally are consistently enforced across multiple engines while enabling semantic search, data lineage, profiling, and quality checks.
High performance analytics, streaming and AI with BigQuery
BigLake tables for Apache Iceberg offer an enterprise-ready, fully managed Iceberg experience when used with BigQuery. By storing Apache Iceberg data in your own Google Cloud Storage buckets and leveraging BigQuery's highly scalable, real time metadata management capabilities, you get the best of both worlds - the openness and data ownership associated with GCS as well as access to BigQuery's fully managed capabilities with Iceberg data for streaming, advance analytics and AI use cases.
How It Works
Common Uses
Build an open lakehouse with Iceberg
Understanding the Google Cloud components of an open data lakehouse
Understanding the Google Cloud components of an open data lakehouse
To build an Iceberg lakehouse with BigLake, start by storing your data in Cloud Storage. Then, define this data using BigLake tables for Apache Iceberg. The BigLake metastore serves as your centralized, serverless catalog for these Iceberg tables, eliminating the need to manage complex infrastructure. This setup allows any Iceberg-compatible engine to consistently access and manage your data, creating a unified, open, and scalable lakehouse environment with ease.
Tutorials, quickstarts, & labs
Understanding the Google Cloud components of an open data lakehouse
Understanding the Google Cloud components of an open data lakehouse
To build an Iceberg lakehouse with BigLake, start by storing your data in Cloud Storage. Then, define this data using BigLake tables for Apache Iceberg. The BigLake metastore serves as your centralized, serverless catalog for these Iceberg tables, eliminating the need to manage complex infrastructure. This setup allows any Iceberg-compatible engine to consistently access and manage your data, creating a unified, open, and scalable lakehouse environment with ease.
Advanced analytics with BigQuery
Provide real-time insights and predictions for financial services
Provide real-time insights and predictions for financial services
You can use Apache Iceberg for evolving data lake datasets like transactions or market feeds. BigLake enables BigQuery to then query Iceberg tables alongside native storage without data movement. You can ingest real-time streams into BigQuery, combining with historical Iceberg data via BigLake for immediate, comprehensive analysis. BigQuery ML then generates real-time insights like market volatility and fraud detection as well as predictive models like credit risk and customer behavior.
Tutorials, quickstarts, & labs
Provide real-time insights and predictions for financial services
Provide real-time insights and predictions for financial services
You can use Apache Iceberg for evolving data lake datasets like transactions or market feeds. BigLake enables BigQuery to then query Iceberg tables alongside native storage without data movement. You can ingest real-time streams into BigQuery, combining with historical Iceberg data via BigLake for immediate, comprehensive analysis. BigQuery ML then generates real-time insights like market volatility and fraud detection as well as predictive models like credit risk and customer behavior.
Enabling all data users on a single copy of data
BigLake provides secure, consistent access to a single copy of data in Cloud Storage. Dataplex Universal Catalog then automatically catalogs this data so all data users and engines can access. This ensures consistent data definitions, easy discovery, and unified governance, eliminating silos and fostering collaboration on one source of truth.
Tutorials, quickstarts, & labs
BigLake provides secure, consistent access to a single copy of data in Cloud Storage. Dataplex Universal Catalog then automatically catalogs this data so all data users and engines can access. This ensures consistent data definitions, easy discovery, and unified governance, eliminating silos and fostering collaboration on one source of truth.
Pricing
| How BigLake pricing works | BigLake pricing is based on table management, metadata storage and metadata access | |
|---|---|---|
| Services and usage | Description | Price (USD) |
BigLake table management | BigLake table management compute resources used for automatic table storage optimization. | Starting at $0.12 per DCU-Hour |
BigLake metadata storage | BigLake Metastore charges for metadata stored. Free tier includes 1 GiB of metadata storage per month included. | Starting at $0.04 per GiB per month |
BigLake metadata access | Class A Operations: BigLake metadata access charges for writes, updates, list, create, and config operations with a free tier of 5,000 operations per month included. | Starting at $6.00 per million operations |
Class B Operations: BigLake metadata access charges for reads, get, and delete operations with a free tier of 50,000 operations per month included. | Starting at $0.90 per million operations | |
How BigLake pricing works
BigLake pricing is based on table management, metadata storage and metadata access
BigLake table management
BigLake table management compute resources used for automatic table storage optimization.
Starting at
$0.12
per DCU-Hour
BigLake metadata storage
BigLake Metastore charges for metadata stored. Free tier includes 1 GiB of metadata storage per month included.
Starting at
$0.04
per GiB per month
BigLake metadata access
Class A Operations: BigLake metadata access charges for writes, updates, list, create, and config operations with a free tier of 5,000 operations per month included.
Starting at
$6.00
per million operations
Class B Operations: BigLake metadata access charges for reads, get, and delete operations with a free tier of 50,000 operations per month included.
Starting at
$0.90
per million operations
- Accelerate your digital transformation
- Whether your business is early in its journey or well on its way to digital transformation, Google Cloud can help solve your toughest challenges.
- Key benefits
- Featured Products
- AI and Machine Learning
- Business Intelligence
- Compute
- Containers
- Data Analytics
- Databases
- Developer Tools
- Distributed Cloud
- Hybrid and Multicloud
- Industry Specific
- Integration Services
- Management Tools
- Maps and Geospatial
- Media Services
- Migration
- Mixed Reality
- Networking
- Operations
- Productivity and Collaboration
- Security and Identity
- Serverless
- Storage
- Web3
- Featured Products
- Not seeing what you're looking for?
- See all products (100+)
- Not seeing what you're looking for?
- See all AI and machine learning products
- Business Intelligence
- Not seeing what you're looking for?
- See all compute products
- Not seeing what you're looking for?
- See all data analytics products
- Not seeing what you're looking for?
- See all developer tools
- Hybrid and Multicloud
- Industry Specific
- Not seeing what you're looking for?
- See all management tools
- Media Services
- Not seeing what you're looking for?
- See all networking products
- Productivity and Collaboration
- Not seeing what you're looking for?
- See all security and identity products
- Save money with our transparent approach to pricing
- Google Cloud's pay-as-you-go pricing offers automatic savings based on monthly usage and discounted rates for prepaid resources. Contact us today to get a quote.
- Pricing overview and tools
- Learn & build
- Connect
- Accelerate your digital transformation
- Learn more
- Key benefits
- Why Google Cloud
- AI and ML
- Multicloud
- Global infrastructure
- Data Cloud
- Modern Infrastructure Cloud
- Security
- Productivity and collaboration
- Reports and insights
- Executive insights
- Analyst reports
- Whitepapers
- Customer stories
- Industry Solutions
- Retail
- Consumer Packaged Goods
- Financial Services
- Healthcare and Life Sciences
- Media and Entertainment
- Telecommunications
- Games
- Manufacturing
- Supply Chain and Logistics
- Government
- Education
- See all industry solutions
- See all solutions
- Application Modernization
- CAMP
- Modernize Traditional Applications
- Migrate from PaaS: Cloud Foundry, Openshift
- Migrate from Mainframe
- Modernize Software Delivery
- DevOps Best Practices
- SRE Principles
- Platform Engineering
- Run Applications at the Edge
- Architect for Multicloud
- Go Serverless
- Artificial Intelligence
- Customer Engagement Suite with Google AI
- Document AI
- Vertex AI Search for commerce
- Google Cloud with Gemini
- Generative AI on Google Cloud
- APIs and Applications
- New Business Channels Using APIs
- Unlocking Legacy Applications Using APIs
- Open Banking APIx
- Data Analytics
- Data Migration
- Data Lakehouse
- Real-time Analytics
- Marketing Analytics
- Datasets
- Business Intelligence
- AI for Data Analytics
- Geospatial Analytics
- Databases
- Database Migration
- Database Modernization
- Databases for Games
- Google Cloud Databases
- Migrate Oracle workloads to Google Cloud
- Open Source Databases
- SQL Server on Google Cloud
- Gemini for Databases
- Infrastructure Modernization
- Application Migration
- SAP on Google Cloud
- High Performance Computing
- Windows on Google Cloud
- Data Center Migration
- Active Assist
- Virtual Desktops
- Rapid Migration and Modernization Program
- Backup and Disaster Recovery
- Red Hat on Google Cloud
- Cross-Cloud Network
- Observability
- Productivity and Collaboration
- Google Workspace
- Google Workspace Essentials
- Cloud Identity
- Chrome Enterprise
- Security
- Agentic SOC
- Web App and API Protection
- Security and Resilience Framework
- Risk and compliance as code (RCaC)
- Software Supply Chain Security
- Security Foundation
- Google Cloud Cybershield™
- Startups and SMB
- Startup Program
- Small and Medium Business
- Software as a Service
- Featured Products
- Compute Engine
- Cloud Storage
- BigQuery
- Cloud Run
- Google Kubernetes Engine
- Vertex AI
- Looker
- Apigee API Management
- Cloud SQL
- Gemini Enterprise
- Cloud CDN
- See all products (100+)
- AI and Machine Learning
- Vertex AI Platform
- Vertex AI Studio
- Vertex AI Agent Builder
- Conversational Agents
- Vertex AI Search
- Speech-to-Text
- Text-to-Speech
- Translation AI
- Gemini Enterprise
- Vision AI
- Contact Center as a Service
- See all AI and machine learning products
- Business Intelligence
- Looker
- Looker Studio
- Compute
- Compute Engine
- App Engine
- Cloud GPUs
- Migrate to Virtual Machines
- Spot VMs
- Batch
- Sole-Tenant Nodes
- Bare Metal
- Recommender
- VMware Engine
- Cloud Run
- See all compute products
- Containers
- Google Kubernetes Engine
- Cloud Run
- Cloud Build
- Artifact Registry
- Cloud Code
- Cloud Deploy
- Migrate to Containers
- Deep Learning Containers
- Knative
- Data Analytics
- BigQuery
- Looker
- Dataflow
- Pub/Sub
- Dataproc
- Google Cloud Serverless for Apache Spark
- Cloud Composer
- BigLake
- Dataplex Universal Catalog
- BigQuery Migration Services
- Managed Service for Apache Kafka
- See all data analytics products
- Databases
- AlloyDB for PostgreSQL
- Cloud SQL
- Firestore
- Spanner
- Bigtable
- Datastream
- Database Migration Service
- Bare Metal Solution
- Memorystore
- Developer Tools
- Artifact Registry
- Cloud Code
- Cloud Build
- Cloud Deploy
- Cloud Deployment Manager
- Cloud SDK
- Cloud Scheduler
- Cloud Source Repositories
- Infrastructure Manager
- Cloud Workstations
- Gemini Code Assist
- See all developer tools
- Distributed Cloud
- Google Distributed Cloud Connected
- Google Distributed Cloud Air-gapped
- Hybrid and Multicloud
- Google Kubernetes Engine
- Apigee API Management
- Migrate to Containers
- Cloud Build
- Observability
- Cloud Service Mesh
- Google Distributed Cloud
- Industry Specific
- Anti Money Laundering AI
- Cloud Healthcare API
- Device Connect for Fitbit
- Telecom Network Automation
- Telecom Data Fabric
- Telecom Subscriber Insights
- Spectrum Access System (SAS)
- Integration Services
- Application Integration
- Workflows
- Apigee API Management
- Cloud Tasks
- Cloud Scheduler
- Dataproc
- Cloud Data Fusion
- Cloud Composer
- Pub/Sub
- Eventarc
- Management Tools
- Cloud Shell
- Cloud console
- Cloud Endpoints
- Cloud IAM
- Cloud APIs
- Service Catalog
- Cost Management
- Observability
- Carbon Footprint
- Config Connector
- Active Assist
- See all management tools
- Maps and Geospatial
- Earth Engine
- Google Maps Platform
- Media Services
- Cloud CDN
- Live Stream API
- OpenCue
- Transcoder API
- Video Stitcher API
- Migration
- Migration Center
- Application Migration
- Migrate to Virtual Machines
- Cloud Foundation Toolkit
- Database Migration Service
- Migrate to Containers
- BigQuery Migration Services
- Rapid Migration and Modernization Program
- Transfer Appliance
- Storage Transfer Service
- VMware Engine
- Mixed Reality
- Immersive Stream for XR
- Networking
- Cloud Armor
- Cloud CDN and Media CDN
- Cloud DNS
- Cloud Load Balancing
- Cloud NAT
- Cloud Connectivity
- Network Connectivity Center
- Network Intelligence Center
- Network Service Tiers
- Virtual Private Cloud
- Private Service Connect
- See all networking products
- Operations
- Cloud Logging
- Cloud Monitoring
- Error Reporting
- Managed Service for Prometheus
- Cloud Trace
- Cloud Profiler
- Cloud Quotas
- Productivity and Collaboration
- AppSheet
- Gemini Enterprise
- Google Workspace
- Google Workspace Essentials
- Cloud Identity
- Chrome Enterprise
- Security and Identity
- Cloud IAM
- Sensitive Data Protection
- Mandiant Managed Defense
- Google Threat Intelligence
- Security Command Center
- Cloud Key Management
- Mandiant Incident Response
- Chrome Enterprise Premium
- Assured Workloads
- Google Security Operations
- Mandiant Consulting
- See all security and identity products
- Serverless
- Cloud Run
- Cloud Functions
- App Engine
- Workflows
- API Gateway
- Storage
- Cloud Storage
- Block Storage
- Filestore
- Persistent Disk
- Cloud Storage for Firebase
- Local SSD
- Storage Transfer Service
- Google Cloud Managed Lustre
- Google Cloud NetApp Volumes
- Backup and DR Service
- Web3
- Blockchain Node Engine
- Blockchain RPC
- Save money with our transparent approach to pricing
- Request a quote
- Pricing overview and tools
- Google Cloud pricing
- Pricing calculator
- Google Cloud free tier
- Cost optimization framework
- Cost management tools
- Product-specific Pricing
- Compute Engine
- Cloud SQL
- Google Kubernetes Engine
- Cloud Storage
- BigQuery
- See full price list with 100+ products
- Learn & build
- Google Cloud Free Program
- Solution Generator
- Quickstarts
- Blog
- Learning Hub
- Google Cloud certification
- Cloud computing basics
- Cloud Architecture Center
- Connect
- Innovators
- Developer Center
- Events and webinars
- Google Cloud Community
- Consulting and Partners
- Google Cloud Consulting
- Google Cloud Marketplace
- Find a partner
- Google Cloud partners










