티스토리 수익 글 보기

티스토리 수익 글 보기

Pub/Sub for Application & Data Integration | Google Cloud

Explore and analyze data with a prebuilt, Google-recommended data warehouse solution that uses BigQuery, Looker Studio, and AI. Try it free.

Jump to
Pub/Sub

Pub/Sub

Ingest events for streaming into BigQuery, data lakes or operational databases.

New customers get $300 in free credits to spend on Pub/Sub. All customers get up to 10 GB for ingestion or delivery of messages free per month, not charged against your credits.

  • Deploy an example data warehouse solution to explore, analyze, and visualize data using BigQuery and Looker Studio. Plus, apply generative AI to summarize the results of the analysis.

  • Ingest analytic events and stream them to BigQuery with Dataflow

  • No-ops, secure, scalable messaging or queue system

  • In-order and any-order at-least-once message delivery with pull and push modes

  • Secure data with fine-grained access controls and always-on encryption 

Pub/Sub logo connecting to different devices

VIDEO

Learn Pub/Sub in a minute, including how it works and common use cases

1:45

Benefits

High availability made simple

Synchronous, cross-zone message replication and per-message receipt tracking ensures reliable delivery at any scale.

No-planning, auto-everything

Auto-scaling and auto-provisioning with no partitions eliminates planning and ensures workloads are production ready from day one.

Easy, open foundation for real-time data systems 

A fast, reliable way to land small records at any volume, an entry point for real-time and batch pipelines feeding BigQuery, data lakes and operational databases. Use it with ETL/ELT pipelines in Dataflow.   

Key features

Key features

Stream analytics and connectors

Native Dataflow integration enables reliable, expressive, exactly-once processing and integration of event streams in Java, Python, and SQL.

In-order delivery at scale

Optional per-key ordering simplifies stateful application logic without sacrificing horizontal scale—no partitions required.

Simplified streaming ingestion with native integrations

Ingest streaming data from Pub/Sub directly in BigQuery or Cloud Storage with our native subscriptions.



Documentation

Documentation

Google Cloud Basics

What is Pub/Sub?

Get a comprehensive overview of Pub/Sub, from core concepts and message flow to common use cases and integrations.

Tutorial

Introduction to Pub/Sub

Learn how to enable Pub/Sub in a Google Cloud project, create a Pub/Sub topic and subscription, and publish messages and pull them to the subscription.

Quickstart

Quickstart: Using client libraries

See how the Pub/Sub service allows applications to exchange messages reliably, quickly, and asynchronously.

Tutorial

In-order message delivery

Learn how scalable message ordering works and when to use it.

Quickstart

Quickstart: Stream processing with Dataflow

Learn how to use Dataflow to read messages published to a Pub/Sub topic, window the messages by timestamp, and write the messages to Cloud Storage.

Tutorial

Guide: Publishing messages to topics

Learn how to create a message containing your data and send a request to the Pub/Sub Server to publish the message to the desired topic.

Not seeing what you’re looking for?

Release notes
Read about the latest releases for Pub/Sub

Use cases

Use cases

Use case
Stream analytics

Google’s stream analytics makes data more organized, useful, and accessible from the instant it’s generated. Built on Pub/Sub along with Dataflow and BigQuery, our streaming solution provisions the resources you need to ingest, process, and analyze fluctuating volumes of real-time data for real-time business insights. This abstracted provisioning reduces complexity and makes stream analytics accessible to both data analysts and data engineers.

Flow across 5 columns, from Trigger, to Ingest, Enrich, Analyze, & Activate. Each column has top and bottom section. In top of Trigger column are edge devices (mobile, web, Data Store, and IoT) which flow to Pub/Sub in Ingest column, and on to Enrich column and Apache Beam / Dataflow Streaming, then down to Analyze and then Activate boxes where it flows back to edge devices in Col 1. From Apache Beam in col 3, flows back and forth to Analyze column, into BigQuery, AI Platform, and Bigtable: all 3 are flowed into by Backfill/ Reprocess - Dataflow Batch. Flow moves from BigQuery to Activate column, into Data Studio, Third-party BI, and Cloud Functions, which flows back to edge devices in column 1. In bottom section of columns, it says Creation Flow: Trigger says “Configure source to push event message to Pub/Sub topic.” Flows to Ingest “Create Pub/Sub Topic and subscription.” To Enrich “Deploy streaming or batch Dataflow job using templates, CLI, or notebooks.” To Analyze “Create dataset, tables, and models to receive stream.” To Activate “Build real-time dashboards and call external APIs.”
Use case
Asynchronous microservices integration

Pub/Sub works as a messaging middleware for traditional service integration or a simple communication medium for modern microservices. Push subscriptions deliver events to serverless webhooks on Cloud Functions, App Engine, Cloud Run, or custom environments on Google Kubernetes Engine or Compute Engine. Low-latency pull delivery is available when exposing webhooks is not an option or for efficient handling of higher throughput streams.

Generate a solution
What problem are you trying to solve?
What you'll get:
Step-by-step guide
Reference architecture
Available pre-built solutions
This service was built with Vertex AI. You must be 18 or older to use it. Do not enter sensitive, confidential, or personal info.

All features

All features

At-least-once delivery

Synchronous, cross-zone message replication and per-message receipt tracking ensures at-least-once delivery at any scale.

Open

Open APIs and client libraries in seven languages support cross-cloud and hybrid deployments.

Exactly-once processing

Dataflow supports reliable, expressive, exactly-once processing of Pub/Sub streams.

No provisioning, auto-everything

Pub/Sub does not have shards or partitions. Just set your quota, publish, and consume.

Compliance and security

Pub/Sub is a HIPAA-compliant service, offering fine-grained access controls and end-to-end encryption.

Google Cloud–native integrations

Take advantage of integrations with multiple services, such as Cloud Storage and Gmail update events and Cloud Functions for serverless event-driven computing.

Third-party and OSS integrations

Pub/Sub provides third-party integrations with  Splunk and Datadog for logs along with Striim and Informatica for data integration. Additionally, OSS integrations are available through Confluent Cloud for Apache Kafka and Knative Eventing for Kubernetes-based serverless workloads.

Seek and replay

Rewind your backlog to any point in time or a snapshot, giving the ability to reprocess the messages. Fast forward to discard outdated data.

Dead letter topics

Dead letter topics allow for messages unable to be processed by subscriber applications to be put aside for offline examination and debugging so that other messages can be processed without delay.

Filtering

Pub/Sub can filter messages based upon attributes in order to reduce delivery volumes to subscribers.

Pricing

Pricing

Pub/Sub pricing is calculated based upon monthly data volumes. The first 10 GB of data per month is offered at no charge. 

Monthly data volume1

Price per TB2

First 10 GB

$0.00

Beyond 10 GB

$40.00

1 For detailed pricing information, please consult the pricing guide.

2 TB refers to a tebibyte, or 240 bytes.

If you pay in a currency other than USD, the prices listed in your currency on Cloud Platform SKUs apply.

Take the next step

Start building on Google Cloud with $300 in free credits and 20+ always free products.

Google Cloud
send_spark
    DocsSupport
    Console
    Sign in
    Cloud Pub/Sub
    • Accelerate your digital transformation
    • Whether your business is early in its journey or well on its way to digital transformation, Google Cloud can help solve your toughest challenges.
    • Featured Products
    • Business Intelligence
    • Hybrid and Multicloud
    • Industry Specific
    • Media Services
    • Mixed Reality
    • Productivity and Collaboration
    • Save money with our transparent approach to pricing
    • Google Cloud's pay-as-you-go pricing offers automatic savings based on monthly usage and discounted rates for prepaid resources. Contact us today to get a quote.
    Google Cloud