Data Integration
Google Cloud Pub/Sub
Google Cloud Pub/Sub is a global, fully managed messaging and event-ingestion service that decouples producers from consumers using topics, subscriptions, and push/pull delivery. It offers at-least-once delivery, ordered messages within a key, automatic scaling by throughput, and integrates natively with Cloud Functions, Dataflow, and BigQuery, operating as a serverless, region-independent event bus.
Google Cloud
Service information
Shortname: Pub/Sub
Huawei equivalent shortnames: DIS, DMS
Keywords: events, stream, ingestion
Differences vs Huawei
Pub/Sub is a single serverless product covering both high-throughput ingestion and fan-out messaging, while Huawei splits these concerns: DIS is a Kafka-compatible streaming-ingestion front end tuned for collecting logs, IoT, and file/agent feeds into analytics sinks, and DMS (Kafka/RocketMQ/RabbitMQ editions) is a managed message-broker family for decoupling microservices. The two Huawei targets are not interchangeable: DIS emphasizes connectors to OBS/DLI/MRS/DWS and short 1-3 day caching, whereas DMS persists messages on broker instances with replay, dead-letter, and ordering semantics. Map Pub/Sub topics to DIS only when the consumer is an analytics pipeline, and to DMS Kafka when consumers are applications needing broker-level subscriptions.
APIs and data models diverge significantly. Pub/Sub exposes a Google proprietary publisher/subscriber API and gRPC with ordering keys; Huawei DIS uses REST/SDK plus Kafka-style partitioned streams, and DMS for Kafka exposes the native Kafka protocol, so client libraries differ. Delivery semantics also differ: Pub/Sub provides at-least-once with key-ordered delivery and a push delivery model to HTTPS endpoints, while DMS Kafka is pull-based with partition ordering and RocketMQ/RabbitMQ offer push or pull. No Huawei service offers a one-click protocol translation from the Pub/Sub SDK, so publishers and subscribers must be re-coded against the chosen Huawei API.
Scaling, HA, and operational responsibility differ. Pub/Sub is serverless with invisible infrastructure and global routing, billed on message volume and throughput; DIS scales by adding partitions (per-partition daily ~100 GB) and stores data across AZs with a cited 99.9% SLA, while DMS runs provisioned instances where you select brokerspecification, replicas, and AZ count and are billed by instance hours plus storage. Cross-region fan-out, schema registry, and IAM-secured subscriptions in Pub/Sub must be re-architected onto Huawei IAM, regional DIS/DMS instances, and optional services, shifting operational responsibility for capacity and topology back onto the team.
Migration to Huawei
Assess workload shape before choosing a target. Pure event-to-analytics pipelines (logs, IoT, file-to-lake) map to DIS, which is Kafka-compatible and couples to OBS, DLI, MRS, DWS, and FunctionGraph via built-in connectors. Application-decoupling fan-out with durable subscriptions maps to DMS, selecting the Kafka edition for high throughput with ordering, RocketMQ for delay/retry/dead-letter, or RabbitMQ for AMQP priority queues. Do not assume feature parity: validate ordered delivery, replay, exactly-once-once semantics, schema handling, and regional availability per service before committing to a design.
Migrate data and configuration by re-platforming clients rather than exporting state. For DIS, recreate streams/partitions and retention, then repoint publishers using the DIS REST API or Kafka client and re-deploy agents for file ingestion; use CDM or DataArts for batch historical loads into OBS/DLI. For DMS Kafka, follow Huawei's documented Kafka business-migration path by exporting consumer offsets, creating mirror topics, and using MirrorMaker/replication to bridge the cut-over; reconfigure IAM, VPC endpoints, SSL/SASL, and quota sizing for the chosen instance specification in the target region.
Validate delivery, ordering, and replay before cutover. Stand up parallel consumers against the Huawei target, compare throughput, end-to-end latency, and per-partition ordering against Pub/Sub, and confirm subscription acknowledgment, dead-letter behavior, and retention windows match your reliability targets. Run dual-write or shadow traffic for telemetry-dependent consumers, verify connector output into OBS/DLI/MRS matches downstream schema, and checkpoint offsets so you can roll back. Confirm DMS instance specification and DIS partition counts hold at peak load plus headroom.
Mind pricing and governance gaps. Pub/Sub bills per message and throughput tiers serverlessly; Huawei bills DIS by stream/partition capacity plus storage/transfer and DMS by instance hours plus storage, so recompute TCO with peak throughput, retention, and cross-region traffic. Cross-region/global delivery native to Pub/Sub is not automatic in Huawei and may require regional instances, ROMA/CDM/DataArts for integration, security, and governance. There is no one-click migration; budget re-coding, testing, and operational ownership of broker/stream capacity into the plan.
Huawei Cloud
Huawei equivalent service
Shortname: DIS
General function: Data Integration
Ingest streaming and batch data into analytics platforms.
Keywords: ingestion, stream, data pipeline
Huawei equivalent service
Shortname: DMS
General function: Messaging
Managed message service framework.
Keywords: message queue, messaging, stream