What is a pub-sub system?

Publish-subscribe messaging, often known as pub-sub messaging, is an asynchronous service-to-service communication method that’s popular in serverless and microservices architectures. Messages can be sent asynchronously to different subsystems of a system using the pub-sub system. All the services subscribed to the pub-sub model receive the message that’s pushed into the system.

For example, when a famous athlete posts on Instagram or shares a tweet, all of their followers are updated. Here, the athlete is the publisher, their post or tweet is the message, and all of their followers are subscribers.

Motivation

The hardware infrastructure of distributed systems consists of millions of machines. Using a pub-sub system to communicate asynchronously increases scalability. Producers and consumers are disconnected and operate independently, thereby allowing us to scale and develop them separately. The decoupling between components, producers and consumers, allows greater scalability because adding or removing any component doesn’t affect the other components.

How do we design a pub-sub system? We have divided the pub-sub system design into the following lessons:

Introduction: In this lesson, we learn about the use cases of the pub-sub system, define its requirements, and design the API for it.

Design: In this lesson, we discuss two designs of the pub-sub system, one with messaging queues and the other with a broker.

System Design: Lesson 13.2 - Introduction to Pub-Sub

Pub-sub messaging offers asynchronous communication. Let’s explore the use cases where it is beneficial to have a pub-sub system.

Use cases of pub-sub

A few use cases of pub-sub are listed below:

Improved performance: The pub-sub system enables push-based distribution, alleviating the need for message recipients to check for …

System Design: Lesson 13.3 - Design of a Pub-Sub System

First design In the previous lesson, we discussed that a producer writes into topics, and consumers subscribe to a topic to read messages from that topic. Since new messages are added at the end of the queue, we can use distributed messaging queues for topics.

The components we’ll need …

Dao Malick BENIN

Other articles

System Design: Lesson 13.2 - Introduction to Pub-Sub

Use cases of pub-sub

System Design: Lesson 13.3 - Design of a Pub-Sub System

Other articles

Use cases of pub-sub

links

social