Message deduplication | Messaging in distributed systems

Опубликовано: 04 Октябрь 2024
на канале: DevMentors EN
3,566
107

Hi there!
"Messaging in distributed systems" series is back! In the 3rd episode we discuss already mentioned message deduplication which brings us closer to the desired "exactly once processing". How can we come into trouble? Where is the "right" place to handle duplicates? Do we always need additional infrastructure for it? As always, we do start with a bit of theory first, to then dive deeply into the code.

ENJOY!


Repository:
https://github.com/devmentors/Messagi...

More content at: https://devmentors.io

Join our Discord: https://devmentors.io/discord

Follow us:
  / dev_mentors  
  / devmentors  
  / devmentors  
===========

Timecodes
00:00:00 - Intro
00:01:30 - When message duplicates may occur?
00:06:40 - Providing "Exactly-once processing" on app/domain level
00:08:20 - Providing "Exactly-once processing" on infrastructure level
00:09:50 - In-memory deduplication
00:14:20 - Database deduplication
00:20:20 - Code
01:37:35 - Outro