Artwork
iconShare
 
Manage episode 516997408 series 3474159
Content provided by HackerNoon. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by HackerNoon or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://staging.podcastplayer.com/legal.

This story was originally published on HackerNoon at: https://hackernoon.com/json-was-killing-our-redis-memory-switching-serialization-made-it-7-smaller.
Cut Redis memory usage by 7× by ditching JSON for Pydantic models. Learn how a custom binary format reduced storage, costs, and overhead at scale.
Check more stories related to programming at: https://hackernoon.com/c/programming. You can also check exclusive content about #python, #pydantic, #object-serialization, #redis-memory, #pybyntic, #protobuf, #messagepack, #hackernoon-top-story, and more.
This story was written by: @yankhachko. Learn more about this writer by checking @yankhachko's about page, and for more stories, please visit hackernoon.com.
Redis was running a large production service with about **10 million monthly active users**. Every record in Redis was a **JSON-serialized Pydantic model** It looked clean and convenient – until it started to hurt. At scale, JSON stops being a harmless convenience and becomes a silent tax on memory.

  continue reading

417 episodes