How Discord has infinity messages...
Shared by Sandy-ONeill · 98d ago · 6 comments

This was super interesting to read. I wonder how valuable it is to publish your work like this – probably massively. What is the bar under which you operate for privacy concerns? What is the trade-off between attracting engineers to your work and revealing that which is better kept secret?

AndyDent-Touchgram · 96d ago

better kept secret

At that scale, that's not a particularly inventive architecture, interesting read. Very little stuff is so strategic it would have a need to be secret - the attracting engineers win is much higher. I think engineering at this level is more cooperative than not.

Note that it's a 2017 article so any specific warnings about tech limitations or side-effects need to be carefully checked as they are likely to have changed. Note that the tombstone problem they refer to is still a common gotcha in such stores.

I did wonder if there was a much deeper tale of abusive behaviour hidden behind the comment they deleted millions of messages using our API, leaving only 1 message in the channel. This sounds a lot like someone using free Discord chat services as an unofficial database backend.

I have a secondary interest in database engines, not the primary focus of my startup. The level of detail at which key tech insight makes a difference is not likely to be in such a high-level article. The same strategy still applies of companies doing interesting tech talks but to get deeper insight, look at industry talks such as:

DataDog's trillions of rows https://www.youtube.com/watch?v=M8LoF7cJJWQ

Going faster than RocksDB https://www.youtube.com/watch?v=xWNbbkQMtfI

Sandy-ONeill · 84d ago

This would be incredible if true.

I did wonder if there was a much deeper tale of abusive behaviour hidden behind the comment they deleted millions of messages using our API, leaving only 1 message in the channel. This sounds a lot like someone using free Discord chat services as an unofficial database backend.

Thanks for those links!!

Sal · 98d ago

Really interesting read. If the internet has proved anything over time... it's that the more open you are, often the better your outcomes. Have seen so many founders swear by the act of building in public, since it raises your standards and organically grows an audience. Also focuses your intentions and makes you go faster. Thanks for sharing.

Sandy-ONeill · 98d ago

Yeah and clearly it's not a negative, otherwise a company like Netflix wouldn't be doing it, either.

Sal · 98d ago

+1!

sole-fields · 97d ago

Thanks for the share.