The 1000x faster financial database (Interview)

The Changelog: Software Development, Open Source

In July of 2020, Joran Dirk Greef stumbled into a fundamental limitation in the general-purpose database design for transaction processing. This sent him on a path that ended with TigerBeetle, a redesigned distributed database for financial transactions that yielded three orders of magnitude faster OLTP performance over the usual (general-purpose) suspects.

On this episode, Joran joins Jerod to explain how TigerBeetle got so fast, to defend its resilience and durability claims as a new market entrant, and to stake his claim at the intersection of open source and business. Oh, plus the age old question: Why Zig?

Join the discussion

Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

• Augment Code – Developer AI that uses deep understanding of your large codebase and how you build software to deliver personalized code suggestions and insights. Augment provides relevant, contextualized code right in your IDE or Slack. It transforms scattered knowledge into code or answers, eliminating time spent searching docs or interrupting teammates.
• Depot – Build faster. Waste less time. Accelerate Docker image builds, and GitHub Actions workflows. Easily integrate with your existing CI provider and dev workflows to save hours of build time.
• Notion – Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It’s a workspace designed not just for making progress, but getting inspired. Notion is for everyone — whether you’re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs.

Featuring:

• Joran Dirk Greef – GitHub, LinkedIn, X
• Jerod Santo – GitHub, LinkedIn, Mastodon, X

Show Notes:

• TigerBeetle website
• TigerBeetle Simulator
• TigerBeetle Architecture
• TigerStyle
• Zig website

Something missing or broken? PRs welcome!

Bab

1. Welcome to The Changelog (00:00:00)

2. Sponsor: Augment Code (00:01:25)

https://www.augmentcode.com

3. Start the show! (00:04:33)

4. Stumbling into it (00:05:18)

5. Maybe I did it wrong (00:08:27)

6. It's the row locks (00:09:41)

7. Pareto meets the Mag 7 (00:11:33)

8. Financial, not SQL, transactions (00:13:40)

9. A specialized database (00:14:51)

10. Why build yet another database? (00:18:01)

11. Sponsor: Depot (00:22:56)

https://depot.dev

12. Where do you start? (00:25:16)

13. Who is 'we'? (00:27:46)

14. 10_000x faster?! (00:29:09)

15. New world, new constraints (00:30:44)

16. Row, column, mulit-major (00:32:14)

17. Multi-row major implications (00:36:08)

18. Embarrassingly simple (00:41:45)

19. On durability (00:44:36)

20. Centuries of testing (00:55:05)

21. What about real-world use tho (00:57:17)

22. Worst-case scenario logic (01:02:38)

23. Sponsor: Notion (01:03:55)

http://notion.com/changelog

24. TigerBeetle Simulator (01:07:03)

https://sim.tigerbeetle.com/

25. The open source story (01:15:38)

26. Jerod reacts (01:25:56)

27. What about AWS re-hosting (01:26:18)

28. Written in Zig (01:30:57)

29. Redis open source again? (01:36:28)

30. Wrapping up (01:37:28)

31. Closing thoughts (01:38:10)