Saturday, 2 February 2008

Tokyo Cabinet

Mikio Hirabayashi is known for QDBM embedded database library and Hyper Estrailer, an open-source search engine. He has a brand new project, called Tokyo Cabinet. It has several advantages over QDBM.

It produces smaller database files, processes them faster, has a more simple API, multi-threaded support, more robustness, no database corruption, 64-bit support. It still restricts a single process to access one database at a time, to user fixed key and value sizes.

Tokyo Cabinet is the fastest DB engine, I've ever seen. You really should check out the benchmarks here (PDF). A million of records can be stored in 1.5 seconds to a hash table, and in 2.2 seconds to a B+ tree. The Overhead is 16 bytes per record in hash, and 5 bytes for B+ tree.

Also Brian Aker is developing a MySQL storage engine on it.

No comments: