Blogs

Apache-ORC Quick Investigation

October 5, 2022 · 575 words · 3 min · Column Store Big Data Storage

Iceberg supports both ORC and Parquet columnar formats. Compared to Parquet, ORC offers advantages in query performance and ACID support. Considering the future data lakehouse requirements for query …

Apache-Iceberg Quick Investigation

October 5, 2022 · 1216 words · 6 min · Lakehouse Storage Big Data

A table format for large-scale analysis of datasets. A specification for organizing data files and metadata files. A schema semantic abstraction between storage and computation. Developed and …

LevelDB Write

May 10, 2022 · 718 words · 4 min · LevelDB LSM Storage

This is the second chapter of my notes on reading the LevelDB source code, focusing on the write flow of LevelDB. This article is not a step-by-step source code tutorial, but rather a learning note …

MIT6.824-RaftKV

April 15, 2022 · 1039 words · 5 min · Raft Distributed System MIT6.824

Earlier, I looked at the code of Casbin-Mesh because I wanted to try GSOC. Casbin-Mesh is a distributed Casbin application based on Raft. This RaftKV in MIT6.824 is quite similar, so I took the …

LevelDB Startup

April 9, 2022 · 1320 words · 7 min · LevelDB LSM Storage

This is the first chapter of my notes on reading the LevelDB source code, focusing on the startup process of LevelDB. This article is not a step-by-step source code tutorial, but rather a learning …