Blogs

Flink-Iceberg-Connector Write Process

October 10, 2022 · 1078 words · 3 min

The Iceberg community provides an official Flink Connector, and this chapter’s source code analysis is based on that. Overview of the Write Submission Process Flink writes data through RowData …

Apache-ORC Quick Investigation

October 5, 2022 · 575 words · 2 min

Iceberg supports both ORC and Parquet columnar formats. Compared to Parquet, ORC offers advantages in query performance and ACID support. Considering the future data lakehouse requirements for query …

Apache-Iceberg Quick Investigation

October 5, 2022 · 1234 words · 3 min

A table format for large-scale analysis of datasets. A specification for organizing data files and metadata files. A schema semantic abstraction between storage and computation. Developed and …

LevelDB Write

May 10, 2022 · 718 words · 4 min

This is the second chapter of my notes on reading the LevelDB source code, focusing on the write flow of LevelDB. This article is not a step-by-step source code tutorial, but rather a learning note …

MIT6.824-RaftKV

April 15, 2022 · 1039 words · 5 min

Paper Reading · Part 6 of 13

Earlier, I looked at the code of Casbin-Mesh because I wanted to try GSOC. Casbin-Mesh is a distributed Casbin application based on Raft. This RaftKV in MIT6.824 is quite similar, so I took the …