Apache-Iceberg Quick Investigation

October 5, 2022 · 1208 words · 6 min · Lakehouse Storage Big Data

  • A table format for large-scale analysis of datasets.
  • A specification for organizing data files and metadata files.
  • A schema semantic abstraction between storage and computation.
  • Developed and open-sourced by Netflix to enhance scalability, reliability, and usability.

Background

Issues encountered when migrating HIVE to the cloud:

LevelDB Write

May 10, 2022 · 712 words · 4 min · LevelDB LSM Storage

This is the second chapter of my notes on reading the LevelDB source code, focusing on the write flow of LevelDB. This article is not a step-by-step source code tutorial, but rather a learning note that records my questions and thoughts.

LevelDB Startup

April 9, 2022 · 1312 words · 7 min · LevelDB LSM Storage

This is the first chapter of my notes on reading the LevelDB source code, focusing on the startup process of LevelDB. This article is not a step-by-step source code tutorial, but rather a learning note that records my questions and thoughts.