Skip to content

feat: implement STCS compaction#430

Merged
dkharms merged 5 commits into
mainfrom
336-compaction
Jul 7, 2026
Merged

feat: implement STCS compaction#430
dkharms merged 5 commits into
mainfrom
336-compaction

Conversation

@dkharms

@dkharms dkharms commented May 27, 2026

Copy link
Copy Markdown
Member

Description

Adds a STCS (Size-Tiered Compaction Strategy) planner that groups sealed fractions into time-bins and selects compaction candidates, and an executor that merges them into a new sealed fraction via k-way merge.


  • I have read and followed all requirements in CONTRIBUTING.md;
  • I used LLM/AI assistance to make this pull request;

If you have used LLM/AI assistance please provide model name and full prompt:

Model: {{model-name}}
Prompt: {{prompt}}

@dkharms dkharms changed the title feat: implement compaction feat: implement STCS compaction May 27, 2026
@dkharms dkharms marked this pull request as ready for review May 29, 2026 09:57
@eguguchkin eguguchkin requested review from eguguchkin and forshev June 1, 2026 11:29
@eguguchkin eguguchkin added this to the v0.73.0 milestone Jun 2, 2026
Comment thread storeapi/store.go Outdated
Comment thread compaction/executor.go Outdated
Comment thread compaction/planner.go Outdated
Comment thread fracmanager/fraction_provider.go Outdated
Comment thread indexwriter/index.go Outdated
Comment thread config/config.go
Comment thread fracmanager/fracmanager.go
Comment thread compaction/planner.go Outdated
Comment thread compaction/planner.go Outdated
Comment thread compaction/planner.go
Comment thread compaction/stcs.go Outdated
Comment thread compaction/planner.go Outdated
Comment thread compaction/planner.go
@dkharms dkharms force-pushed the 336-merge-source branch from 6ee2e2b to 216c6dd Compare July 6, 2026 12:12
@dkharms dkharms force-pushed the 336-merge-source branch 2 times, most recently from 8917131 to 261846d Compare July 6, 2026 12:37
Base automatically changed from 336-merge-source to main July 6, 2026 12:40
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 38.82784% with 167 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.52%. Comparing base (ec96266) to head (fc90905).

Files with missing lines Patch % Lines
compaction/planner.go 12.96% 93 Missing and 1 partial ⚠️
compaction/executor.go 22.22% 27 Missing and 1 partial ⚠️
cmd/seq-db/seq-db.go 0.00% 12 Missing ⚠️
fracmanager/fracmanager.go 0.00% 12 Missing ⚠️
fracmanager/fraction_registry.go 0.00% 11 Missing ⚠️
config/validation.go 64.70% 5 Missing and 1 partial ⚠️
compaction/stcs.go 96.29% 1 Missing and 1 partial ⚠️
indexwriter/index.go 0.00% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #430      +/-   ##
==========================================
+ Coverage   70.29%   70.52%   +0.23%     
==========================================
  Files         229      232       +3     
  Lines       18009    18268     +259     
==========================================
+ Hits        12659    12884     +225     
- Misses       4413     4424      +11     
- Partials      937      960      +23     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@dkharms dkharms merged commit 25381c2 into main Jul 7, 2026
8 checks passed
@dkharms dkharms deleted the 336-compaction branch July 7, 2026 10:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants