feat(connectors): Clickhouse Sink Connector#2886
Conversation
Codecov Report❌ Patch coverage is Additional details and impacted files@@ Coverage Diff @@
## master #2886 +/- ##
=============================================
- Coverage 73.98% 45.44% -28.55%
Complexity 937 937
=============================================
Files 1263 1266 +3
Lines 132810 117777 -15033
Branches 108444 93458 -14986
=============================================
- Hits 98257 53520 -44737
- Misses 31454 61391 +29937
+ Partials 3099 2866 -233
🚀 New features to boost your workflow:
|
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. If you need a review, please ensure CI is green and the PR is rebased on the latest master. Don't hesitate to ping the maintainers - either @core on Discord or by mentioning them directly here on the PR. Thank you for your contribution! |
hubcio
left a comment
There was a problem hiding this comment.
overall good direction, just needs a little bit polishing
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. If you need a review, please ensure CI is green and the PR is rebased on the latest master. Don't hesitate to ping the maintainers - either @core on Discord or by mentioning them directly here on the PR. Thank you for your contribution! |
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. If you need a review, please ensure CI is green and the PR is rebased on the latest master. Don't hesitate to ping the maintainers - either @core on Discord or by mentioning them directly here on the PR. Thank you for your contribution! |
|
/ready |
|
/ready |
atharvalade
left a comment
There was a problem hiding this comment.
One smaller thing I noticed but left out as non-critical: the README still says retries use "a fixed delay... not exponential backoff" and that MATERIALIZED columns get the 0x01 prefix byte, both of which the code no longer does. Worth changing I believe
|
/ready |
Which issue does this PR close?
Closes #2539
Rationale
Clickhouse is a real-time data analytics engine, and very popular in modern analytics architectures.
What changed?
This PR introduces a Clickhouse Sink Connector that enables writing data from Iggy to Clickhouse.
The Clickhouse writing logic is heavily inspired by the official Clickhouse Kafka Connector.
Local Execution
Images 1&2: Produced 30456 + 29060 rows into Iggy in two batches
Image 3: Verified schema and number of rows in Clickhouse
AI Usage