How to turn on Tiered Storage for your Kafka topic¶
This guide shows you how to enable tiered storage for your Kafka topic.
Prerequisites¶
You need to own an existing topic in nais. Check Create a Kafka topic for how to create a topic.
Your topic can not use compact cleanup policy.
Enable tiered storage by specifying local retention on a topic¶
Git diff showing how to enable tiered storage in a 'nai example_topic.yaml' file
diff --git a/example_topic.yaml b/example_topic.yaml
index 230ec001..cbc01774 100644
--- a/example_topic.yaml
+++ b/example_topic.yaml
@@ -8,3 +8,8 @@ labels:
spec:
kafka:
# ... other configuration ...
+ config:
+ # Must be a value smaller than `retentionHours`
+ localRetentionHours: X
+ # Must be a value smaller than `retentionBytes`
+ localRetentionBytes: Y
Apply the new configuration¶
Add the file to your application repository and deploy with NAIS github action.