Kafka ticket,Opened,Type,Summary,Public link,Comparison,SprintReady tickets,Why,Checked by hand KAFKA-9548,2020-02-13,Sub-task,SPI - RemoteStorageManager and RemoteLogMetadataManager interfaces and related classes.,https://issues.apache.org/jira/browse/KAFKA-9548,Planned by SprintReady,SR-13 SR-14,Covers defining the RemoteStorageManager and RemoteLogMetadataManager interfaces as specified in the design.,yes KAFKA-9549,2020-02-13,Sub-task,Local storage implementations for RSM which can be used in tests,https://issues.apache.org/jira/browse/KAFKA-9549,"Described, not planned",,"The document says: ""We will provide a simple implementation of RSM to get a better understanding of the APIs."" SprintReady didn't write a ticket for it: our one genuine miss.",no KAFKA-9550,2020-02-13,Sub-task,RemoteLogManager - copying eligible log segments to remote storage implementation ,https://issues.apache.org/jira/browse/KAFKA-9550,Planned by SprintReady,SR-16,Covers the RLM Leader Task for copying eligible log segments to remote storage.,yes KAFKA-9554,2020-02-14,Sub-task,Define the SPI for Tiered Storage framework,https://issues.apache.org/jira/browse/KAFKA-9554,Planned by SprintReady,SR-13 SR-14,Defining the SPI interfaces matches the RemoteStorageManager and RemoteLogMetadataManager interface specifications.,yes KAFKA-9555,2020-02-14,Sub-task,Topic-based implementation for the RemoteLogMetadataManager,https://issues.apache.org/jira/browse/KAFKA-9555,Planned by SprintReady,SR-3 SR-14,Topic-based RemoteLogMetadataManager implementation is the default implementation described in SR-3 and SR-14.,yes KAFKA-9564,2020-02-17,Sub-task,Integration Test framework for Tiered Storage,https://issues.apache.org/jira/browse/KAFKA-9564,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-9565,2020-02-18,Sub-task,Implementation of Tiered Storage SPI to integrate with S3,https://issues.apache.org/jira/browse/KAFKA-9565,Outside the project (per the document),,"The document says S3 and HDFS implementations ""are planned to be hosted in external repos"", outside the project, so SprintReady rightly didn't plan them.",yes KAFKA-9569,2020-02-18,Sub-task,RemoteStorageManager implementation for HDFS storage.,https://issues.apache.org/jira/browse/KAFKA-9569,Outside the project (per the document),,"The document says S3 and HDFS implementations ""are planned to be hosted in external repos"", outside the project, so SprintReady rightly didn't plan them.",yes KAFKA-9579,2020-02-20,Sub-task,Remote consumer fetch implementation by adding respective purgatory,https://issues.apache.org/jira/browse/KAFKA-9579,Planned by SprintReady,SR-19,Remote consumer fetch with purgatory matches the RemoteFetchPurgatory implementation in SR-19.,yes KAFKA-9990,2020-05-13,Sub-task,Supporting transactions in tiered storage,https://issues.apache.org/jira/browse/KAFKA-9990,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-12368,2021-02-24,Sub-task,Inmemory implementation of RSM and RLMM. ,https://issues.apache.org/jira/browse/KAFKA-12368,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-12429,2021-03-05,Sub-task,Serdes for all message types in internal topic which is used in default implementation for RLMM.,https://issues.apache.org/jira/browse/KAFKA-12429,Planned by SprintReady,SR-5 SR-14,Serdes for metadata topic messages are part of the RemoteLogMetadataManager implementation covered in SR-14.,yes KAFKA-12458,2021-03-12,Sub-task,Implementation of Tiered Storage Integration with Azure Storage (ADLS + Blob Storage),https://issues.apache.org/jira/browse/KAFKA-12458,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",yes KAFKA-12802,2021-05-17,Sub-task,Add a file based cache for consumed remote log metadata for each partition to avoid consuming again incase of broker restarts.,https://issues.apache.org/jira/browse/KAFKA-12802,Planned by SprintReady,SR-31,File-based cache for consumed metadata to avoid re-reading after restart is described in SR-31.,yes KAFKA-12816,2021-05-20,Sub-task,Add tier storage configs. ,https://issues.apache.org/jira/browse/KAFKA-12816,Planned by SprintReady,SR-1 SR-2 SR-3 SR-4 SR-5 SR-6 SR-7 SR-8 SR-9 SR-10 SR-11,Adding all tiered storage configurations matches the comprehensive config tickets SR-1 through SR-11.,yes KAFKA-12969,2021-06-18,Sub-task,Add cluster or broker level config for topic level tiered storage confgs.,https://issues.apache.org/jira/browse/KAFKA-12969,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-12970,2021-06-18,Sub-task,Make tiered storage related schemas adopt flexible versions feature. ,https://issues.apache.org/jira/browse/KAFKA-12970,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-12988,2021-06-24,Sub-task,Change RLMM add/updateRemoteLogSegmentMetadata and putRemotePartitionDeleteMetadata APIS asynchronous.,https://issues.apache.org/jira/browse/KAFKA-12988,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-13097,2021-07-16,Sub-task,Handle the requests gracefully to publish the events in TopicBasedRemoteLogMetadataManager when it is not yet initialized.,https://issues.apache.org/jira/browse/KAFKA-13097,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-13369,2021-10-12,Sub-task,Follower fetch protocol enhancements for tiered storage.,https://issues.apache.org/jira/browse/KAFKA-13369,Planned by SprintReady,SR-24 SR-27,Follower fetch protocol enhancements match SR-24 and SR-27 for handling remote-only segments and NEXT_LOCAL_TIMESTAMP.,yes KAFKA-14038,2022-07-01,Improvement,Optimize calculation of size for log in remote tier,https://issues.apache.org/jira/browse/KAFKA-14038,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-14466,2022-12-13,Sub-task,Refactor ClassLoaderAwareRemoteStorageManager.scala to ClassLoaderAwareRemoteStorageManager.java and move it to storage module.,https://issues.apache.org/jira/browse/KAFKA-14466,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-14469,2022-12-14,Sub-task,Fix inconsistency in config name between code and KIP-405 ,https://issues.apache.org/jira/browse/KAFKA-14469,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-14495,2022-12-15,Sub-task,Improve the RemoteIndexCacheTest,https://issues.apache.org/jira/browse/KAFKA-14495,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-14685,2023-02-06,Sub-task,TierStateMachine interface for building remote aux log,https://issues.apache.org/jira/browse/KAFKA-14685,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-14850,2023-03-27,Sub-task,Introduce InMemoryLeaderEpochCheckpoint to allow quick write/read,https://issues.apache.org/jira/browse/KAFKA-14850,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-14888,2023-04-11,Sub-task,RemoteLogManager - deleting expired/size breached log segments to remote storage implementation ,https://issues.apache.org/jira/browse/KAFKA-14888,Planned by SprintReady,SR-17,Deleting expired/size-breached remote log segments matches the RLM task in SR-17.,yes KAFKA-14889,2023-04-11,Sub-task,RemoteLogManager - allow consumer fetch records from remote storage implementation ,https://issues.apache.org/jira/browse/KAFKA-14889,Planned by SprintReady,SR-19 SR-23,Allowing consumer fetch from remote storage matches SR-19 and SR-23 for remote fetch handling.,yes KAFKA-14953,2023-05-02,Sub-task,Add metrics for tiered storage,https://issues.apache.org/jira/browse/KAFKA-14953,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-14993,2023-05-12,Improvement,Improve TransactionIndex instance handling while copying to and fetching from RSM.,https://issues.apache.org/jira/browse/KAFKA-14993,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15037,2023-05-30,Sub-task,initialize unifiedLog with remoteStorageSystemEnable correctly,https://issues.apache.org/jira/browse/KAFKA-15037,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15040,2023-05-31,Sub-task,segment copy to remote storage won't work in KRaft mode,https://issues.apache.org/jira/browse/KAFKA-15040,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15066,2023-06-07,Sub-task,passing listener name config into TopicBasedRemoteLogMetadataManagerConfig,https://issues.apache.org/jira/browse/KAFKA-15066,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15083,2023-06-13,Sub-task,"Passing ""remote.log.metadata.*"" configs into RLMM",https://issues.apache.org/jira/browse/KAFKA-15083,Planned by SprintReady,SR-5,Passing remote.log.metadata.* configs to RLMM matches the configuration namespace in SR-5.,yes KAFKA-15084,2023-06-13,Sub-task,Remove lock contention in RemoteIndexCache,https://issues.apache.org/jira/browse/KAFKA-15084,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15130,2023-06-28,Improvement,Delete remote segments when delete a topic,https://issues.apache.org/jira/browse/KAFKA-15130,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15131,2023-06-28,Improvement,Improve RemoteStorageManager exception handling documentation,https://issues.apache.org/jira/browse/KAFKA-15131,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15132,2023-06-28,New Feature,Implement disable & re-enablement for Tiered Storage,https://issues.apache.org/jira/browse/KAFKA-15132,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15135,2023-06-30,Bug,RLM listener configurations passed but ignored by RLMM,https://issues.apache.org/jira/browse/KAFKA-15135,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15157,2023-07-06,Sub-task,Print startup time for RemoteIndexCache,https://issues.apache.org/jira/browse/KAFKA-15157,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15167,2023-07-08,Sub-task,Tiered Storage Test Harness Framework,https://issues.apache.org/jira/browse/KAFKA-15167,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15168,2023-07-08,Sub-task,Handle overlapping remote log segments in RemoteLogMetadata cache,https://issues.apache.org/jira/browse/KAFKA-15168,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15176,2023-07-11,Sub-task,Add missing tests for remote storage metrics,https://issues.apache.org/jira/browse/KAFKA-15176,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15181,2023-07-12,Sub-task,Race condition on partition assigned to TopicBasedRemoteLogMetadataManager ,https://issues.apache.org/jira/browse/KAFKA-15181,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15189,2023-07-14,Bug,Do not initialize RemoteStorage related metrics when disabled at cluster,https://issues.apache.org/jira/browse/KAFKA-15189,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15194,2023-07-17,Task,Rename local tiered storage segment with offset as prefix for easy navigation,https://issues.apache.org/jira/browse/KAFKA-15194,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15236,2023-07-22,Sub-task,Rename Remote Storage metrics to remove ambiguity,https://issues.apache.org/jira/browse/KAFKA-15236,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15260,2023-07-27,Sub-task,RLM Task should wait until RLMM is initialized before copying segments to remote,https://issues.apache.org/jira/browse/KAFKA-15260,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15261,2023-07-27,Sub-task,ReplicaFetcher thread should not block if RLMM is not initialized,https://issues.apache.org/jira/browse/KAFKA-15261,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15267,2023-07-28,Sub-task,Cluster-wide disablement of Tiered Storage,https://issues.apache.org/jira/browse/KAFKA-15267,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15274,2023-07-31,Task,support moving files to be deleted to other directories,https://issues.apache.org/jira/browse/KAFKA-15274,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15290,2023-08-01,Sub-task,Add support to onboard existing topics to tiered storage,https://issues.apache.org/jira/browse/KAFKA-15290,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15293,2023-08-02,Sub-task,Update metrics doc to add tiered storage metrics,https://issues.apache.org/jira/browse/KAFKA-15293,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15294,2023-08-02,Sub-task,Make remote storage related configs as public (i.e. non-internal),https://issues.apache.org/jira/browse/KAFKA-15294,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15295,2023-08-02,Sub-task,Add config validation when remote storage is enabled on a topic,https://issues.apache.org/jira/browse/KAFKA-15295,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15298,2023-08-02,Sub-task,Disable DeleteRecords on Tiered Storage topics,https://issues.apache.org/jira/browse/KAFKA-15298,Closed as Won't Fix,,Closed as Won't Fix: DeleteRecords already worked (SprintReady had specified it in SR-25).,no KAFKA-15329,2023-08-10,Sub-task,Make default `remote.log.metadata.manager.class.name` as topic based RLMM,https://issues.apache.org/jira/browse/KAFKA-15329,Planned by SprintReady,SR-3,Setting default remote.log.metadata.manager.class.name to topic-based RLMM matches SR-3.,yes KAFKA-15351,2023-08-16,Sub-task,Update log-start-offset after leader election for topics enabled with remote storage,https://issues.apache.org/jira/browse/KAFKA-15351,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15352,2023-08-16,Sub-task,Ensure consistency while deleting the remote log segments,https://issues.apache.org/jira/browse/KAFKA-15352,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15386,2023-08-21,Task,Update log-start-offset in RLM task for a leader partition for the earliest leader epoch of the current leader's leader epoch lineage available in the remote storage. ,https://issues.apache.org/jira/browse/KAFKA-15386,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15399,2023-08-24,Sub-task,Enable OffloadAndConsumeFromLeader test,https://issues.apache.org/jira/browse/KAFKA-15399,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15410,2023-08-28,Sub-task,Add functional integration tests with tiered storage,https://issues.apache.org/jira/browse/KAFKA-15410,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15414,2023-08-29,Bug,remote logs get deleted after partition reassignment,https://issues.apache.org/jira/browse/KAFKA-15414,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15427,2023-09-01,Sub-task,Integration tests in TS test harness detect resource leaks,https://issues.apache.org/jira/browse/KAFKA-15427,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no KAFKA-15442,2023-09-07,Sub-task,add document to introduce tiered storage feature and the usage,https://issues.apache.org/jira/browse/KAFKA-15442,Added after Feb 2020,,"Work the February 2020 document didn't describe: added later (new scope, tests, metrics, KRaft support, or a fix found in 2023).",no