Skip to content

figure out what we're going to do for HRPD-X in terms of actually having a redpanda/kafka cluster #4

Closed

Description

@rerpha

This is a wider management question as we need infrastructure that will be maintained but generally the requirements are:

  1. the cluster is replicated
  2. the cluster has enough storage for at least 1 cycle's worth of retention for all data
  3. the cluster is run on a dedicated system separate to the NDX

Activity

  1. converted this from a draft issue on Nov 26, 2025
  2. Tom-Willemsen commented on Feb 27, 2026

    @Tom-Willemsen
    Member

    It's become clear that we are going to have to run Kafka, at least for the short term on HRPD-X.

    Hardware spec requirements to be discussed in #38 - including what level of replication/redundancy we provide (discussions with HRPD-X project management suggests that they would like to err on the side of more redundancy, even if that means higher capital cost - up to a point, obviously).

  3. added this to the September 2026 milestone on Mar 6, 2026
  4. Tom-Willemsen commented on Mar 20, 2026

    @Tom-Willemsen
    Member

    This has effectively become part of #38 , closing.

  5. moved this from research/needs discussion to Done in Data streaming for HRPD-X & SANDALS-IIon Mar 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions