How many max total schemas? #4398
-
I'm doing an investigation on schema registries. I'm trying to find out what's the hard limit on apicurio. Thanks! |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Hi @woile. The answer to this question depends (to some degree) on the storage mechanism you choose. We support using either a conventional DB or Kafka as the persistent store. If the chosen storage is a DB (e.g. postgresql), then the max number of schemas is essentially unbounded (practically bounded only by the normal limits of an indexed Postgresql table). If you choose Kafka as the storage, then you are bounded by memory, much like the Confluent solution. We keep all of the schemas and metadata in memory, and so you might choose to set whatever max you find sensible (this will depend on how big your schemas are, on average). We assume the number of schemas for most use-cases will tend to be small (in the 1000s at most?) so either solution is typically fine in practice. |
Beta Was this translation helpful? Give feedback.
Hi @woile. The answer to this question depends (to some degree) on the storage mechanism you choose. We support using either a conventional DB or Kafka as the persistent store. If the chosen storage is a DB (e.g. postgresql), then the max number of schemas is essentially unbounded (practically bounded only by the normal limits of an indexed Postgresql table).
If you choose Kafka as the storage, then you are bounded by memory, much like the Confluent solution. We keep all of the schemas and metadata in memory, and so you might choose to set whatever max you find sensible (this will depend on how big your schemas are, on average).
We assume the number of schemas for most use-cases will tend…