RESEARCH

apache kafka – Is there any specification to describe the functionality of KafkaAvroSerializer / KafkaAvroDeserializer or the confluent platform registry?

I am wondering whether the confluent schema-registry paradigm (which to my understanding is paired with KafkaAvroSerializer/KafkaAvroDeserializer implementation) changes over time. If it does, is it based on some publicly available…Read moreapache kafka – Is there any specification to describe the functionality of KafkaAvroSerializer / KafkaAvroDeserializer or the confluent platform registry?

RESEARCH

garbage collection – Application running out of memory due to apache kafka metric objects while using kafkaProducer

We try to send 1000s of messages to a kafka-topic using kafkaProducer(org.apache.kafka.clients.producer.KafkaProducer) objects on our tomcat application. Lately we have been observing an issue with large number of kafkaMetric objects…Read moregarbage collection – Application running out of memory due to apache kafka metric objects while using kafkaProducer

RESEARCH

apache kafka – KafkaStreams metrics, records processed per stream/extracting offset for each stream in topology

I’m using org.apache.kafka.streams.KafkaStreams and for example my topology looks this: StreamsBuilder builder = new StreamsBuilder(); builder.stream(“input-topic1”) .mapValues((readOnlyKey, value) -> value.toUpperCase()) .to(“output-topic1”); builder.stream(“input-topic2”) .mapValues((readOnlyKey, value) -> value.toUpperCase()) .to(“output-topic2”); Every two minutes…Read moreapache kafka – KafkaStreams metrics, records processed per stream/extracting offset for each stream in topology

RESEARCH

apache kafka – java.lang.UnsupportedOperationException: getPosition is not implemented by this StateStore

NAjava.lang.UnsupportedOperationException: getPosition is not implemented by this StateStore at org.apache.kafka.streams.processor.StateStore.getPosition(StateStore.java:165) at org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.log(ChangeLoggingKeyValueBytesStore.java:142) at org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:79) at org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:33) Please let us know the alternative for this method in Kafka Read more here:…Read moreapache kafka – java.lang.UnsupportedOperationException: getPosition is not implemented by this StateStore

DATA MANAGEMENT RESEARCH

apache kafka – Why do I get an error when running control center in a confluent cluster environment?

my environment is centos 7 and Cluster (The number of brokers is 3) error below : [2023-06-08 11:22:49,034] ERROR [main] found topic=_confluent-command with replication=1 expecting at least expectedReplication=3 (io.confluent.controlcenter.KafkaHelper) [2023-06-08…Read moreapache kafka – Why do I get an error when running control center in a confluent cluster environment?

DATA MANAGEMENT RESEARCH

apache kafka streams – ksqlDb Unable to verify if the value schema for topic is compatible with ksqlDB

I’m trying to create a new stream and topic with ksqlDb CREATE STREAM valid_deals ( dealId BIGINT KEY ) WITH ( KAFKA_TOPIC=’valid_deals’, PARTITIONS=4, REPLICAS=3, VALUE_FORMAT=’JSON_SR’, VALUE_SCHEMA_ID=434 ); I’m using a…Read moreapache kafka streams – ksqlDb Unable to verify if the value schema for topic is compatible with ksqlDB