Kafka & Streaming questions and answers
Topics, consumer groups, stream processing and message queues. Page 3 of 20.
System Design practice on Codemia
Work through 120+ system design problems with detailed solutions, from rate limiters to multi-region storage.
Answers 121-180
- Apache Pulsar vs Kafka - do consumers pull (poll) messages off the topics?
- Apache Spark-Kafka.TaskCompletionListenerException & KafkaRDD$KafkaRDDIterator.close NPE on local cluster(Client Mode)
- Apache Spark Getting a InstanceAlreadyExistsException when running the Kafka producer
- apache spark streaming - kafka - reading older messages
- Apache storm using Kafka Spout gives error IllegalStateException
- Apache ZooKeeper with out a client
- ApacheKafka Appender logback
- Are there any good alternatives to RabbitMQ for low-end setups?
- Auto reconnect not woring in kafka
- Automate RabbitMQ consumer testing
- Automatic change kafka topic partition leader
- Automatic documentation/contract generation for Pub/Sub RabbitMQ
- Automatically reconnect RabbitMQ channels
- Avro deserialization from Kafka using fastavro
- Avro schema with logicalType can't be used with latest confluent-kafka
- AWS DynamoDB Stream into Redshift
- AWS Lambda processing stream from DynamoDB
- AWS MSK - Timeout when creating Kafka topic with ACL turned-on
- Azure Event Hub vs Kafka as a Service Broker
- Azure Event hubs for Kafka Attempt to join group failed due to unexpected error
- Azure Event Hubs limits and its comparison to pure Kafka cluster
- Azure Service Bus vs RabbitMQ for Enterprise applications
- Back pressure in Kafka
- Backup/restore kafka and zookeeper
- Balancing Kafka consumers
- Basic Authentication for Kafka Connect to Access Schema Registry
- Behavior of channels in confirm mode with RabbitMQ
- best option to put Nginx logs into Kafka?
- Best PHP client library for accessing RabbitMQ (AMQP)?
- Best practice for integrating Kafka and HBase
- Best way to ensure an event is eventually published to a message queuing sytem
- Best way to join two (or more) kafka topics in KSQL emiting changes from all topics?
- best way to rotate rabbitmq log files
- Bidirectional messaging system using kafka
- Book for Django + Celery + RabbitMQ?
- bootstrap-server vs zookeeper params in consumer console
- Bootstrap server vs zookeeper in kafka?
- Bucket records based on time(kafka-hdfs-connector)
- Build a multi node Kafka cluster on docker swarm
- Building a Kafka producer immediately results Disconnected while requesting ApiVersion error
- Building Go Application using confluent-kafka-go on Linux
- Bulk processing data through a join with kafka-streams results in `Skipping record for expired segment`
- C# RabbitMQ Client thread safety
- C# RabbitMQ wait for one message for specified timeout?
- Camel Kafka Integration
- Camel RabbitMQ consumer what's the interaction between concurrentConsumers and threadPoolSize options?
- Can a kafka client to play multiple role both consumer and producer
- Can a Kafka consumer(0.8.2.2) read messages in batch
- can a kafka consumer filter messages before polling all of them from a topic?
- Can a kafka consumer group freeze during a rebalance
- Can a Kafka producer create topics and partitions?
- Can a message loss occur in Kafka even if producer gets acknowledgement for it?
- Can anyone share a Flink Kafka example in Scala?
- Can celery gracefully endure a mongodb failover when using it as a broker?
- Can compacted Kafka topic be used as key-value database?
- Can consumers act as producers and send messages to the message broker in RabbitMQ?
- Can different Kafka topics have different retention lengths?
- Can I access Kafka Connect Worker config from connector or task?
- Can I create an RDD from a kafka topic if I do not know the until offset?
- Can I delete a Kafka Partition version 0.10.0.1

Course
Beginner
27 lessons
10 hours
System Design Fundamentals
Build a strong foundation in designing scalable, reliable distributed systems.
View the course