[Incubator-Kafka-Users] ERROR [ReplicaFetcherThread-0-202], Error for partition

Hello,
I'm using 0.8.2-beta with 3 brokers and 3 zookeeper nodes (3.4.6). I had
some known issues with 0.8.1.1 that were supposedly fixed in 0.8.2, so I
moved to 0.82-beta, but now I'm getting different errors in 0.8.2-beta.
All the brokers come up fine and registered with the zookeeper. Then, I
created a topic, which succeeds on the command line, but there are many
errors in the kafka logs. Does anyone know why this may be happening?
Thanks,
Terry
bin/kafka-topics.sh --create --zookeeper
migration201:2181,migration202:2181,migration203:2181 --replication-factor
2 --topic nto1-mailboxes --partition 100
Created topic "nto1-mailboxes".
[2014-12-18 05:34:23,405] ERROR [ReplicaFetcherThread-0-202], Error for
partition [nto1-mailboxes,29] to broker 202:class
kafka.common.UnknownException (kafka.server.ReplicaFetcherThread)
[2014-12-18 05:34:23,406] ERROR [ReplicaFetcherThread-0-202], Error for
partition [nto1-mailboxes,11] to broker 202:class
kafka.common.UnknownException (kafka.server.ReplicaFetcherThread)
[2014-12-18 05:34:23,406] ERROR [ReplicaFetcherThread-0-202], Error for
partition [nto1-mailboxes,23] to broker 202:class
kafka.common.UnknownException (kafka.server.ReplicaFetcherThread)
Another broker has:
[2014-12-18 05:34:26,485] ERROR [KafkaApi-202] error when handling request
Name: FetchRequest; Version: 0; CorrelationId
: 463; ClientId: ReplicaFetcherThread-0-202; ReplicaId: 201; MaxWait: 500
ms; MinBytes: 1 bytes; RequestInfo: [nto1-mail
boxes,29] -> PartitionFetchInfo(0,1048576),[nto1-mailboxes,11] ->
PartitionFetchInfo(0,1048576),[nto1-mailboxes,23] -> P
artitionFetchInfo(0,1048576),[nto1-mailboxes,83] ->
PartitionFetchInfo(0,1048576),[nto1-mailboxes,5] -> PartitionFetchIn
fo(0,1048576),[nto1-mailboxes,59] ->
PartitionFetchInfo(0,1048576),[nto1-mailboxes,17] ->
PartitionFetchInfo(0,1048576),
[nto1-mailboxes,65] -> PartitionFetchInfo(0,1048576),[nto1-mailboxes,41] ->
PartitionFetchInfo(0,1048576),[nto1-mailboxe
s,77] -> PartitionFetchInfo(0,1048576),[nto1-mailboxes,47] ->
PartitionFetchInfo(0,1048576),[nto1-mailboxes,53] -> Parti
tionFetchInfo(0,1048576),[nto1-mailboxes,95] ->
PartitionFetchInfo(0,1048576),[nto1-mailboxes,89] -> PartitionFetchInfo(
0,1048576),[nto1-mailboxes,35] ->
PartitionFetchInfo(0,1048576),[nto1-mailboxes,71] ->
PartitionFetchInfo(0,1048576) (ka
fka.server.KafkaApis)
kafka.common.NotAssignedReplicaException: Leader 202 failed to record
follower 201's position -1 since the replica is no
t recognized to be one of the assigned replicas  for partition
[nto1-mailboxes,65]
        at
kafka.server.ReplicaManager.updateReplicaLEOAndPartitionHW(ReplicaManager.scala:570)
        at
kafka.server.KafkaApis$$anonfun$recordFollowerLogEndOffsets$2.apply(KafkaApis.scala:348)
        at
kafka.server.KafkaApis$$anonfun$recordFollowerLogEndOffsets$2.apply(KafkaApis.scala:346)
        at
scala.collection.MapLike$MappedValues$$anonfun$foreach$3.apply(MapLike.scala:245)
        at
scala.collection.MapLike$MappedValues$$anonfun$foreach$3.apply(MapLike.scala:245)
        at
scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:772)
        at
scala.collection.immutable.HashMap$HashMap1.foreach(HashMap.scala:224)
        at
scala.collection.immutable.HashMap$HashTrieMap.foreach(HashMap.scala:403)
        at
scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:771)
        at scala.collection.MapLike$MappedValues.foreach(MapLike.scala:245)
        at
kafka.server.KafkaApis.recordFollowerLogEndOffsets(KafkaApis.scala:346)
        at kafka.server.KafkaApis.handleFetchRequest(KafkaApis.scala:311)
        at kafka.server.KafkaApis.handle(KafkaApis.scala:60)
        at
kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:59)
        at java.lang.Thread.run(Unknown Source)
However, the describe topic shows that everything is fine:
Topic:nto1-mailboxes    PartitionCount:100      ReplicationFactor:2
Configs:
        Topic: nto1-mailboxes   Partition: 0    Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 1    Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 2    Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 3    Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 4    Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 5    Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 6    Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 7    Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 8    Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 9    Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 10   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 11   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 12   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 13   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 14   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 15   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 16   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 17   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 18   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 19   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 20   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 21   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 22   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 23   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 24   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 25   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 26   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 27   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 28   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 29   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 30   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 31   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 32   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 33   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 34   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 35   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 36   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 37   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 38   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 39   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 40   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 41   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 42   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 43   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 44   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 45   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 46   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 47   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 48   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 49   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 50   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 51   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 52   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 53   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 54   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 55   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 56   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 57   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 58   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 59   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 60   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 61   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 62   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 63   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 64   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 65   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 66   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 67   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 68   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 69   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 70   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 71   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 72   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 73   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 74   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 75   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 76   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 77   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 78   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 79   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 80   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 81   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 82   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 83   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 84   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 85   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 86   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 87   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 88   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 89   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 90   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 91   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 92   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 93   Leader: 203     Replicas:
203,202       Isr: 203,202
        Topic: nto1-mailboxes   Partition: 94   Leader: 201     Replicas:
201,203       Isr: 201,203
        Topic: nto1-mailboxes   Partition: 95   Leader: 202     Replicas:
202,201       Isr: 202,201
        Topic: nto1-mailboxes   Partition: 96   Leader: 203     Replicas:
203,201       Isr: 203,201
        Topic: nto1-mailboxes   Partition: 97   Leader: 201     Replicas:
201,202       Isr: 201,202
        Topic: nto1-mailboxes   Partition: 98   Leader: 202     Replicas:
202,203       Isr: 202,203
        Topic: nto1-mailboxes   Partition: 99   Leader: 203     Replicas:
203,202       Isr: 203,202

Reply To : ERROR [ReplicaFetcherThread-0-202], Error For Partition

asked Dec 17 2014 at 21:50

Terry Cumaranatunge

1 Replies for : ERROR [ReplicaFetcherThread-0-202], Error For Partition

You may want to take a look at
https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-WhydoIseeerror
"Shouldnotsetlogendoffsetonpartition"inthebrokerlog?
Thanks,
Jun

Reply To : ERROR [ReplicaFetcherThread-0-202], Error For Partition

answered Dec 22 2014 at 08:13

Jun Rao

Related discussions

Error While Fetching Metadata For Partition [my-topic,0] (kafka.server.KafkaApis)

Hi, Kafka 8 is giving issues. I want to connect to kafka via python Below is the error I get in kafka and in python. I just dont get why kafka fails.......how do I resolve....how do I just reset everything? Thanks from kafka.client import KafkaClient from kafka.producer import SimpleProducer, KeyedProducer from kafka.consumer import MultiProcessConsumer kafka = KafkaClient(kafka_domain

Fetch Request With Correlation Id 1171437 From Client ReplicaFetcherThread-0-1 On Partition [meetme,0] Failed Due To Leader Not Local For Partition

Good morning. I have a cluster of 3 kafka nodes. They were both running at the time. I need it to make configuration change in the property file and restart kafka. I have not broker shutdown tool, but simple used pkill -TERM -u ${KAFKA_USER} -f kafka.Kafka. That suddenly cause the exception. How to avoid this issue in the future? What's the right way to shutdown kafka to prevent Not Leder Exception

Error In Reassignment Partition Tool

Hi All I am trying to reassign partition to new borker but i am getting following error: ERROR: Assigned replicas (0,1) don't match the list of replicas for reassignment (2,3) for partition [test06,0] Found smiler issue is registered on Kafka https://issues.apache.org/jira/browse/KAFKA-1850 Is there any update on this issue?

Error While Fetching Metadata For Partition [topic-pixel,1] (kafka.server.KafkaApis)

I just built a new kafka server 0.8.0. How I am getting the below in the logs. What does it mean? [2014-02-13 00:01:43,034] ERROR [KafkaApi-1392248055] Error while fetching metadata for partition [topic-pixel,0] (kafka.server.KafkaApis) kafka.common.LeaderNotAvailableException: Leader not available for partition [topic-pixel,0] at kafka.server.KafkaApis$$anonfun$17$$anonfun$20.apply(KafkaApis

Leader Not Local For Partition Error?

Hi all, I'm not sure if I'm doing something wrong or if I missed a step somewhere. A little while ago I successfully got the 0.8 quickstart example to work fine with the console producer/consumer. Then I went to work on some code to learn how to implement a producer, which failed with the producer not being able to send anything with the following error in the logs: Produce request with

Impala Unkown Error 255 While Inserting Data Into Partition Tables

Dear all, I encountered an unknown error 255 while inserting about 1 GB size of 1 year data into table partitioned by date, if works fine with 1 year data, but when I increased to 10 year(3650 days) and replicated 10 times of record per day, it ran an error while inserting the data at the 2557th day(it varies among different days), it seems like the hdfs went down and can not offer

Hive Error On Dynamic Partition Insert

I have a set of queries that have run without issue for quite some time. However, we're trying to migrate to a Kerberos-secure cluster using CDH 5.2. Old cluster is non-secure, CDH 5.1... both are on YARN. I'm getting some very odd errors somewhere deep down in the metastore (I think), likely due to some partition information not being set. Basic process 1) Selecting from a partitioned

Broker Error: "failed Due To Leader Not Local For Partition"

Hello, For some reason, I'm getting this "failed due to Leader not local for partition" on my brokers. I can't send the logs, but I'm going to try to describe what I see. First, note that this is a fresh set of brokers with no data. I do see a series of messages stating "Expanding ISR for partition", so it looks like all of the partitions have enough replicas. I set up two partitions for each

Error With Partition

Hi,all I am trying to run a simple tutorial example with partition. But one error occurs. What this error means? hive>CREATE TABLE invites (foo INT, bar STRING) PARTITIONED BY (ds STRING); hive> LOAD DATA LOCAL INPATH 'hive/data/files/kv3.txt' OVERWRITE INTO TABLE invites partition(ds='2008'); FAILED: Error in semantic analysis: line 2:99 Exception while processing '2008': com.facebook

Alter Table Add Partition Error

Hi, I am trying to create an external table against already existing data in sequencefile format. However I have written a custom Serde to interpret the data. I am able to create the table fine but get the exception shown in the session output below when I try to add partition - any help would be greatly appreciated. =20 Thanks, Pradeep =20 =3D=3D session output =3D=3D=3D =20 [pradeepk

ERROR [ReplicaFetcherThread-0-202], Error For Partition

Related discussions

Incubator-chukwa-commits

Incubator-chukwa-dev

Incubator-chukwa-user

Incubator-drill-commits

Incubator-drill-dev