[Kafka 운영] Request log 살펴보기

들어가며 Request log 설정하기 Request log 내용 살펴보기 요청 별 로그 토픽 생성 메시지 프로듀싱 메시지 컨슈밍 마무리

개발자 라이프/카프카 2020. 11. 29. 23:11

들어가며

중앙에 위치하는 카프카 브로커 (출처 : https://engineering.linkedin.com/blog/2016/04/kafka-ecosystem-at-linkedin)

카프카는 아키텍처 중앙에 위치하여 다양한 클라이언트들의 요청을 받습니다. 그렇기 때문에 간혹 클라이언트에서 잘못된 요청을 보내는 경우가 발생할 수 있습니다. 예를 들면, 스키마가 정의되지 않은 토픽에 대해 프로듀서가 기존과 다른 임의의 메시지 포맷으로 보내게 된다면 컨슈머는 이 메시지를 처리하지 못하게 됩니다. 이와 같이 잘못된 요청이 발생하게 되면 어떤 클라이언트에서 보낸 요청인지 확인할 필요가 있습니다. 그리고 다행히도 카프카는 브로커가 받는 요청에 대해 별도의 로그 파일로 저장할 수 있습니다.

이번 글은 카프카 브로커가 받은 요청에 대해 저장하는 로그인 request log에 대해 살펴봅니다. 이 글 내용은 카프카 한국 사용자 모임에서 진행한 제4회 버츄얼 밋업 내용에서 영감을 받아 작성했습니다.

Request log 설정하기

request log는 기본적으로 INFO 레벨에 대한 로그를 저장하고 있으며, 기본적으로 ${kafka.logs.dir}/kafka-request.log 파일에 저장됩니다. 하지만 INFO 레벨에선 자세한 내용을 알 수 없으므로 관련 로거인 kafka.request.logger의 로깅 레벨을 DEBUG로 내릴 필요가 있습니다. 브로커의 로깅 레벨 변경은 런타임 중에도 가능하며, 아래와 같이 요청하면 됩니다.

	$KAFKA_HOME/bin/kafka-configs.sh \
	--bootstrap-server localhost:9092 \
	--entity-type broker-loggers \
	--entity-name 0 \
	--alter \
	--add-config kafka.request.logger=DEBUG

view raw kafka-config-request-logger.sh hosted with ❤ by GitHub

카프카와 함께 제공되는 kafka-configs.sh 스크립트 명령어를 사용합니다.
entity-name 은 로깅 레벨을 변경할 브로커 id입니다.

위 명령어를 입력하면 kafka-request.log 파일이 생성되고, 방금 전에 설정 변경을 요청했던 것에 대한 로그가 저장된 것을 확인할 수 있습니다.

Request log 내용 살펴보기

위 스크린샷을 보면 상당히 많은 내용이 로그로 남는 것을 알 수 있는데, 한번 나눠서 살펴보겠습니다.

	[2020-11-29 22:24:37,731] DEBUG Completed request:
	RequestHeader(apiKey=INCREMENTAL_ALTER_CONFIGS, apiVersion=1, clientId=adminclient-1, correlationId=4) --
	{
	resources=[
	{
	resource_type=8,
	resource_name=0,
	configs=[
	{
	name=kafka.request.logger,
	config_operation=0,
	value=DEBUG,
	_tagged_fields={}
	}
	],
	_tagged_fields={}
	}
	],
	validate_only=false,
	_tagged_fields={}
	},
	response:
	{
	throttle_time_ms=0,
	responses=[
	{
	error_code=0,
	error_message=null,
	resource_type=8,
	resource_name=0,
	_tagged_fields={}
	}
	],
	_tagged_fields={}
	}
	from connection 192.168.0.2:9092-192.168.0.2:57250-2;
	totalTime:6.537,
	requestQueueTime:0.727,
	localTime:5.674,
	remoteTime:0.0,
	throttleTime:0,
	responseQueueTime:0.036,
	sendTime:0.097,
	securityProtocol:PLAINTEXT,
	principal:User:ANONYMOUS,
	listener:PLAINTEXT,
	clientInformation:ClientInformation(softwareName=apache-kafka-java, softwareVersion=2.8.0-SNAPSHOT),
	forwarded:false
	(kafka.request.logger)

view raw kafka-request-alter-config.txt hosted with ❤ by GitHub

위에서 보는 것과 같이 로그 내용은 크게 세 부분으로 나눠 볼 수 있습니다.

API 요청 정보
브로커 응답 정보
클라이언트 연결 및 처리 정보

이 중 특히 눈에 띄는 부분은 클라이언트의 연결 및 처리 정보를 통해 어떤 클라이언트에서 어떤 요청이 전달되었는지 확인할 수 있다는 것입니다. 그럼 설정 변경 외의 다른 요청에 대한 로그도 간단히 살펴보겠습니다.

요청 별 로그

요청에 따라 저장되는 로그를 간단하게 살펴봅니다. 참고로 아래 내용 중 대문자 알파벳은 로그의 apiKey에 대응하는 것입니다.

토픽 생성

	# 토픽 생성 요청
	kafka-topics.sh --bootstrap-server localhost:9092 --create --topic test.kafka.logger --partitions 1 --replication-factor 1

	# 관련 로그
	[2020-11-21 14:37:04,111] DEBUG Completed request:RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=adminclient-1, correlationId=0) -- {client_software_name=apache-kafka-java,client_software_version=2.4.2-SNAPSHOT,_tagged_fields={}},response:{error_code=0,api_keys=[{api_key=0,min_version=0,max_version=8,_tagged_fields={}},{api_key=1,min_version=0,max_version=11,_tagged_fields={}},{api_key=2,min_version=0,max_version=5,_tagged_fields={}},{api_key=3,min_version=0,max_version=9,_tagged_fields={}},{api_key=4,min_version=0,max_version=4,_tagged_fields={}},{api_key=5,min_version=0,max_version=2,_tagged_fields={}},{api_key=6,min_version=0,max_version=6,_tagged_fields={}},{api_key=7,min_version=0,max_version=3,_tagged_fields={}},{api_key=8,min_version=0,max_version=8,_tagged_fields={}},{api_key=9,min_version=0,max_version=6,_tagged_fields={}},{api_key=10,min_version=0,max_version=3,_tagged_fields={}},{api_key=11,min_version=0,max_version=6,_tagged_fields={}},{api_key=12,min_version=0,max_version=4,_tagged_fields={}},{api_key=13,min_version=0,max_version=4,_tagged_fields={}},{api_key=14,min_version=0,max_version=4,_tagged_fields={}},{api_key=15,min_version=0,max_version=5,_tagged_fields={}},{api_key=16,min_version=0,max_version=3,_tagged_fields={}},{api_key=17,min_version=0,max_version=1,_tagged_fields={}},{api_key=18,min_version=0,max_version=3,_tagged_fields={}},{api_key=19,min_version=0,max_version=5,_tagged_fields={}},{api_key=20,min_version=0,max_version=4,_tagged_fields={}},{api_key=21,min_version=0,max_version=1,_tagged_fields={}},{api_key=22,min_version=0,max_version=2,_tagged_fields={}},{api_key=23,min_version=0,max_version=3,_tagged_fields={}},{api_key=24,min_version=0,max_version=1,_tagged_fields={}},{api_key=25,min_version=0,max_version=1,_tagged_fields={}},{api_key=26,min_version=0,max_version=1,_tagged_fields={}},{api_key=27,min_version=0,max_version=0,_tagged_fields={}},{api_key=28,min_version=0,max_version=2,_tagged_fields={}},{api_key=29,min_version=0,max_version=1,_tagged_fields={}},{api_key=30,min_version=0,max_version=1,_tagged_fields={}},{api_key=31,min_version=0,max_version=1,_tagged_fields={}},{api_key=32,min_version=0,max_version=2,_tagged_fields={}},{api_key=33,min_version=0,max_version=1,_tagged_fields={}},{api_key=34,min_version=0,max_version=1,_tagged_fields={}},{api_key=35,min_version=0,max_version=1,_tagged_fields={}},{api_key=36,min_version=0,max_version=1,_tagged_fields={}},{api_key=37,min_version=0,max_version=1,_tagged_fields={}},{api_key=38,min_version=0,max_version=2,_tagged_fields={}},{api_key=39,min_version=0,max_version=1,_tagged_fields={}},{api_key=40,min_version=0,max_version=1,_tagged_fields={}},{api_key=41,min_version=0,max_version=1,_tagged_fields={}},{api_key=42,min_version=0,max_version=2,_tagged_fields={}},{api_key=43,min_version=0,max_version=2,_tagged_fields={}},{api_key=44,min_version=0,max_version=1,_tagged_fields={}},{api_key=45,min_version=0,max_version=0,_tagged_fields={}},{api_key=46,min_version=0,max_version=0,_tagged_fields={}},{api_key=47,min_version=0,max_version=0,_tagged_fields={}}],throttle_time_ms=0,_tagged_fields={}} from connection 127.0.0.1:9092-127.0.0.1:50771-3;totalTime:0.417,requestQueueTime:0.076,localTime:0.223,remoteTime:0.0,throttleTime:0.195,responseQueueTime:0.028,sendTime:0.103,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:37:04,162] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=adminclient-1, correlationId=1) -- {topics=[],allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[],cluster_authorized_operations=0,_tagged_fields={}} from connection 127.0.0.1:9092-127.0.0.1:50771-3;totalTime:0.645,requestQueueTime:0.062,localTime:0.416,remoteTime:0.0,throttleTime:0.224,responseQueueTime:0.042,sendTime:0.14,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:37:04,168] DEBUG Completed request:RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=adminclient-1, correlationId=2) -- {client_software_name=apache-kafka-java,client_software_version=2.4.2-SNAPSHOT,_tagged_fields={}},response:{error_code=0,api_keys=[{api_key=0,min_version=0,max_version=8,_tagged_fields={}},{api_key=1,min_version=0,max_version=11,_tagged_fields={}},{api_key=2,min_version=0,max_version=5,_tagged_fields={}},{api_key=3,min_version=0,max_version=9,_tagged_fields={}},{api_key=4,min_version=0,max_version=4,_tagged_fields={}},{api_key=5,min_version=0,max_version=2,_tagged_fields={}},{api_key=6,min_version=0,max_version=6,_tagged_fields={}},{api_key=7,min_version=0,max_version=3,_tagged_fields={}},{api_key=8,min_version=0,max_version=8,_tagged_fields={}},{api_key=9,min_version=0,max_version=6,_tagged_fields={}},{api_key=10,min_version=0,max_version=3,_tagged_fields={}},{api_key=11,min_version=0,max_version=6,_tagged_fields={}},{api_key=12,min_version=0,max_version=4,_tagged_fields={}},{api_key=13,min_version=0,max_version=4,_tagged_fields={}},{api_key=14,min_version=0,max_version=4,_tagged_fields={}},{api_key=15,min_version=0,max_version=5,_tagged_fields={}},{api_key=16,min_version=0,max_version=3,_tagged_fields={}},{api_key=17,min_version=0,max_version=1,_tagged_fields={}},{api_key=18,min_version=0,max_version=3,_tagged_fields={}},{api_key=19,min_version=0,max_version=5,_tagged_fields={}},{api_key=20,min_version=0,max_version=4,_tagged_fields={}},{api_key=21,min_version=0,max_version=1,_tagged_fields={}},{api_key=22,min_version=0,max_version=2,_tagged_fields={}},{api_key=23,min_version=0,max_version=3,_tagged_fields={}},{api_key=24,min_version=0,max_version=1,_tagged_fields={}},{api_key=25,min_version=0,max_version=1,_tagged_fields={}},{api_key=26,min_version=0,max_version=1,_tagged_fields={}},{api_key=27,min_version=0,max_version=0,_tagged_fields={}},{api_key=28,min_version=0,max_version=2,_tagged_fields={}},{api_key=29,min_version=0,max_version=1,_tagged_fields={}},{api_key=30,min_version=0,max_version=1,_tagged_fields={}},{api_key=31,min_version=0,max_version=1,_tagged_fields={}},{api_key=32,min_version=0,max_version=2,_tagged_fields={}},{api_key=33,min_version=0,max_version=1,_tagged_fields={}},{api_key=34,min_version=0,max_version=1,_tagged_fields={}},{api_key=35,min_version=0,max_version=1,_tagged_fields={}},{api_key=36,min_version=0,max_version=1,_tagged_fields={}},{api_key=37,min_version=0,max_version=1,_tagged_fields={}},{api_key=38,min_version=0,max_version=2,_tagged_fields={}},{api_key=39,min_version=0,max_version=1,_tagged_fields={}},{api_key=40,min_version=0,max_version=1,_tagged_fields={}},{api_key=41,min_version=0,max_version=1,_tagged_fields={}},{api_key=42,min_version=0,max_version=2,_tagged_fields={}},{api_key=43,min_version=0,max_version=2,_tagged_fields={}},{api_key=44,min_version=0,max_version=1,_tagged_fields={}},{api_key=45,min_version=0,max_version=0,_tagged_fields={}},{api_key=46,min_version=0,max_version=0,_tagged_fields={}},{api_key=47,min_version=0,max_version=0,_tagged_fields={}}],throttle_time_ms=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50772-3;totalTime:0.422,requestQueueTime:0.058,localTime:0.257,remoteTime:0.0,throttleTime:0.226,responseQueueTime:0.025,sendTime:0.095,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:37:04,174] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=adminclient-1, correlationId=3) -- {topics=null,allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[{error_code=0,name=test.kafka.logs,is_internal=false,partitions=[{error_code=0,partition_index=0,leader_id=0,leader_epoch=0,replica_nodes=[0],isr_nodes=[0],offline_replicas=[],_tagged_fields={}}],topic_authorized_operations=0,_tagged_fields={}}],cluster_authorized_operations=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50772-3;totalTime:5.164,requestQueueTime:0.093,localTime:4.939,remoteTime:0.0,throttleTime:1.031,responseQueueTime:0.035,sendTime:0.116,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:37:04,209] DEBUG Completed request:RequestHeader(apiKey=LEADER_AND_ISR, apiVersion=4, clientId=0, correlationId=3) -- {controller_id=0,controller_epoch=1,broker_epoch=45,topic_states=[{topic_name=test.kafka.logger,partition_states=[{partition_index=0,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}}],_tagged_fields={}}],live_leaders=[{broker_id=0,host_name=172.30.1.4,port=9092,_tagged_fields={}}],_tagged_fields={}},response:{error_code=0,partition_errors=[{topic_name=test.kafka.logger,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50747-2;totalTime:6.491,requestQueueTime:0.079,localTime:6.276,remoteTime:0.0,throttleTime:0.0,responseQueueTime:0.04,sendTime:0.11,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:37:04,211] DEBUG Completed request:RequestHeader(apiKey=UPDATE_METADATA, apiVersion=6, clientId=0, correlationId=4) -- {controller_id=0,controller_epoch=1,broker_epoch=45,topic_states=[{topic_name=test.kafka.logger,partition_states=[{partition_index=0,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}}],_tagged_fields={}}],live_brokers=[{id=0,endpoints=[{port=9092,host=172.30.1.4,listener=PLAINTEXT,security_protocol=0,_tagged_fields={}}],rack=null,_tagged_fields={}}],_tagged_fields={}},response:{error_code=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50747-2;totalTime:1.031,requestQueueTime:0.095,localTime:0.854,remoteTime:0.0,throttleTime:0.0,responseQueueTime:0.019,sendTime:0.071,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:37:04,211] DEBUG Completed request:RequestHeader(apiKey=CREATE_TOPICS, apiVersion=5, clientId=adminclient-1, correlationId=4) -- {topics=[{name=test.kafka.logger,num_partitions=1,replication_factor=1,assignments=[],configs=[],_tagged_fields={}}],timeout_ms=119999,validate_only=false,_tagged_fields={}},response:{throttle_time_ms=0,topics=[{name=test.kafka.logger,error_code=0,error_message=null,num_partitions=1,replication_factor=1,configs=[{name=compression.type,value=producer,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=leader.replication.throttled.replicas,value=,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=min.insync.replicas,value=1,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=message.downconversion.enable,value=true,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=segment.jitter.ms,value=0,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=cleanup.policy,value=delete,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=flush.ms,value=9223372036854775807,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=follower.replication.throttled.replicas,value=,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=segment.bytes,value=1073741824,read_only=false,config_source=4,is_sensitive=false,_tagged_fields={}},{name=retention.ms,value=604800000,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=flush.messages,value=9223372036854775807,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=message.format.version,value=2.4-IV1,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=max.compaction.lag.ms,value=9223372036854775807,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=file.delete.delay.ms,value=60000,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=max.message.bytes,value=1000012,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=min.compaction.lag.ms,value=0,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=message.timestamp.type,value=CreateTime,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=preallocate,value=false,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=index.interval.bytes,value=4096,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=min.cleanable.dirty.ratio,value=0.5,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=unclean.leader.election.enable,value=false,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=retention.bytes,value=-1,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=delete.retention.ms,value=86400000,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=segment.ms,value=604800000,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=message.timestamp.difference.max.ms,value=9223372036854775807,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}},{name=segment.index.bytes,value=10485760,read_only=false,config_source=5,is_sensitive=false,_tagged_fields={}}],_tagged_fields={}}],_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50772-3;totalTime:18.194,requestQueueTime:0.102,localTime:7.572,remoteTime:10.121,throttleTime:0.258,responseQueueTime:0.024,sendTime:0.114,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)

view raw kafka-request-create-topic.log hosted with ❤ by GitHub

최종적으로 CREATE_TOPICS 요청을 통해 토픽이 생성되는 것을 알 수 있다.

메시지 프로듀싱

	# 요청
	kafka-console-producer.sh --broker-list localhost:9092 --topic test.kafka.logger
	>1
	>2
	>3

	# 관련 로그
	## Console Producer 연결
	[2020-11-21 14:38:57,294] DEBUG Completed request:RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=console-producer, correlationId=0) -- {client_software_name=apache-kafka-java,client_software_version=2.4.2-SNAPSHOT,_tagged_fields={}},response:{error_code=0,api_keys=[{api_key=0,min_version=0,max_version=8,_tagged_fields={}},{api_key=1,min_version=0,max_version=11,_tagged_fields={}},{api_key=2,min_version=0,max_version=5,_tagged_fields={}},{api_key=3,min_version=0,max_version=9,_tagged_fields={}},{api_key=4,min_version=0,max_version=4,_tagged_fields={}},{api_key=5,min_version=0,max_version=2,_tagged_fields={}},{api_key=6,min_version=0,max_version=6,_tagged_fields={}},{api_key=7,min_version=0,max_version=3,_tagged_fields={}},{api_key=8,min_version=0,max_version=8,_tagged_fields={}},{api_key=9,min_version=0,max_version=6,_tagged_fields={}},{api_key=10,min_version=0,max_version=3,_tagged_fields={}},{api_key=11,min_version=0,max_version=6,_tagged_fields={}},{api_key=12,min_version=0,max_version=4,_tagged_fields={}},{api_key=13,min_version=0,max_version=4,_tagged_fields={}},{api_key=14,min_version=0,max_version=4,_tagged_fields={}},{api_key=15,min_version=0,max_version=5,_tagged_fields={}},{api_key=16,min_version=0,max_version=3,_tagged_fields={}},{api_key=17,min_version=0,max_version=1,_tagged_fields={}},{api_key=18,min_version=0,max_version=3,_tagged_fields={}},{api_key=19,min_version=0,max_version=5,_tagged_fields={}},{api_key=20,min_version=0,max_version=4,_tagged_fields={}},{api_key=21,min_version=0,max_version=1,_tagged_fields={}},{api_key=22,min_version=0,max_version=2,_tagged_fields={}},{api_key=23,min_version=0,max_version=3,_tagged_fields={}},{api_key=24,min_version=0,max_version=1,_tagged_fields={}},{api_key=25,min_version=0,max_version=1,_tagged_fields={}},{api_key=26,min_version=0,max_version=1,_tagged_fields={}},{api_key=27,min_version=0,max_version=0,_tagged_fields={}},{api_key=28,min_version=0,max_version=2,_tagged_fields={}},{api_key=29,min_version=0,max_version=1,_tagged_fields={}},{api_key=30,min_version=0,max_version=1,_tagged_fields={}},{api_key=31,min_version=0,max_version=1,_tagged_fields={}},{api_key=32,min_version=0,max_version=2,_tagged_fields={}},{api_key=33,min_version=0,max_version=1,_tagged_fields={}},{api_key=34,min_version=0,max_version=1,_tagged_fields={}},{api_key=35,min_version=0,max_version=1,_tagged_fields={}},{api_key=36,min_version=0,max_version=1,_tagged_fields={}},{api_key=37,min_version=0,max_version=1,_tagged_fields={}},{api_key=38,min_version=0,max_version=2,_tagged_fields={}},{api_key=39,min_version=0,max_version=1,_tagged_fields={}},{api_key=40,min_version=0,max_version=1,_tagged_fields={}},{api_key=41,min_version=0,max_version=1,_tagged_fields={}},{api_key=42,min_version=0,max_version=2,_tagged_fields={}},{api_key=43,min_version=0,max_version=2,_tagged_fields={}},{api_key=44,min_version=0,max_version=1,_tagged_fields={}},{api_key=45,min_version=0,max_version=0,_tagged_fields={}},{api_key=46,min_version=0,max_version=0,_tagged_fields={}},{api_key=47,min_version=0,max_version=0,_tagged_fields={}}],throttle_time_ms=0,_tagged_fields={}} from connection 127.0.0.1:9092-127.0.0.1:50798-4;totalTime:0.736,requestQueueTime:0.112,localTime:0.415,remoteTime:0.0,throttleTime:0.36,responseQueueTime:0.054,sendTime:0.172,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:38:57,333] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=console-producer, correlationId=1) -- {topics=[],allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[],cluster_authorized_operations=0,_tagged_fields={}} from connection 127.0.0.1:9092-127.0.0.1:50798-4;totalTime:0.631,requestQueueTime:0.121,localTime:0.354,remoteTime:0.0,throttleTime:0.137,responseQueueTime:0.033,sendTime:0.138,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	## Message 발행
	[2020-11-21 14:39:25,548] DEBUG Completed request:RequestHeader(apiKey=PRODUCE, apiVersion=8, clientId=console-producer, correlationId=4) -- {acks=1,timeout=1500,numPartitions=1},response:{responses=[{topic=test.kafka.logger,partition_responses=[{partition=0,error_code=0,base_offset=0,log_append_time=-1,log_start_offset=0,record_errors=[],error_message=null}]}],throttle_time_ms=0} from connection 172.30.1.4:9092-172.30.1.4:50803-4;totalTime:56.015,requestQueueTime:1.985,localTime:53.881,remoteTime:0.0,throttleTime:1.088,responseQueueTime:0.046,sendTime:0.126,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:39:35,303] DEBUG Completed request:RequestHeader(apiKey=PRODUCE, apiVersion=8, clientId=console-producer, correlationId=5) -- {acks=1,timeout=1500,numPartitions=1},response:{responses=[{topic=test.kafka.logger,partition_responses=[{partition=0,error_code=0,base_offset=1,log_append_time=-1,log_start_offset=0,record_errors=[],error_message=null}]}],throttle_time_ms=0} from connection 172.30.1.4:9092-172.30.1.4:50803-4;totalTime:1.843,requestQueueTime:0.153,localTime:1.501,remoteTime:0.0,throttleTime:0.191,responseQueueTime:0.057,sendTime:0.156,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:39:39,804] DEBUG Completed request:RequestHeader(apiKey=PRODUCE, apiVersion=8, clientId=console-producer, correlationId=6) -- {acks=1,timeout=1500,numPartitions=1},response:{responses=[{topic=test.kafka.logger,partition_responses=[{partition=0,error_code=0,base_offset=2,log_append_time=-1,log_start_offset=0,record_errors=[],error_message=null}]}],throttle_time_ms=0} from connection 172.30.1.4:9092-172.30.1.4:50803-4;totalTime:2.589,requestQueueTime:0.186,localTime:2.16,remoteTime:0.0,throttleTime:0.268,responseQueueTime:0.063,sendTime:0.211,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)

view raw kafka-request-produce.log hosted with ❤ by GitHub

프로듀서가 연결되면서 METADATA 요청으로 카프카 클러스터에 대한 메타데이터를 가져가는 것을 알 수 있다.
PRODCUE 요청으로 프로듀서가 메시지를 발행하는 것을 알 수 있다.

메시지 컨슈밍

	# 요청
	kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test.kafka.logger --from-beginning

	# 응답
	## Console Consumer 연결
	[2020-11-21 14:42:13,282] DEBUG Completed request:RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=1) -- {client_software_name=apache-kafka-java,client_software_version=2.4.2-SNAPSHOT,_tagged_fields={}},response:{error_code=0,api_keys=[{api_key=0,min_version=0,max_version=8,_tagged_fields={}},{api_key=1,min_version=0,max_version=11,_tagged_fields={}},{api_key=2,min_version=0,max_version=5,_tagged_fields={}},{api_key=3,min_version=0,max_version=9,_tagged_fields={}},{api_key=4,min_version=0,max_version=4,_tagged_fields={}},{api_key=5,min_version=0,max_version=2,_tagged_fields={}},{api_key=6,min_version=0,max_version=6,_tagged_fields={}},{api_key=7,min_version=0,max_version=3,_tagged_fields={}},{api_key=8,min_version=0,max_version=8,_tagged_fields={}},{api_key=9,min_version=0,max_version=6,_tagged_fields={}},{api_key=10,min_version=0,max_version=3,_tagged_fields={}},{api_key=11,min_version=0,max_version=6,_tagged_fields={}},{api_key=12,min_version=0,max_version=4,_tagged_fields={}},{api_key=13,min_version=0,max_version=4,_tagged_fields={}},{api_key=14,min_version=0,max_version=4,_tagged_fields={}},{api_key=15,min_version=0,max_version=5,_tagged_fields={}},{api_key=16,min_version=0,max_version=3,_tagged_fields={}},{api_key=17,min_version=0,max_version=1,_tagged_fields={}},{api_key=18,min_version=0,max_version=3,_tagged_fields={}},{api_key=19,min_version=0,max_version=5,_tagged_fields={}},{api_key=20,min_version=0,max_version=4,_tagged_fields={}},{api_key=21,min_version=0,max_version=1,_tagged_fields={}},{api_key=22,min_version=0,max_version=2,_tagged_fields={}},{api_key=23,min_version=0,max_version=3,_tagged_fields={}},{api_key=24,min_version=0,max_version=1,_tagged_fields={}},{api_key=25,min_version=0,max_version=1,_tagged_fields={}},{api_key=26,min_version=0,max_version=1,_tagged_fields={}},{api_key=27,min_version=0,max_version=0,_tagged_fields={}},{api_key=28,min_version=0,max_version=2,_tagged_fields={}},{api_key=29,min_version=0,max_version=1,_tagged_fields={}},{api_key=30,min_version=0,max_version=1,_tagged_fields={}},{api_key=31,min_version=0,max_version=1,_tagged_fields={}},{api_key=32,min_version=0,max_version=2,_tagged_fields={}},{api_key=33,min_version=0,max_version=1,_tagged_fields={}},{api_key=34,min_version=0,max_version=1,_tagged_fields={}},{api_key=35,min_version=0,max_version=1,_tagged_fields={}},{api_key=36,min_version=0,max_version=1,_tagged_fields={}},{api_key=37,min_version=0,max_version=1,_tagged_fields={}},{api_key=38,min_version=0,max_version=2,_tagged_fields={}},{api_key=39,min_version=0,max_version=1,_tagged_fields={}},{api_key=40,min_version=0,max_version=1,_tagged_fields={}},{api_key=41,min_version=0,max_version=1,_tagged_fields={}},{api_key=42,min_version=0,max_version=2,_tagged_fields={}},{api_key=43,min_version=0,max_version=2,_tagged_fields={}},{api_key=44,min_version=0,max_version=1,_tagged_fields={}},{api_key=45,min_version=0,max_version=0,_tagged_fields={}},{api_key=46,min_version=0,max_version=0,_tagged_fields={}},{api_key=47,min_version=0,max_version=0,_tagged_fields={}}],throttle_time_ms=0,_tagged_fields={}} from connection 127.0.0.1:9092-127.0.0.1:50813-4;totalTime:0.483,requestQueueTime:0.071,localTime:0.258,remoteTime:0.0,throttleTime:0.223,responseQueueTime:0.039,sendTime:0.132,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,319] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=consumer-console-consumer-43517-1, correlationId=2) -- {topics=[{name=test.kafka.logger,_tagged_fields={}}],allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[{error_code=0,name=test.kafka.logger,is_internal=false,partitions=[{error_code=0,partition_index=0,leader_id=0,leader_epoch=0,replica_nodes=[0],isr_nodes=[0],offline_replicas=[],_tagged_fields={}}],topic_authorized_operations=0,_tagged_fields={}}],cluster_authorized_operations=0,_tagged_fields={}} from connection 127.0.0.1:9092-127.0.0.1:50813-4;totalTime:0.911,requestQueueTime:0.07,localTime:0.701,remoteTime:0.0,throttleTime:0.353,responseQueueTime:0.029,sendTime:0.128,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,336] DEBUG Completed request:RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=0) -- {key=console-consumer-43517,key_type=0,_tagged_fields={}},response:{throttle_time_ms=0,error_code=15,error_message=The coordinator is not available.,node_id=-1,host=,port=-1,_tagged_fields={}} from connection 127.0.0.1:9092-127.0.0.1:50813-4;totalTime:15.801,requestQueueTime:0.143,localTime:15.461,remoteTime:0.0,throttleTime:0.726,responseQueueTime:0.034,sendTime:0.179,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,423] DEBUG Completed request:RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=3) -- {client_software_name=apache-kafka-java,client_software_version=2.4.2-SNAPSHOT,_tagged_fields={}},response:{error_code=0,api_keys=[{api_key=0,min_version=0,max_version=8,_tagged_fields={}},{api_key=1,min_version=0,max_version=11,_tagged_fields={}},{api_key=2,min_version=0,max_version=5,_tagged_fields={}},{api_key=3,min_version=0,max_version=9,_tagged_fields={}},{api_key=4,min_version=0,max_version=4,_tagged_fields={}},{api_key=5,min_version=0,max_version=2,_tagged_fields={}},{api_key=6,min_version=0,max_version=6,_tagged_fields={}},{api_key=7,min_version=0,max_version=3,_tagged_fields={}},{api_key=8,min_version=0,max_version=8,_tagged_fields={}},{api_key=9,min_version=0,max_version=6,_tagged_fields={}},{api_key=10,min_version=0,max_version=3,_tagged_fields={}},{api_key=11,min_version=0,max_version=6,_tagged_fields={}},{api_key=12,min_version=0,max_version=4,_tagged_fields={}},{api_key=13,min_version=0,max_version=4,_tagged_fields={}},{api_key=14,min_version=0,max_version=4,_tagged_fields={}},{api_key=15,min_version=0,max_version=5,_tagged_fields={}},{api_key=16,min_version=0,max_version=3,_tagged_fields={}},{api_key=17,min_version=0,max_version=1,_tagged_fields={}},{api_key=18,min_version=0,max_version=3,_tagged_fields={}},{api_key=19,min_version=0,max_version=5,_tagged_fields={}},{api_key=20,min_version=0,max_version=4,_tagged_fields={}},{api_key=21,min_version=0,max_version=1,_tagged_fields={}},{api_key=22,min_version=0,max_version=2,_tagged_fields={}},{api_key=23,min_version=0,max_version=3,_tagged_fields={}},{api_key=24,min_version=0,max_version=1,_tagged_fields={}},{api_key=25,min_version=0,max_version=1,_tagged_fields={}},{api_key=26,min_version=0,max_version=1,_tagged_fields={}},{api_key=27,min_version=0,max_version=0,_tagged_fields={}},{api_key=28,min_version=0,max_version=2,_tagged_fields={}},{api_key=29,min_version=0,max_version=1,_tagged_fields={}},{api_key=30,min_version=0,max_version=1,_tagged_fields={}},{api_key=31,min_version=0,max_version=1,_tagged_fields={}},{api_key=32,min_version=0,max_version=2,_tagged_fields={}},{api_key=33,min_version=0,max_version=1,_tagged_fields={}},{api_key=34,min_version=0,max_version=1,_tagged_fields={}},{api_key=35,min_version=0,max_version=1,_tagged_fields={}},{api_key=36,min_version=0,max_version=1,_tagged_fields={}},{api_key=37,min_version=0,max_version=1,_tagged_fields={}},{api_key=38,min_version=0,max_version=2,_tagged_fields={}},{api_key=39,min_version=0,max_version=1,_tagged_fields={}},{api_key=40,min_version=0,max_version=1,_tagged_fields={}},{api_key=41,min_version=0,max_version=1,_tagged_fields={}},{api_key=42,min_version=0,max_version=2,_tagged_fields={}},{api_key=43,min_version=0,max_version=2,_tagged_fields={}},{api_key=44,min_version=0,max_version=1,_tagged_fields={}},{api_key=45,min_version=0,max_version=0,_tagged_fields={}},{api_key=46,min_version=0,max_version=0,_tagged_fields={}},{api_key=47,min_version=0,max_version=0,_tagged_fields={}}],throttle_time_ms=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:0.529,requestQueueTime:0.134,localTime:0.284,remoteTime:0.0,throttleTime:0.25,responseQueueTime:0.024,sendTime:0.101,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,425] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=consumer-console-consumer-43517-1, correlationId=4) -- {topics=[{name=test.kafka.logger,_tagged_fields={}}],allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[{error_code=0,name=test.kafka.logger,is_internal=false,partitions=[{error_code=0,partition_index=0,leader_id=0,leader_epoch=0,replica_nodes=[0],isr_nodes=[0],offline_replicas=[],_tagged_fields={}}],topic_authorized_operations=0,_tagged_fields={}}],cluster_authorized_operations=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:0.895,requestQueueTime:0.1,localTime:0.65,remoteTime:0.0,throttleTime:0.218,responseQueueTime:0.025,sendTime:0.134,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,429] DEBUG Completed request:RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=5) -- {key=console-consumer-43517,key_type=0,_tagged_fields={}},response:{throttle_time_ms=0,error_code=15,error_message=The coordinator is not available.,node_id=-1,host=,port=-1,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:3.014,requestQueueTime:0.047,localTime:2.808,remoteTime:0.0,throttleTime:0.066,responseQueueTime:0.026,sendTime:0.146,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,528] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=consumer-console-consumer-43517-1, correlationId=6) -- {topics=[{name=test.kafka.logger,_tagged_fields={}}],allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[{error_code=0,name=test.kafka.logger,is_internal=false,partitions=[{error_code=0,partition_index=0,leader_id=0,leader_epoch=0,replica_nodes=[0],isr_nodes=[0],offline_replicas=[],_tagged_fields={}}],topic_authorized_operations=0,_tagged_fields={}}],cluster_authorized_operations=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:1.124,requestQueueTime:0.246,localTime:0.705,remoteTime:0.0,throttleTime:0.272,responseQueueTime:0.065,sendTime:0.158,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,548] DEBUG Completed request:RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=7) -- {key=console-consumer-43517,key_type=0,_tagged_fields={}},response:{throttle_time_ms=0,error_code=15,error_message=The coordinator is not available.,node_id=-1,host=,port=-1,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:18.858,requestQueueTime:0.262,localTime:17.912,remoteTime:0.0,throttleTime:0.212,responseQueueTime:0.507,sendTime:0.23,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,630] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=consumer-console-consumer-43517-1, correlationId=8) -- {topics=[{name=test.kafka.logger,_tagged_fields={}}],allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[{error_code=0,name=test.kafka.logger,is_internal=false,partitions=[{error_code=0,partition_index=0,leader_id=0,leader_epoch=0,replica_nodes=[0],isr_nodes=[0],offline_replicas=[],_tagged_fields={}}],topic_authorized_operations=0,_tagged_fields={}}],cluster_authorized_operations=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:0.62,requestQueueTime:0.088,localTime:0.417,remoteTime:0.0,throttleTime:0.167,responseQueueTime:0.033,sendTime:0.096,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,633] DEBUG Completed request:RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=9) -- {key=console-consumer-43517,key_type=0,_tagged_fields={}},response:{throttle_time_ms=0,error_code=15,error_message=The coordinator is not available.,node_id=-1,host=,port=-1,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:2.31,requestQueueTime:0.056,localTime:2.14,remoteTime:0.0,throttleTime:0.076,responseQueueTime:0.029,sendTime:0.101,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,665] DEBUG Completed request:RequestHeader(apiKey=LEADER_AND_ISR, apiVersion=4, clientId=0, correlationId=5) -- {controller_id=0,controller_epoch=1,broker_epoch=45,topic_states=[{topic_name=__consumer_offsets,partition_states=[{partition_index=49,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=38,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=16,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=27,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=8,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=19,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=13,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=2,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=46,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=35,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=24,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=5,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=43,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=21,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=32,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=10,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=37,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=48,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=40,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=18,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=29,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=7,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=23,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=45,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=34,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=26,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=15,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=4,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=42,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=31,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=9,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=20,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=12,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=1,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=28,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=17,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=6,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=39,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=44,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=36,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=47,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=3,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=25,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=14,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=30,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=41,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=22,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=33,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=11,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}},{partition_index=0,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],adding_replicas=[],removing_replicas=[],is_new=true,_tagged_fields={}}],_tagged_fields={}}],live_leaders=[{broker_id=0,host_name=172.30.1.4,port=9092,_tagged_fields={}}],_tagged_fields={}},response:{error_code=0,partition_errors=[{topic_name=__consumer_offsets,partition_index=49,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=38,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=27,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=16,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=8,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=19,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=13,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=2,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=24,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=46,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=35,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=5,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=43,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=21,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=32,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=10,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=37,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=48,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=29,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=40,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=18,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=7,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=45,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=23,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=34,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=26,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=4,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=15,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=42,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=20,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=31,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=9,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=1,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=12,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=17,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=28,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=6,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=39,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=44,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=36,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=47,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=14,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=25,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=3,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=30,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=41,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=11,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=33,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=22,error_code=0,_tagged_fields={}},{topic_name=__consumer_offsets,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50747-2;totalTime:275.279,requestQueueTime:0.794,localTime:274.305,remoteTime:0.0,throttleTime:0.0,responseQueueTime:0.047,sendTime:0.157,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,676] DEBUG Completed request:RequestHeader(apiKey=UPDATE_METADATA, apiVersion=6, clientId=0, correlationId=6) -- {controller_id=0,controller_epoch=1,broker_epoch=45,topic_states=[{topic_name=__consumer_offsets,partition_states=[{partition_index=49,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=38,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=16,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=27,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=8,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=19,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=13,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=2,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=46,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=35,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=24,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=5,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=43,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=21,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=32,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=10,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=37,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=48,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=40,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=18,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=29,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=7,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=23,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=45,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=34,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=26,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=15,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=4,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=42,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=31,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=9,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=20,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=12,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=1,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=28,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=17,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=6,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=39,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=44,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=36,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=47,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=3,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=25,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=14,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=30,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=41,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=22,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=33,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=11,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}},{partition_index=0,controller_epoch=1,leader=0,leader_epoch=0,isr=[0],zk_version=0,replicas=[0],offline_replicas=[],_tagged_fields={}}],_tagged_fields={}}],live_brokers=[{id=0,endpoints=[{port=9092,host=172.30.1.4,listener=PLAINTEXT,security_protocol=0,_tagged_fields={}}],rack=null,_tagged_fields={}}],_tagged_fields={}},response:{error_code=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50747-2;totalTime:2.919,requestQueueTime:0.354,localTime:2.333,remoteTime:0.0,throttleTime:0.0,responseQueueTime:0.067,sendTime:0.191,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,733] DEBUG Completed request:RequestHeader(apiKey=METADATA, apiVersion=9, clientId=consumer-console-consumer-43517-1, correlationId=10) -- {topics=[{name=test.kafka.logger,_tagged_fields={}}],allow_auto_topic_creation=true,include_cluster_authorized_operations=false,include_topic_authorized_operations=false,_tagged_fields={}},response:{throttle_time_ms=0,brokers=[{node_id=0,host=172.30.1.4,port=9092,rack=null,_tagged_fields={}}],cluster_id=9QLfuFn6Szu1fsAIhgadOw,controller_id=0,topics=[{error_code=0,name=test.kafka.logger,is_internal=false,partitions=[{error_code=0,partition_index=0,leader_id=0,leader_epoch=0,replica_nodes=[0],isr_nodes=[0],offline_replicas=[],_tagged_fields={}}],topic_authorized_operations=0,_tagged_fields={}}],cluster_authorized_operations=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:0.722,requestQueueTime:0.085,localTime:0.512,remoteTime:0.0,throttleTime:0.196,responseQueueTime:0.038,sendTime:0.104,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,736] DEBUG Completed request:RequestHeader(apiKey=FIND_COORDINATOR, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=11) -- {key=console-consumer-43517,key_type=0,_tagged_fields={}},response:{throttle_time_ms=0,error_code=0,error_message=NONE,node_id=0,host=172.30.1.4,port=9092,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:2.151,requestQueueTime:0.059,localTime:1.92,remoteTime:0.0,throttleTime:1.075,responseQueueTime:0.062,sendTime:0.125,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,743] DEBUG Completed request:RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=consumer-console-consumer-43517-1, correlationId=13) -- {client_software_name=apache-kafka-java,client_software_version=2.4.2-SNAPSHOT,_tagged_fields={}},response:{error_code=0,api_keys=[{api_key=0,min_version=0,max_version=8,_tagged_fields={}},{api_key=1,min_version=0,max_version=11,_tagged_fields={}},{api_key=2,min_version=0,max_version=5,_tagged_fields={}},{api_key=3,min_version=0,max_version=9,_tagged_fields={}},{api_key=4,min_version=0,max_version=4,_tagged_fields={}},{api_key=5,min_version=0,max_version=2,_tagged_fields={}},{api_key=6,min_version=0,max_version=6,_tagged_fields={}},{api_key=7,min_version=0,max_version=3,_tagged_fields={}},{api_key=8,min_version=0,max_version=8,_tagged_fields={}},{api_key=9,min_version=0,max_version=6,_tagged_fields={}},{api_key=10,min_version=0,max_version=3,_tagged_fields={}},{api_key=11,min_version=0,max_version=6,_tagged_fields={}},{api_key=12,min_version=0,max_version=4,_tagged_fields={}},{api_key=13,min_version=0,max_version=4,_tagged_fields={}},{api_key=14,min_version=0,max_version=4,_tagged_fields={}},{api_key=15,min_version=0,max_version=5,_tagged_fields={}},{api_key=16,min_version=0,max_version=3,_tagged_fields={}},{api_key=17,min_version=0,max_version=1,_tagged_fields={}},{api_key=18,min_version=0,max_version=3,_tagged_fields={}},{api_key=19,min_version=0,max_version=5,_tagged_fields={}},{api_key=20,min_version=0,max_version=4,_tagged_fields={}},{api_key=21,min_version=0,max_version=1,_tagged_fields={}},{api_key=22,min_version=0,max_version=2,_tagged_fields={}},{api_key=23,min_version=0,max_version=3,_tagged_fields={}},{api_key=24,min_version=0,max_version=1,_tagged_fields={}},{api_key=25,min_version=0,max_version=1,_tagged_fields={}},{api_key=26,min_version=0,max_version=1,_tagged_fields={}},{api_key=27,min_version=0,max_version=0,_tagged_fields={}},{api_key=28,min_version=0,max_version=2,_tagged_fields={}},{api_key=29,min_version=0,max_version=1,_tagged_fields={}},{api_key=30,min_version=0,max_version=1,_tagged_fields={}},{api_key=31,min_version=0,max_version=1,_tagged_fields={}},{api_key=32,min_version=0,max_version=2,_tagged_fields={}},{api_key=33,min_version=0,max_version=1,_tagged_fields={}},{api_key=34,min_version=0,max_version=1,_tagged_fields={}},{api_key=35,min_version=0,max_version=1,_tagged_fields={}},{api_key=36,min_version=0,max_version=1,_tagged_fields={}},{api_key=37,min_version=0,max_version=1,_tagged_fields={}},{api_key=38,min_version=0,max_version=2,_tagged_fields={}},{api_key=39,min_version=0,max_version=1,_tagged_fields={}},{api_key=40,min_version=0,max_version=1,_tagged_fields={}},{api_key=41,min_version=0,max_version=1,_tagged_fields={}},{api_key=42,min_version=0,max_version=2,_tagged_fields={}},{api_key=43,min_version=0,max_version=2,_tagged_fields={}},{api_key=44,min_version=0,max_version=1,_tagged_fields={}},{api_key=45,min_version=0,max_version=0,_tagged_fields={}},{api_key=46,min_version=0,max_version=0,_tagged_fields={}},{api_key=47,min_version=0,max_version=0,_tagged_fields={}}],throttle_time_ms=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:0.79,requestQueueTime:0.073,localTime:0.278,remoteTime:0.0,throttleTime:0.239,responseQueueTime:0.035,sendTime:0.423,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,758] DEBUG Completed request:RequestHeader(apiKey=JOIN_GROUP, apiVersion=6, clientId=consumer-console-consumer-43517-1, correlationId=12) -- {group_id=console-consumer-43517,session_timeout_ms=10000,rebalance_timeout_ms=300000,member_id=,group_instance_id=null,protocol_type=consumer,protocols=[{name=range,metadata=java.nio.HeapByteBuffer[pos=0 lim=33 cap=33],_tagged_fields={}}],_tagged_fields={}},response:{throttle_time_ms=0,error_code=79,generation_id=-1,protocol_name=,leader=,member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,members=[],_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:13.214,requestQueueTime:0.783,localTime:12.273,remoteTime:0.0,throttleTime:0.562,responseQueueTime:0.051,sendTime:0.129,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,776] DEBUG Completed request:RequestHeader(apiKey=JOIN_GROUP, apiVersion=6, clientId=consumer-console-consumer-43517-1, correlationId=14) -- {group_id=console-consumer-43517,session_timeout_ms=10000,rebalance_timeout_ms=300000,member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,protocol_type=consumer,protocols=[{name=range,metadata=java.nio.HeapByteBuffer[pos=0 lim=33 cap=33],_tagged_fields={}}],_tagged_fields={}},response:{throttle_time_ms=0,error_code=0,generation_id=1,protocol_name=range,leader=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,members=[{member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,metadata=java.nio.HeapByteBuffer[pos=0 lim=33 cap=33],_tagged_fields={}}],_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:17.725,requestQueueTime:0.084,localTime:8.903,remoteTime:7.166,throttleTime:0.593,responseQueueTime:0.124,sendTime:0.853,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,796] DEBUG Completed request:RequestHeader(apiKey=SYNC_GROUP, apiVersion=4, clientId=consumer-console-consumer-43517-1, correlationId=15) -- {group_id=console-consumer-43517,generation_id=1,member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,assignments=[{member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,assignment=java.nio.HeapByteBuffer[pos=0 lim=37 cap=37],_tagged_fields={}}],_tagged_fields={}},response:{throttle_time_ms=0,error_code=0,assignment=java.nio.HeapByteBuffer[pos=0 lim=37 cap=37],_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:15.559,requestQueueTime:0.225,localTime:15.255,remoteTime:0.0,throttleTime:0.256,responseQueueTime:0.041,sendTime:0.4,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	## 메시지 Fetch
	[2020-11-21 14:42:13,809] DEBUG Completed request:RequestHeader(apiKey=OFFSET_FETCH, apiVersion=6, clientId=consumer-console-consumer-43517-1, correlationId=16) -- {group_id=console-consumer-43517,topics=[{name=test.kafka.logger,partition_indexes=[0],_tagged_fields={}}],_tagged_fields={}},response:{throttle_time_ms=0,topics=[{name=test.kafka.logger,partitions=[{partition_index=0,committed_offset=-1,committed_leader_epoch=-1,metadata=,error_code=0,_tagged_fields={}}],_tagged_fields={}}],error_code=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:4.697,requestQueueTime:0.25,localTime:4.287,remoteTime:0.0,throttleTime:3.885,responseQueueTime:0.056,sendTime:0.128,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,825] DEBUG Completed request:RequestHeader(apiKey=LIST_OFFSETS, apiVersion=5, clientId=consumer-console-consumer-43517-1, correlationId=17) -- {replica_id=-1,isolation_level=0,topics=[{topic=test.kafka.logger,partitions=[{partition=0,current_leader_epoch=0,timestamp=-2}]}]},response:{throttle_time_ms=0,responses=[{topic=test.kafka.logger,partition_responses=[{partition=0,error_code=0,timestamp=-1,offset=0,leader_epoch=0}]}]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:6.576,requestQueueTime:0.731,localTime:5.684,remoteTime:0.0,throttleTime:0.509,responseQueueTime:0.041,sendTime:0.14,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:13,862] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=18) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=0,session_epoch=0,topics=[{topic=test.kafka.logger,partitions=[{partition=0,current_leader_epoch=0,fetch_offset=0,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[{topic=test.kafka.logger,partition_responses=[{partition_header={partition=0,error_code=0,high_watermark=3,last_stable_offset=3,log_start_offset=0,aborted_transactions=null,preferred_read_replica=-1},record_set=FileRecords(size=207, file=/Users/daehokimm/dev/data/kafka/test.kafka.logger-0/00000000000000000000.log, start=0, end=207)}]}]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:31.673,requestQueueTime:0.757,localTime:28.792,remoteTime:0.0,throttleTime:10.808,responseQueueTime:0.048,sendTime:2.095,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:14,396] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=19) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=1,topics=[{topic=test.kafka.logger,partitions=[{partition=0,current_leader_epoch=0,fetch_offset=3,log_start_offset=-1,partition_max_bytes=1048576}]}],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:510.619,requestQueueTime:0.366,localTime:6.821,remoteTime:501.9,throttleTime:1.274,responseQueueTime:0.064,sendTime:0.192,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:14,902] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=20) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=2,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:504.093,requestQueueTime:0.099,localTime:0.355,remoteTime:503.012,throttleTime:0.295,responseQueueTime:0.129,sendTime:0.2,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:15,407] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=21) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=3,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:503.462,requestQueueTime:0.095,localTime:0.646,remoteTime:502.241,throttleTime:0.183,responseQueueTime:0.087,sendTime:0.207,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:15,909] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=22) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=4,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:501.628,requestQueueTime:0.074,localTime:0.352,remoteTime:500.779,throttleTime:0.156,responseQueueTime:0.065,sendTime:0.201,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:16,416] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=23) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=5,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:505.36,requestQueueTime:0.071,localTime:0.311,remoteTime:504.476,throttleTime:0.219,responseQueueTime:0.103,sendTime:0.176,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:16,802] DEBUG Completed request:RequestHeader(apiKey=HEARTBEAT, apiVersion=4, clientId=consumer-console-consumer-43517-1, correlationId=25) -- {group_id=console-consumer-43517,generation_id=1,member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,_tagged_fields={}},response:{throttle_time_ms=0,error_code=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:3.21,requestQueueTime:0.261,localTime:2.798,remoteTime:0.0,throttleTime:0.728,responseQueueTime:0.038,sendTime:0.136,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:16,918] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=24) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=6,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:501.249,requestQueueTime:0.094,localTime:0.345,remoteTime:500.331,throttleTime:0.189,responseQueueTime:0.078,sendTime:0.21,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:17,423] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=26) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=7,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:503.531,requestQueueTime:0.068,localTime:0.305,remoteTime:502.683,throttleTime:0.196,responseQueueTime:0.076,sendTime:0.201,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:17,927] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=27) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=8,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:502.421,requestQueueTime:0.111,localTime:0.385,remoteTime:501.446,throttleTime:0.186,responseQueueTime:0.072,sendTime:0.218,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:18,430] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=28) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=9,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:502.694,requestQueueTime:0.086,localTime:0.325,remoteTime:501.708,throttleTime:0.267,responseQueueTime:0.112,sendTime:0.194,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:18,935] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=29) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=10,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:502.886,requestQueueTime:0.112,localTime:0.38,remoteTime:501.933,throttleTime:0.19,responseQueueTime:0.071,sendTime:0.198,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:19,437] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=30) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=11,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:501.287,requestQueueTime:0.087,localTime:0.318,remoteTime:500.5,throttleTime:0.156,responseQueueTime:0.055,sendTime:0.169,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:19,803] DEBUG Completed request:RequestHeader(apiKey=HEARTBEAT, apiVersion=4, clientId=consumer-console-consumer-43517-1, correlationId=32) -- {group_id=console-consumer-43517,generation_id=1,member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,_tagged_fields={}},response:{throttle_time_ms=0,error_code=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:0.892,requestQueueTime:0.171,localTime:0.554,remoteTime:0.0,throttleTime:0.115,responseQueueTime:0.053,sendTime:0.138,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:19,942] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=31) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=12,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:503.689,requestQueueTime:0.088,localTime:0.284,remoteTime:502.641,throttleTime:0.323,responseQueueTime:0.125,sendTime:0.226,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:20,448] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=33) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=13,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:505.107,requestQueueTime:0.115,localTime:0.398,remoteTime:503.883,throttleTime:0.306,responseQueueTime:0.092,sendTime:0.31,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:20,955] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=34) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=14,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:505.41,requestQueueTime:0.118,localTime:0.396,remoteTime:504.325,throttleTime:0.268,responseQueueTime:0.107,sendTime:0.195,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:21,460] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=35) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=15,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:503.584,requestQueueTime:0.088,localTime:0.376,remoteTime:502.547,throttleTime:0.266,responseQueueTime:0.11,sendTime:0.194,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:21,965] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=36) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=16,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:503.602,requestQueueTime:0.102,localTime:0.359,remoteTime:502.622,throttleTime:0.227,responseQueueTime:0.081,sendTime:0.209,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:22,470] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=37) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=17,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:503.962,requestQueueTime:0.097,localTime:0.373,remoteTime:502.871,throttleTime:0.303,responseQueueTime:0.106,sendTime:0.211,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:22,804] DEBUG Completed request:RequestHeader(apiKey=HEARTBEAT, apiVersion=4, clientId=consumer-console-consumer-43517-1, correlationId=39) -- {group_id=console-consumer-43517,generation_id=1,member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,_tagged_fields={}},response:{throttle_time_ms=0,error_code=0,_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:0.879,requestQueueTime:0.118,localTime:0.623,remoteTime:0.0,throttleTime:0.088,responseQueueTime:0.046,sendTime:0.113,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:22,973] DEBUG Completed request:RequestHeader(apiKey=FETCH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=38) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=18,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:502.003,requestQueueTime:0.097,localTime:0.377,remoteTime:500.95,throttleTime:0.251,responseQueueTime:0.123,sendTime:0.203,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	## Console Consumer 종료
	[2020-11-21 14:42:23,258] DEBUG Completed request:RequestHeader(apiKey=LEAVE_GROUP, apiVersion=4, clientId=consumer-console-consumer-43517-1, correlationId=41) -- {group_id=console-consumer-43517,members=[{member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,_tagged_fields={}}],_tagged_fields={}},response:{throttle_time_ms=0,error_code=0,members=[{member_id=consumer-console-consumer-43517-1-c4a856c3-df56-4420-ad24-9a3857c14546,group_instance_id=null,error_code=0,_tagged_fields={}}],_tagged_fields={}} from connection 172.30.1.4:9092-172.30.1.4:50815-5;totalTime:8.206,requestQueueTime:0.221,localTime:7.845,remoteTime:0.0,throttleTime:0.306,responseQueueTime:0.04,sendTime:0.121,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)
	[2020-11-21 14:42:23,476] DEBUG Completed request:RequestHeader(apiKey=FETCxH, apiVersion=11, clientId=consumer-console-consumer-43517-1, correlationId=40) -- {replica_id=-1,max_wait_time=500,min_bytes=1,max_bytes=52428800,isolation_level=0,session_id=1349438060,session_epoch=19,topics=[],forgotten_topics_data=[],rack_id=},response:{throttle_time_ms=0,error_code=0,session_id=1349438060,responses=[]} from connection 172.30.1.4:9092-172.30.1.4:50814-5;totalTime:501.639,requestQueueTime:0.108,localTime:0.394,remoteTime:500.448,throttleTime:0.318,responseQueueTime:0.077,sendTime:0.292,securityProtocol:PLAINTEXT,principal:User:ANONYMOUS,listener:PLAINTEXT (kafka.request.logger)

view raw kafka-request-consume.log hosted with ❤ by GitHub

컨슈머가 연결되면서 JOIN_GROUP 과 SYNC_GROUP을 통해 컨슈머 그룹을 구성하는 것을 알 수 있다.
컨슈머가 연결되면 오프셋 정보를 가져오고(OFFST_FETCH, LIST_OFFSETS), 지속적인 메시지 FETCH 요청과 헬스 체크를 위해 HEARTBEAT 요청을 하는 것을 알 수 있다.
컨슈머가 종료되면 LEAVE_GROUP 요청을 통해 컨슈머 그룹을 이탈하고 FETCxH 요청으로 종료 되는 것을 알 수 있다.

마무리

위에서 살펴본 것처럼 간단한 로깅 레벨 변경으로 현재 브로커에 들어오고 있는 요청에 대해 더욱 자세히 알 수 있었습니다. 이는 가시성이 좋지 않은 카프카 운영 환경을 보완하기에 매우 좋은 요소입니다. 참고로 아직 저도 실제 운영 환경에 적용해보지는 못했지만 테스트해보며 고려하고 있습니다. 테스트 과정에서의 내용은 별도의 포스팅을 정리하도록 하겠습니다. 0

내 블로그 - 관리자 홈 전환	`Q` `Q`
새 글 쓰기	`W` `W`

글 수정 (권한 있는 경우)	`E` `E`
댓글 영역으로 이동	`C` `C`

이 페이지의 URL 복사	`S` `S`
맨 위로 이동	`T` `T`
티스토리 홈 이동	`H` `H`
단축키 안내	`Shift` + `/` `⇧` + `/`

인기포스트

ABOUT ME

언제나 김김 언제나 김김

들어가며

Request log 설정하기

Request log 내용 살펴보기

요청 별 로그

토픽 생성

메시지 프로듀싱

메시지 컨슈밍

마무리

티스토리툴바

단축키

내 블로그

블로그 게시글

모든 영역

인기포스트

ABOUT ME

들어가며

Request log 설정하기

Request log 내용 살펴보기

요청 별 로그

토픽 생성

메시지 프로듀싱

메시지 컨슈밍

마무리

관련글 관련글 더보기

티스토리툴바

단축키

내 블로그

블로그 게시글

모든 영역