1
resposta

Kafka não inicia

O zookeeper starta normalmente, segue registro do log.

[2021-12-09 09:08:26,015] INFO zookeeper.snapshotSizeFactor = 0.33 (org.apache.zookeeper.server.ZKDatabase)
[2021-12-09 09:08:26,015] INFO zookeeper.commitLogCount=500 (org.apache.zookeeper.server.ZKDatabase)
[2021-12-09 09:08:26,024] INFO zookeeper.snapshot.compression.method = CHECKED (org.apache.zookeeper.server.persistence.SnapStream)
[2021-12-09 09:08:26,024] INFO Snapshotting: 0x0 to \tmp\zookeeper\version-2\snapshot.0 (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2021-12-09 09:08:26,028] INFO Snapshot loaded in 13 ms, highest zxid is 0x0, digest is 1371985504 (org.apache.zookeeper.server.ZKDatabase)
[2021-12-09 09:08:26,028] INFO Snapshotting: 0x0 to \tmp\zookeeper\version-2\snapshot.0 (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
[2021-12-09 09:08:26,029] INFO Snapshot taken in 1 ms (org.apache.zookeeper.server.ZooKeeperServer)
[2021-12-09 09:08:26,037] INFO PrepRequestProcessor (sid:0) started, reconfigEnabled=false (org.apache.zookeeper.server.PrepRequestProcessor)
[2021-12-09 09:08:26,038] INFO zookeeper.request_throttler.shutdownTimeout = 10000 (org.apache.zookeeper.server.RequestThrottler)
[2021-12-09 09:08:26,050] INFO Using checkIntervalMs=60000 maxPerMinute=10000 maxNeverUsedIntervalMs=0 (org.apache.zookeeper.server.ContainerManager)
[2021-12-09 09:08:26,050] INFO ZooKeeper audit is disabled. (org.apache.zookeeper.audit.ZKAuditProvider)

Quando tento rodar o kafka_2.12 ocorre erro na pasta log.

[2021-12-09 09:10:07,374] INFO [ThrottledChannelReaper-Fetch]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
INFO [ThrottledChannelReaper-Produce]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
INFO [ThrottledChannelReaper-Request]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
INFO [ThrottledChannelReaper-ControllerMutation]: Starting (kafka.server.ClientQuotaManager$ThrottledChannelReaper)
INFO Log directory E:\tmp\kafka-logs not found, creating it. (kafka.log.LogManager)
ERROR Failed to create or validate data directory E:\tmp\kafka-logs (kafka.server.LogDirFailureChannel)
java.nio.file.AccessDeniedException: E:\tmp
        at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:89)
        at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103)
        at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:108)
        at java.base/sun.nio.fs.WindowsFileSystemProvider.newFileChannel(WindowsFileSystemProvider.java:120)
        at java.base/java.nio.channels.FileChannel.open(FileChannel.java:292)
        at java.base/java.nio.channels.FileChannel.open(FileChannel.java:345)
        at org.apache.kafka.common.utils.Utils.flushDir(Utils.java:953)
        at kafka.log.LogManager.<init>(LogManager.scala:88)
        at kafka.log.LogManager$.apply(LogManager.scala:1283)
        at kafka.server.KafkaServer.startup(KafkaServer.scala:254)
        at kafka.Kafka$.main(Kafka.scala:109)
        at kafka.Kafka.main(Kafka.scala)
[2021-12-09 09:10:07,395] ERROR Shutdown broker because none of the specified log dirs from E:\tmp\kafka-logs can be created or validated (kafka.log.LogManager)

E depois aparece o seguinte erro no log do zookeeper.

2021-12-09 09:08:26,050] INFO ZooKeeper audit is disabled. (org.apache.zookeeper.audit.ZKAuditProvider)
[2021-12-09 09:10:07,055] INFO Creating new log file: log.1 (org.apache.zookeeper.server.persistence.FileTxnLog)
[2021-12-09 09:10:07,911] WARN Close of session 0x10000068ec00000 (org.apache.zookeeper.server.NIOServerCnxn)
java.io.IOException: Foi for▒ado o cancelamento de uma conex▒o existente pelo host remoto
        at java.base/sun.nio.ch.SocketDispatcher.read0(Native Method)
        at java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43)
        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
        at java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:358)
        at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:324)
        at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522)
        at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:834)
[2021-12-09 09:10:28,271] INFO Expiring session 0x10000068ec00000, timeout of 18000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
1 resposta

Oi, Allan! Tudo bem?

Parece que você não tem acesso na pasta /tmp (que está mapeando para E:\tmp no seu Windows). Dentro da pasta do Kafka, tente alterar a linha log.dirs=... do arquivo config/server.properties para log.dirs={DIRETORIO_DO_SEU_USUARIO}/data/kafka-logs e a linha dataDir=... do arquivo config/zookeeper.properties para dataDir={DIRETORIO_DO_SEU_USUARIO}/data/zookeeper.

Durante o curso, o Guilherme vai explicar melhor o que esses parâmetros são.