博客

spark kafka Topic not present in metadata after 60000 ms

  • Post author:
  • Post category:其他


structstured streaming 结合kafka

问题出在kafka加了kerberos认证在将数据写入kafka时需要加.option(“kafka.security.protocol”, “SASL_PLAINTEXT”) 

spark.readStream.format("kafka")
      .option("kafka.bootstrap.servers", "")
      .option("subscribe", "")
      .option("startingOffsets", "latest")
      .option("failOnDataLoss",false)
      .option("kafka.security.protocol", "SASL_PLAINTEXT")
      .load()


版权声明：本文为yidan7063原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。