主页 / server / 问题

问题[telegraf](server)

Martin Hope
JJandke
Asked: 2021-12-09 13:21:46 +0800 CST
  • 0

为了监控服务器，我们为 Grafana 导入了仪表板。这使用 Telegraf 和 InfluxDB 作为收集器和数据库。

当需要调整某些图表时，我注意到在网络速度查询中，接收到的字节（bytes_recv）乘以8，但图表本身的单位以位显示。

SELECT non_negative_derivative(mean(bytes_recv),1s)*8 as "in" FROM "net" WHERE host =~ /$server/ AND interface =~ /$netif/ AND $timeFilter GROUP BY time($interval), * fill(none)

根据我的理解是：8Bit = 1Byte。据此，如果数据以字节形式提供，则必须将其除以 8 才能获得位，如果图形应该显示位。

此外（如果我没记错的话）： 兆位 = Mb Mebibit = Mib 兆字节 = MB Mebibyte = MiB

参考这个，图上的单位好像是兆比特吧？我是否理解了根本上的错误，或者“*”是否与“/”混淆了？

Grafana 仪表板的屏幕截图

networking grafana network-speed telegraf
Martin Hope
LuckyFr
Asked: 2021-03-14 16:23:13 +0800 CST
  • 0

我有一个在 Ubuntu 20.04 上运行的虚拟机，我安装了 Telegraf、InfluxDB 和 Grafana 来监控虚拟机和集群的节点。

一切正常，除非我尝试让电报在后台工作。

手动启动正在工作的 Telegraf 的命令：

telegraf --config http://XXX.XX.X.X:8086/api/v2/telegrafs/XXXXXXXXXXX

返回我：

2021-03-14T00:02:27Z I! Starting Telegraf 1.17.3
2021-03-14T00:02:27Z I! Loaded inputs: cpu disk diskio mem net processes swap system
2021-03-14T00:02:27Z I! Loaded aggregators:
2021-03-14T00:02:27Z I! Loaded processors:
2021-03-14T00:02:27Z I! Loaded outputs: influxdb_v2
2021-03-14T00:02:27Z I! Tags enabled: host=XXXXX
2021-03-14T00:02:27Z I! [agent] Config: Interval:10s, Quiet:false, Hostname:"XXXXX", Flush Interval:10s

所以到目前为止一切都很好。

但无法运行此服务（/lib/systemd/system/telegraf.service）：

[Unit]
Description=The plugin-driven server agent for reporting metrics into InfluxDB
Documentation=https://github.com/influxdata/telegraf
After=network.target

[Service]
EnvironmentFile=-/etc/default/telegraf
User=telegraf
ExecStart=/usr/bin/telegraf -config /etc/telegraf/telegraf.conf -config-directory /etc/telegraf/telegraf.d $TELEGRAF_OP>
ExecReload=/bin/kill -HUP $MAINPID
Restart=on-failure
RestartForceExitStatus=SIGPIPE
KillMode=control-group

[Install]
WantedBy=multi-user.target

它开始很好，但在检查了服务状态后，我得到了：

14T00:10:46Z E! [agent] Error writing to outputs.influxdb: could not write any address
14T00:10:56Z W! [outputs.influxdb] Metric buffer overflow; 25 metrics have been dropped
14T00:10:56Z E! [outputs.influxdb] When writing to [http://XXX.XX.X.X:8086]: 401 Unauthorized
14T00:10:56Z E! [agent] Error writing to outputs.influxdb: could not write any address
14T00:11:06Z W! [outputs.influxdb] Metric buffer overflow; 25 metrics have been dropped
14T00:11:06Z E! [outputs.influxdb] When writing to [http://XXX.XX.X.X:8086]: 401 Unauthorized
14T00:11:06Z E! [agent] Error writing to outputs.influxdb: could not write any address
14T00:11:16Z W! [outputs.influxdb] Metric buffer overflow; 25 metrics have been dropped
14T00:11:16Z E! [outputs.influxdb] When writing to [http://XXX.XX.X.X:8086]: 401 Unauthorized
14T00:11:16Z E! [agent] Error writing to outputs.influxdb: could not write any address

InfluxDB 没有得到任何数据，所以 Grafana。

谁能帮我解决这个服务问题并让 Telegraf 在后台工作？

linux ubuntu monitoring grafana telegraf
Martin Hope
sarvesh.lad
Asked: 2020-12-08 07:09:58 +0800 CST
  • 0

如何通过拖尾包含 JSON 数据的文件将 json 数据提取到 influx 中？

例如：

我的日志是这样的：

2020-12-01T18:34:06+02:00 10.132.90.194 {"wfd_successful_hits_sec": "0", "sql_hits_sec_max": "0", "timestamp": "2020/12/01 18:34:01", "connection_sec_max": "1922", "http_hits_sec_max": "1106", "http_hits_sec": "106", "wfd_successful_hits_sec_max": "0", "sql_hits_sec": "0", "sql_audit_phase2_events_sec_max": "0", "hdfs_hits_sec": "0", "connection_sec": "26"}

有没有办法只提取 JSON 部分并将其发送给 influx？

我知道 grok 模式(\{.*\})$会提取 JSON 部分。

我的配置如下所示：

[global_tags]
[agent]
  interval = "10s"
  round_interval = true
  metric_batch_size = 1000
  metric_buffer_limit = 10000
  collection_jitter = "0s"
  flush_interval = "10s"
  flush_jitter = "0s"
  precision = ""
  hostname = ""
  omit_hostname = false
[[inputs.tail]]
  files = ["/opt/share/host*log"]
  data_format = "json"
[[outputs.influxdb_v2]]
  urls = ["http://localhost:8086"]
  token = "TOKEN"
  organization = "ORG"
  bucket = "performance_stats
json telegraf