主页 / server / 问题

问题[sensu](server)

Martin Hope
030
Asked: 2016-08-19 02:20:23 +0800 CST
  • 0

为了防止最新版本的插件破坏生产监控，应该可以安装特定版本：

试图

[user@host ~]$ sensu-install --help
Usage: sensu-install [options]
    -h, --help                       Display this message
    -v, --verbose                    Enable verbose logging
    -p, --plugin PLUGIN              Install a Sensu PLUGIN
    -P, --plugins PLUGIN[,PLUGIN]    PLUGIN or comma-delimited list of Sensu plugins to install
    -s, --source SOURCE              Install Sensu plugins from a custom SOURCE
sensu
Martin Hope
030
Asked: 2016-08-19 01:26:21 +0800 CST
  • 0
[user@host ~]$ sudo sensu-install -p ansible
[SENSU-INSTALL] installing Sensu plugins ...
[SENSU-INSTALL] determining if Sensu plugin gem 'sensu-plugins-ansible' is already installed ...
false
[SENSU-INSTALL] Sensu plugin gems to be installed: ["sensu-plugins-ansible"]
[SENSU-INSTALL] installing Sensu plugin gem 'sensu-plugins-ansible'
Fetching: sensu-plugins-ansible-0.0.4.gem (100%)
You can use the embedded Ruby by setting EMBEDDED_RUBY=true in /etc/default/sensu
Successfully installed sensu-plugins-ansible-0.0.4
1 gem installed
[SENSU-INSTALL] successfully installed Sensu plugins: ["ansible"]

ansible 插件似乎没有安装在 plugins 目录中。

[user@host ~]$ ls /etc/sensu/plugins
check-apache.rb

尝试解决问题

尝试一

[user@host ~]$ sudo -u sensu sensu-install -p ssl
[SENSU-INSTALL] installing Sensu plugins ...
[SENSU-INSTALL] determining if Sensu plugin gem 'sensu-plugins-ssl' is already installed ...
false
[SENSU-INSTALL] Sensu plugin gems to be installed: ["sensu-plugins-ssl"]
[SENSU-INSTALL] installing Sensu plugin gem 'sensu-plugins-ssl'
Fetching: unf_ext-0.0.7.2.gem (100%)
ERROR:  While executing gem ... (Errno::ENOENT)
    No such file or directory @ rb_sysopen - /opt/sensu/.gem/ruby/2.3.0/cache/unf_ext-0.0.7.2.gem
[SENSU-INSTALL] failed to install Sensu plugin gem 'sensu-plugins-ssl'
[SENSU-INSTALL] you can run the sensu-install command again with --verbose for more info
[SENSU-INSTALL] please take note of any failure messages above
[SENSU-INSTALL] make sure you have build tools installed (e.g. gcc)
[SENSU-INSTALL] trying to determine the Sensu plugin homepage for sensu-plugins-ssl ...
homepage: https://github.com/sensu-plugins/sensu-plugins-ssl

尝试二

遵循建议，即you can run the sensu-install command again with --verbose for more info先前的尝试导致：

[user@host ~]$ sudo sensu-install -p http --verbose
[SENSU-INSTALL] installing Sensu plugins ...
[SENSU-INSTALL] provided Sensu plugins: ["http"]
[SENSU-INSTALL] compiled Sensu plugin gems: ["sensu-plugins-http"]
[SENSU-INSTALL] determining if Sensu plugin gem 'sensu-plugins-http' is already installed ...
[SENSU-INSTALL] gem list -i sensu-plugins-http
false
[SENSU-INSTALL] Sensu plugin gem 'sensu-plugins-http' has not been installed
[SENSU-INSTALL] Sensu plugin gems to be installed: ["sensu-plugins-http"]
[SENSU-INSTALL] installing Sensu plugin gem 'sensu-plugins-http'
[SENSU-INSTALL] gem install sensu-plugins-http --no-ri --no-rdoc --verbose
HEAD https://api.rubygems.org/api/v1/dependencies
200 OK
...
/opt/sensu/embedded/bin/metrics-http-json-deep.rb
/opt/sensu/embedded/bin/check-http-json.rb
/opt/sensu/embedded/bin/metrics-curl.rb
/opt/sensu/embedded/bin/check-last-modified.rb
/opt/sensu/embedded/bin/check-https-cert.rb
/opt/sensu/embedded/bin/check-http-cors.rb
/opt/sensu/embedded/bin/check-head-redirect.rb
/opt/sensu/embedded/bin/metrics-http-json.rb
/opt/sensu/embedded/bin/check-http.rb
You can use the embedded Ruby by setting EMBEDDED_RUBY=true in /etc/default/sensu
Successfully installed sensu-plugins-http-1.0.0
13 gems installed
[SENSU-INSTALL] successfully installed Sensu plugins: ["http"]

插件已安装并且检查是可执行的：

[user@host ~]$ /opt/sensu/embedded/bin/check-http.rb
CheckHttp UNKNOWN: No URL specified
sensu
Martin Hope
030
Asked: 2016-08-17 15:27:39 +0800 CST
  • 0

大约需要 15 分钟，Sensu 发送的指标才会出现在 Graphite 中。

问题

  • 为什么需要 15 分钟？
  • 是否有可能加快这一进程？

讨论

虽然已配置保留 1 分钟：

/opt/graphite/conf/storage-schemas.conf

[carbon]
pattern = ^carbon\.
retentions = 60:90d

[default_1min_for_1day]
pattern = .*
retentions = 60s:1d

以及 sensu 客户端：

/var/log/sensu/sensu-client.log

{"timestamp":"2016-08-16T23:17:54.131805+0000","level":"info","message":
"publishing check result","payload":{"client":"rhel","check":{"type":"metric",
"command":"/etc/sensu/plugins/metrics-memory-percent.rb","handlers":["relay"],
"name":"load_metrics3","issued":1471389473,"interval":10,"subscribers":["ALL"],
"executed":1471389473,"duration":0.226,
"output":"box01-ubuntu.memory_percent.free 3.6590918167658453
1471389474\nbox01-ubuntu.memory_percent.buffers 0.0 1471389474\nbox01-ubuntu.memory_percent.cached 22.651064339630178 1471389474\n
box01-ubuntu.memory_percent.dirty 0.01837134070849475 1471389474\n
box01-ubuntu.memory_percent.swapUsed 7.438716420871131 1471389474\
nbox01-ubuntu.memory_percent.usedWOBuffersCaches 73.68984384360398 1471389474\nbox01-ubuntu.memory_percent.freeWOBuffersCaches 26.310156156396022 1471389474\n","status":0}}}

作为石墨日志活动：

/opt/graphite/storage/log/carbon-cache/carbon-cache-a/creates.log

16/08/2016 23:14:29 :: new metric box01-ubuntu.memory_percent.freeWOBuffersCaches 
matched schema default_1min_for_1day

图表在 15 分钟后出现。

graphite sensu
Martin Hope
030
Asked: 2016-08-08 16:52:10 +0800 CST
  • 0

这个 Ansible 角色已经被创建，并且这个 .travis.yml被用作一个例子来测试这个角色。除 sensu-client 外，所有服务都可以启动。

尝试解决问题

为了解决这个问题，在 travis 中添加了一个调试步骤。构建完成后抛出以下错误：

The command "sudo docker exec "$(cat ${container_id})" ansible-playbook /etc/ansible/roles/role_under_test/tests/test-${SITE}.yml | grep -q 'changed=0.*failed=0' && (echo 'Idempotence test: pass' && exit 0) || (echo 'Idempotence test: fail' && exit 1)

" exited with 1.

0.07s$ sudo docker exec --tty "$(cat ${container_id})" env TERM=xterm sudo systemctl status sensu-client.service -l

● sensu-client.service - LSB: Sensu monitoring framework client

   Loaded: loaded (/etc/rc.d/init.d/sensu-client)

   Active: failed (Result: exit-code) since Mon 2016-08-08 00:18:20 UTC; 131ms ago

     Docs: man:systemd-sysv-generator(8)

  Process: 1534 ExecStart=/etc/rc.d/init.d/sensu-client start (code=exited, status=1/FAILURE)

Aug 08 00:18:19 c6354976113c systemd[1]: Starting LSB: Sensu monitoring framework client...

Aug 08 00:18:19 c6354976113c sensu-client[1534]: /etc/init.d/sensu-service: line 71: /etc/init.d/functions: No such file or directory

Aug 08 00:18:19 c6354976113c sensu-client[1534]: Starting sensu-client/etc/init.d/sensu-service: line 79: daemon: command not found

Aug 08 00:18:20 c6354976113c sensu-client[1534]: /etc/init.d/sensu-service: line 88: echo_failure: command not found

Aug 08 00:18:20 c6354976113c systemd[1]: sensu-client.service: control process exited, code=exited status=1

Aug 08 00:18:20 c6354976113c systemd[1]: Failed to start LSB: Sensu monitoring framework client.

Aug 08 00:18:20 c6354976113c systemd[1]: Unit sensu-client.service entered failed state.

Aug 08 00:18:20 c6354976113c systemd[1]: sensu-client.service failed.

当 ansible 角色部署在远程系统上时，sensu-client 启动，但它在 Travis 上失败，尽管其他服务能够启动。

systemd sensu travis-ci
Martin Hope
030
Asked: 2016-07-04 15:26:46 +0800 CST
  • 4

这篇文章与使用 YUM 安装 Sensu相结合，用于安装、配置和启动 Sensu 及相关服务：

sudo yum install -y erlang && \
sudo rpm -Uvh http://www.rabbitmq.com/releases/rabbitmq-server/v3.5.0/rabbitmq-server-3.5.0-1.noarch.rpm && \
sudo yum install -y redis && \
echo '[sensu]
name=sensu
baseurl=http://sensu.global.ssl.fastly.net/yum/$basearch/
gpgcheck=0
enabled=1' | sudo tee /etc/yum.repos.d/sensu.repo && \
sudo yum install -y sensu && \
sudo yum install -y uchiwa && \
for s in rabbitmq-server redis.service sensu-server sensu-api uchiwa; do sudo systemctl restart $s; done && \
sudo rabbitmqctl add_vhost /sensu && \
sudo rabbitmqctl add_user sensu secret && \
sudo rabbitmqctl set_permissions -p /sensu sensu ".*" ".*" ".*"

分析

  • 导航到 :3000 显示 uchiwa 仪表板并指示Connection error. Is the Sensu API running?
  • /var/log/sensu/sensu-api.log 表示
{"timestamp":"2016-07-03T22:58:58.532905+0000","level":"warn","message":"config file does not exist or is not readable","file":"/etc/sensu/config.json"}
{"timestamp":"2016-07-03T22:58:58.533069+0000","level":"warn","message":"ignoring config file","file":"/etc/sensu/config.json"}
{"timestamp":"2016-07-03T22:58:58.533137+0000","level":"warn","message":"loading config files from directory","directory":"/etc/sensu/conf.d"}
{"timestamp":"2016-07-03T22:58:58.712175+0000","level":"info","message":"api listening","protocol":"http","bind":"0.0.0.0","port":4567}
  • config.json 似乎不存在（/etc/sensu/config.json: No such file or directory）
  • 下载示例 config.json并重新启动 sensu-api 并没有解决问题
{
  "rabbitmq": {
    "host": "localhost",
    "vhost": "/sensu",
    "user": "sensu",
    "password": "secret"
  },
  "redis": {
    "host": "localhost",
    "port": 6379,
    "password": "secret"
  }
}
  • redis端口正在监听：
LISTEN     0      128    127.0.0.1:6379                     *:*
  • rabbitmq 端口：
LISTEN     0      100          *:4567                     *:*
  • Uchiwa 无法连接到数据中心
{
  "sensu": [
    {
      "name": "Site 1",
      "host": "localhost",
      "port": 4567,
      "timeout": 10
    },
    {
      "name": "Site 2",
      "host": "localhost",
      "port": 4567,
      "ssl": false,
      "path": "",
      "user": "",
      "pass": "",
      "timeout": 10
    }
  ],
  "uchiwa": {
    "host": "0.0.0.0",
    "port": 3000,
    "refresh": 10
  }
}

{"timestamp":"2016-07-03T23:34:32.990067621Z","level":"warn","message":"GET http://localhost:4567/stashes returned: 500 Internal Server Error"}
{"timestamp":"2016-07-03T23:34:32.990102095Z","level":"warn","message":"Connection failed to the datacenter Site 1"}
{"timestamp":"2016-07-03T23:34:32.990115588Z","level":"info","message":"Updating the datacenter Site 2"}
{"timestamp":"2016-07-03T23:34:32.991462585Z","level":"warn","message":"GET http://localhost:4567/stashes returned: 500 Internal Server Error"}
{"timestamp":"2016-07-03T23:34:32.991492978Z","level":"warn","message":"Connection failed to the datacenter Site 2"}
  • 导航到<IPADDRESS>:4567结果：
{"error":"redis and transport connections not initialized"}
  • redis 回复
sudo redis-cli ping
PONG
  • redis密码已设置，但问题仍然存在
sudo redis-cli
127.0.0.1:6379> auth secret
OK
centos7 redis rabbitmq sensu uchiwa
Martin Hope
Mikhail T.
Asked: 2016-05-27 19:04:54 +0800 CST
  • 0

我们正在评估监控系统，其中 Sensu 是候选者之一。我们的一项要求是处理 SNMP 陷阱。

我的搜索仅提供 Sensu 扩展，但这些扩展来自第三方，甚至无法通过gem.

Sensu 能否处理 SNMP 陷阱——开箱即用或使用通用且免费的扩展程序？

snmp sensu system-monitoring
Martin Hope
nulltek
Asked: 2015-07-24 09:50:07 +0800 CST
  • 7

我安装了最新的 sensu-core，并使用综合包安装了 sensu-plugin gem。

Sensu 启动并运行没有问题，但我遇到了处理程序的主要问题。我已经设置了来自社区插件的标准 ruby​​ mailer.rb 以及 pagerduty 处理程序。

当我将处理程序添加到我知道在日志中失败的检查中时，我看到：

{\"id\":\"a1e807d2-425f-4891-b291-ed5bda5b6105\",\"client\":{\"name\":\"mfp\",\"address\":\"25.147.26.157\",\"subscriptions\":[\"test\"],\"version\":\"0.20.0\",\"timestamp\":1437673191},\"check\":{\"command\":\"/etc/sensu/plugins/check-disk.sh -d /dev/md1 -w 80 -c 90\",\"interval\":10,\"handlers\":[\"default\",\"pagerduty\",\"mailer\"],\"occurrences\":3,\"subscribers\":[\"test\"],\"name\":\"disk\",\"issued\":1437673279,\"executed\":1437673201,\"duration\":0.01,\"output\":\"CRITICAL - /dev/md1 space used=94% | '/dev/md1 usage'=94%;80;90;\\n\",\"status\":2,\"history\":[\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\",\"2\"],\"total_state_change\":0},\"occurrences\":513,\"action\":\"create\"}"]}
{"timestamp":"2015-07-23T12:41:20.873279-0500","level":"info","message":"handler output","handler":{"type":"pipe","command":"/etc/sensu/handlers/pagerduty.rb","api_key":"2e24c101ef754ff6add39aaaffa846c9","name":"pagerduty"},"output":["only handling every 180 occurrences: ws/disk\n"]}
{"timestamp":"2015-07-23T12:41:20.873561-0500","level":"info","message":"handler output","handler":{"type":"pipe","command":"/etc/sensu/handlers/pagerduty.rb","api_key":"2e24c101ef754ff6add39aaaffa846c9","name":"pagerduty"},"output":["only handling every 180 occurrences: wwv/disk\n"]}
{"timestamp":"2015-07-23T12:41:21.055407-0500","level":"info","message":"handler output","handler":{"type":"pipe","command":"/etc/sensu/handlers/pagerduty.rb","api_key":"2e24c101ef754ff6add39aaaffa846c9","name":"pagerduty"},"output":["only handling every 180 occurrences: mfp/disk\n"]}

所以看起来处理程序正在触发，但被 sensu-handler.rb gem 过滤，而不是创建电子邮件或 pagerduty 事件。

这是违规行

only handling every 180 occurrences

有谁知道问题是什么？这是一个错误吗？我需要覆盖一些东西吗？对于这个特定的检查（check_disk），我有大量的感觉，所以它应该被触发到 pagerduty 和邮件程序。

sensu
Martin Hope
Mike
Asked: 2014-10-22 08:39:24 +0800 CST
  • 6

我创建了一个测试检查，现在我想删除它。它似乎并没有远离客户。我使用 uchima 作为前端，支票不再列在

/检查

但是，如果我查看客户，它仍然有支票。

我发现删除检查的唯一方法是删除节点并让它重新添加自己。我有 300 个客户，我不想那样做。

sensu