例如,我有 3 台计算服务器,我想在每台服务器上都有 1 个特定实例,并且我想在它们上拥有节点关联性。
- instance_1 --> compute_node_1(总是在这个节点上)
- instance_2 --> compute_node_2(总是在这个节点上)
- instance_3 --> compute_node_3(总是在这个节点上)
我知道有一个“森林”服务。但是具体如何使用呢?或者如果有其他解决方案?
例如,我有 3 台计算服务器,我想在每台服务器上都有 1 个特定实例,并且我想在它们上拥有节点关联性。
我知道有一个“森林”服务。但是具体如何使用呢?或者如果有其他解决方案?
在 Openstack 中,是否可以创建没有硬盘驱动器的计算节点并使用 PXE 来启动主机系统,从而启动没有本地驱动器的实例来启动 VM 的映像。
如果不是,为了获得功能齐全的系统,需要为主机提供的最小存储空间是多少。
我使用OpenStack 安装指南安装了 Openstack Wallaby ,所有命令和配置都在我的Github上。这个 LAB 在 VirtualBox 上运行,我在 ESXi 上有另一个具有相同配置和 Openstack 版本的 LAB,没有任何问题。
此时一个控制器带有两个计算节点。
数据库已正确创建:
user@controller001:~$ sudo mysql
MariaDB [(none)]> SHOW DATABASES;
+--------------------+
| Database |
+--------------------+
| glance |
| information_schema |
| keystone |
| mysql |
| nova |
| nova_api |
| nova_cell0 |
| performance_schema |
| placement |
+--------------------+
授予这些数据库的所有权限:
MariaDB [(none)]> SHOW GRANTS FOR nova;
+-----------------------------------------------------------------------------------------------------+
| Grants for nova@% |
+-----------------------------------------------------------------------------------------------------+
| GRANT USAGE ON *.* TO `nova`@`%` IDENTIFIED BY PASSWORD '*3A4A03AC22526F6B591010973A741D59A71D728E' |
| GRANT ALL PRIVILEGES ON `nova`.* TO `nova`@`%` |
| GRANT ALL PRIVILEGES ON `nova_cell0`.* TO `nova`@`%` |
| GRANT ALL PRIVILEGES ON `nova_api`.* TO `nova`@`%` |
+-----------------------------------------------------------------------------------------------------+
可以从计算节点远程访问数据库:
user@compute001:~$ mysql -unova -popenstack -h controller001
MariaDB [(none)]> show databases;
+--------------------+
| Database |
+--------------------+
| information_schema |
| nova |
| nova_api |
| nova_cell0 |
+--------------------+
user@controller001:~$ sudo systemctl restart nova-*
user@controller001:~$ sudo tail -f /var/log/mysql/error.log
2021-10-02 12:52:12 112 [Warning] Aborted connection 112 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 118 [Warning] Aborted connection 118 to db: 'nova_api' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 116 [Warning] Aborted connection 116 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 119 [Warning] Aborted connection 119 to db: 'nova_api' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 115 [Warning] Aborted connection 115 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 113 [Warning] Aborted connection 113 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 114 [Warning] Aborted connection 114 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 117 [Warning] Aborted connection 117 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 109 [Warning] Aborted connection 109 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 110 [Warning] Aborted connection 110 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 111 [Warning] Aborted connection 111 to db: 'nova' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 108 [Warning] Aborted connection 108 to db: 'nova_cell0' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 103 [Warning] Aborted connection 103 to db: 'nova_api' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 102 [Warning] Aborted connection 102 to db: 'nova_api' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:12 105 [Warning] Aborted connection 105 to db: 'nova_cell0' user: 'nova' host: 'controller001' (Got an error reading communication packets)
2021-10-02 12:52:16 141 [Warning] Access denied for user 'nova'@'controller001' (using password: YES)
2021-10-02 12:52:16 142 [Warning] Access denied for user 'nova'@'controller001' (using password: YES)
2021-10-02 12:52:17 147 [Warning] Access denied for user 'nova'@'controller001' (using password: YES)
以下是解决此错误的一些建议:
SET GLOBAL max_allowed_packet = 1024 * 1024 * 256;
set @@global.max_connections = 400;
SET GLOBAL interactive_timeout=6000;
SET GLOBAL innodb_buffer_pool_size = 1024 * 1024 * 2;
user@controller001:~$ sudo su -s /bin/sh -c "nova-manage cell_v2 discover_hosts --verbose" nova
....
sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1045, "Access denied for user 'nova'@'controller001' (using password: YES)")
(Background on this error at: http://sqlalche.me/e/13/e3q8)
user@controller001:~$ os hypervisor list
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'sqlalchemy.exc.OperationalError'> (HTTP 500) (Request-ID: req-d6edcfa3-ccf2-4eb8-80f8-041cb55e772d)
user@controller001:~$ . admin-openrc
user@controller001:~$ os endpoint list
+----------------------------------+-----------+--------------+--------------+---------+-----------+--------------------------------+
| ID | Region | Service Name | Service Type | Enabled | Interface | URL |
+----------------------------------+-----------+--------------+--------------+---------+-----------+--------------------------------+
| 1e2f0fc829f84a53a337bbb70e7679af | RegionOne | nova | compute | True | internal | http://controller001:8774/v2.1 |
| 38e967a4c87f4464ba6ac965c889f6a4 | RegionOne | placement | placement | True | admin | http://controller001:8778 |
| 398d51ab439f4afc8fb7c71adc1bf3a9 | RegionOne | keystone | identity | True | internal | http://controller001:5000/v3/ |
| 4aaf9ac0ccec41978e541a0de0e55ed4 | RegionOne | nova | compute | True | public | http://controller001:8774/v2.1 |
| 52ba2047ed864b9aa6ad352ba2fe59dc | RegionOne | nova | compute | True | admin | http://controller001:8774/v2.1 |
| 659ed7ae84074b30a6a4941648b994c3 | RegionOne | placement | placement | True | internal | http://controller001:8778 |
| 9cd126c1f07e4b13946edcdc80f9f215 | RegionOne | placement | placement | True | public | http://controller001:8778 |
| aec5b18b834b4a9cad8a4efb83b1b1d7 | RegionOne | glance | image | True | internal | http://controller001:9292 |
| b1a13f51438c40b8b74ec25b89efebab | RegionOne | glance | image | True | public | http://controller001:9292 |
| c35c703090f3478aa7d960293fde1bf0 | RegionOne | keystone | identity | True | admin | http://controller001:5000/v3/ |
| ca231e48c3ad406c8ec757c765b651a6 | RegionOne | glance | image | True | admin | http://controller001:9292 |
| ff927678f6634475bd80bdba7effc3fc | RegionOne | keystone | identity | True | public | http://controller001:5000/v3/ |
+----------------------------------+-----------+--------------+--------------+---------+-----------+--------------------------------+
user@controller001:~$ sudo su -s /bin/sh -c "nova-manage cell_v2 list_cells" nova
+-------+--------------------------------------+---------------------------------------------+----------------------------------------------------+----------+
| Name | UUID | Transport URL | Database Connection | Disabled |
+-------+--------------------------------------+---------------------------------------------+----------------------------------------------------+----------+
| cell0 | 00000000-0000-0000-0000-000000000000 | none:/ | mysql+pymysql://nova:****@controller001/nova_cell0 | False |
| cell1 | e62ffdc8-5f28-43ef-9bcb-404812faaeae | rabbit://openstack:****@controller001:5672/ | mysql+pymysql://nova:****@controller001/nova | False |
+-------+--------------------------------------+---------------------------------------------+----------------------------------------------------+----------+
user@controller001:~$ cat /etc/hosts
127.0.0.1 localhost
127.0.1.1 controller001
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
172.16.50.41 controller001
172.16.50.42 compute011
我正在构建一个 openstack 集群,并且遇到了一些我认为可能是配额问题的问题。我可以在每台主机上成功构建虚拟机,但每台主机只有一个虚拟机。
我使用 puppet 部署了系统。当前部署的 openstack 版本是 Ussuri。使用的 openstack puppet 模块是 17.4,除了使用 13.4 的 puppet-vswitch
每个计算主机(管理程序)有 64 个内核和 512GB 的 RAM。即使我启动了一个 2 核 vm,我也无法在该虚拟机管理程序上再启动,并且我在日志中收到以下错误:
调度程序日志:
"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Unable to allocate inventory: Unable to create allocation for 'VCPU' on resource provider
nova-conductor.log
2021-05-24 15:31:21.770 31421 ERROR nova.conductor.manager [req-18e93e25-5cc2-43b6-a036-312ed064070b 9f72d8a0694146288eb09ac7fee38298 7016985dddfe4048b535ca7ff12a0c68 - default default] Failed to schedule instances: nova.exception_Remote.NoValidHost_Remote: No valid host was found. There are not enough hosts available.
我已经检查并重新检查了该项目的配额,并且实例数设置为 10000,所以我不确定我缺少什么:
| 固定IP | 10000
| 浮动_ips | 无
| 健康监视器 | 无
| 注入文件大小 | 10240
| 注入文件 | 5
| 注入路径大小 | 255
| 实例 | 10000
| 密钥对 | 100 | 项目名称 | 管理员
| 属性 | 128
| 公羊 | 99999999
我不太确定我还能检查什么,并且从我所做的搜索来看,似乎没有其他人遇到过这样的事情,所以我希望我缺少一个简单的设置。
编辑 5-26-21:我进行了更多测试,发现了一个有趣的模式。
如果我在计算主机上放置一台 1 核机器(风格 m1.nano),我可以构建任意数量的虚拟机,任何我想要的风格,直到机器物理运行资源。
如果我创建了大于 1 核 vm 的任何东西,并且该 vm 是在还没有 1 核 vm 的计算主机上启动的,那么在放置一台机器后,在该主机上构建的任何其他 vm 都会失败。
除了告诉我它在失败时无法分配 vcpus 之外,日志没有任何帮助。
编辑添加部署方法和 openstack 版本。
提前致谢!-杰夫
我在以下问题上遇到了困难:“将 Openstack 控制服务(如 Neurtron/Cinder/Glance/Keystone 服务器服务(neutron-API 等)和 Nova-api 等 nova 控制服务(除了nova-compute)? 我对 Openstack Kolla 项目进行了研究,但它无法帮助我吸收其背后的想法。
任何帮助,将不胜感激。问候
如何更新flavor
实例image
?这个api是不可能的。
作为另一个问题,我如何更新ram
,disk
和vcpu
风味?
我可以使用name
而不是id
openstack apishow instance
吗?当我发送server name
网址时,我得到了404
. 有没有办法通过id
它来获取实例的name
?
我正在从http://docs.openstack.org/newton/install-guide-rdo/设置示例架构
我在启动实例章节
当我启动实例时,我在实例信息中收到以下错误消息:
Build of instance bcaa06fe-99ca-4db7-baf3-633f21b16f61 aborted: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='control
当我查看 /var/log/nova/nova-compute.log 中计算节点上的日志时,我注意到以下两条错误消息:
我该如何调试和解决这个问题?
/var/log/nova/nova-compute.log
2017-01-02 02:36:03.290 2309 ERROR nova.compute.manager [req-2224a009-1cf2-4b84-b654-05c79d688b7b cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] Instance failed network setup after 1 attempt(s)
2017-01-02 02:36:03.290 2309 ERROR nova.compute.manager ConnectFailure: Unable to establish connection to http://127.0.0.1:9696/v2.0/networks.json?id=b4fb8e4a-cbbc-43e8-9e80-4abede8e4d56: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/networks.json?id=b4fb8e4a-cbbc-43e8-9e80-4abede8e4d56 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x6608f90>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 02:36:03.290 2309 ERROR nova.compute.manager
2017-01-02 02:36:03.535 2309 ERROR nova.image.glance [req-2224a009-1cf2-4b84-b654-05c79d688b7b cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] Error contacting glance server 'http://controller:9292' for 'data', done trying.
2017-01-02 02:36:03.535 2309 ERROR nova.image.glance CommunicationError: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x86fba90>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:36:03.535 2309 ERROR nova.image.glance
2017-01-02 02:36:03.561 2309 ERROR nova.compute.manager [req-2224a009-1cf2-4b84-b654-05c79d688b7b cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: c854d552-037c-4e84-a953-9610b6a6670d] Instance failed to spawn
2017-01-02 02:36:03.561 2309 ERROR nova.compute.manager [instance: c854d552-037c-4e84-a953-9610b6a6670d] GlanceConnectionFailed: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x86fba90>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:36:03.561 2309 ERROR nova.compute.manager [instance: c854d552-037c-4e84-a953-9610b6a6670d]
2017-01-02 02:36:03.678 2309 ERROR nova.compute.manager [req-2224a009-1cf2-4b84-b654-05c79d688b7b cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: c854d552-037c-4e84-a953-9610b6a6670d] Failed to deallocate network for instance. Error: Unable to establish connection to http://127.0.0.1:9696/v2.0/ports.json?device_id=c854d552-037c-4e84-a953-9610b6a6670d: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/ports.json?device_id=c854d552-037c-4e84-a953-9610b6a6670d (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x875bed0>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 02:36:03.846 2309 ERROR nova.compute.manager [req-2224a009-1cf2-4b84-b654-05c79d688b7b cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: c854d552-037c-4e84-a953-9610b6a6670d] Build of instance c854d552-037c-4e84-a953-9610b6a6670d aborted: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x86fba90>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:36:03.846 2309 ERROR nova.compute.manager [instance: c854d552-037c-4e84-a953-9610b6a6670d] BuildAbortException: Build of instance c854d552-037c-4e84-a953-9610b6a6670d aborted: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x86fba90>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:36:03.846 2309 ERROR nova.compute.manager [instance: c854d552-037c-4e84-a953-9610b6a6670d]
2017-01-02 02:36:03.872 2309 ERROR nova.compute.manager [req-2224a009-1cf2-4b84-b654-05c79d688b7b cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: c854d552-037c-4e84-a953-9610b6a6670d] Failed to deallocate networks
2017-01-02 02:36:03.872 2309 ERROR nova.compute.manager [instance: c854d552-037c-4e84-a953-9610b6a6670d] ConnectFailure: Unable to establish connection to http://127.0.0.1:9696/v2.0/ports.json?device_id=c854d552-037c-4e84-a953-9610b6a6670d: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/ports.json?device_id=c854d552-037c-4e84-a953-9610b6a6670d (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x8772d90>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 02:36:03.872 2309 ERROR nova.compute.manager [instance: c854d552-037c-4e84-a953-9610b6a6670d]
2017-01-02 02:48:49.652 2309 ERROR nova.compute.manager [req-dfd82484-3bfd-4bc7-92eb-029ee52bf579 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] Instance failed network setup after 1 attempt(s)
2017-01-02 02:48:49.652 2309 ERROR nova.compute.manager ConnectFailure: Unable to establish connection to http://127.0.0.1:9696/v2.0/networks.json?id=b4fb8e4a-cbbc-43e8-9e80-4abede8e4d56: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/networks.json?id=b4fb8e4a-cbbc-43e8-9e80-4abede8e4d56 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x662f510>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 02:48:49.652 2309 ERROR nova.compute.manager
2017-01-02 02:48:49.807 2309 ERROR nova.image.glance [req-dfd82484-3bfd-4bc7-92eb-029ee52bf579 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] Error contacting glance server 'http://controller:9292' for 'data', done trying.
2017-01-02 02:48:49.807 2309 ERROR nova.image.glance CommunicationError: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x87dec50>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:48:49.807 2309 ERROR nova.image.glance
2017-01-02 02:48:49.807 2309 ERROR nova.compute.manager [req-dfd82484-3bfd-4bc7-92eb-029ee52bf579 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91] Instance failed to spawn
2017-01-02 02:48:49.807 2309 ERROR nova.compute.manager [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91] GlanceConnectionFailed: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x87dec50>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:48:49.807 2309 ERROR nova.compute.manager [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91]
2017-01-02 02:48:49.896 2309 ERROR nova.compute.manager [req-dfd82484-3bfd-4bc7-92eb-029ee52bf579 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91] Failed to deallocate network for instance. Error: Unable to establish connection to http://127.0.0.1:9696/v2.0/ports.json?device_id=79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/ports.json?device_id=79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x87de550>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 02:48:50.064 2309 ERROR nova.compute.manager [req-dfd82484-3bfd-4bc7-92eb-029ee52bf579 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91] Build of instance 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91 aborted: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x87dec50>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:48:50.064 2309 ERROR nova.compute.manager [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91] BuildAbortException: Build of instance 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91 aborted: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x87dec50>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 02:48:50.064 2309 ERROR nova.compute.manager [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91]
2017-01-02 02:48:50.066 2309 ERROR nova.compute.manager [req-dfd82484-3bfd-4bc7-92eb-029ee52bf579 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91] Failed to deallocate networks
2017-01-02 02:48:50.066 2309 ERROR nova.compute.manager [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91] ConnectFailure: Unable to establish connection to http://127.0.0.1:9696/v2.0/ports.json?device_id=79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/ports.json?device_id=79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x87e25d0>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 02:48:50.066 2309 ERROR nova.compute.manager [instance: 79a943ae-7c5f-44a9-a5c9-c7f68c6f8b91]
2017-01-02 04:46:25.063 2309 ERROR nova.compute.manager [req-3b4a7b20-fa9f-4f59-ab90-3d914395add4 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] Instance failed network setup after 1 attempt(s)
2017-01-02 04:46:25.063 2309 ERROR nova.compute.manager ConnectFailure: Unable to establish connection to http://127.0.0.1:9696/v2.0/networks.json?id=b4fb8e4a-cbbc-43e8-9e80-4abede8e4d56: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/networks.json?id=b4fb8e4a-cbbc-43e8-9e80-4abede8e4d56 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x88a34d0>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 04:46:25.063 2309 ERROR nova.compute.manager
2017-01-02 04:46:25.227 2309 ERROR nova.image.glance [req-3b4a7b20-fa9f-4f59-ab90-3d914395add4 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] Error contacting glance server 'http://controller:9292' for 'data', done trying.
2017-01-02 04:46:25.227 2309 ERROR nova.image.glance CommunicationError: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x8772190>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 04:46:25.227 2309 ERROR nova.image.glance
2017-01-02 04:46:25.228 2309 ERROR nova.compute.manager [req-3b4a7b20-fa9f-4f59-ab90-3d914395add4 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61] Instance failed to spawn
2017-01-02 04:46:25.228 2309 ERROR nova.compute.manager [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61] GlanceConnectionFailed: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x8772190>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 04:46:25.228 2309 ERROR nova.compute.manager [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61]
2017-01-02 04:46:25.330 2309 ERROR nova.compute.manager [req-3b4a7b20-fa9f-4f59-ab90-3d914395add4 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61] Failed to deallocate network for instance. Error: Unable to establish connection to http://127.0.0.1:9696/v2.0/ports.json?device_id=bcaa06fe-99ca-4db7-baf3-633f21b16f61: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/ports.json?device_id=bcaa06fe-99ca-4db7-baf3-633f21b16f61 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x876fc50>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 04:46:25.494 2309 ERROR nova.compute.manager [req-3b4a7b20-fa9f-4f59-ab90-3d914395add4 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61] Build of instance bcaa06fe-99ca-4db7-baf3-633f21b16f61 aborted: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x8772190>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 04:46:25.494 2309 ERROR nova.compute.manager [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61] BuildAbortException: Build of instance bcaa06fe-99ca-4db7-baf3-633f21b16f61 aborted: Connection to glance host http://controller:9292 failed: Error finding address for http://controller:9292/v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file: HTTPConnectionPool(host='controller', port=9292): Max retries exceeded with url: /v2/images/41dc78dd-963d-4a84-a872-35d1d3cb3f7c/file (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x8772190>: Failed to establish a new connection: [Errno 113] EHOSTUNREACH',))
2017-01-02 04:46:25.494 2309 ERROR nova.compute.manager [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61]
2017-01-02 04:46:25.496 2309 ERROR nova.compute.manager [req-3b4a7b20-fa9f-4f59-ab90-3d914395add4 cb356159afe8419593c567ed59ecf8de 9de892a2176a4744ba7bfda9ba47f62c - - -] [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61] Failed to deallocate networks
2017-01-02 04:46:25.496 2309 ERROR nova.compute.manager [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61] ConnectFailure: Unable to establish connection to http://127.0.0.1:9696/v2.0/ports.json?device_id=bcaa06fe-99ca-4db7-baf3-633f21b16f61: HTTPConnectionPool(host='127.0.0.1', port=9696): Max retries exceeded with url: /v2.0/ports.json?device_id=bcaa06fe-99ca-4db7-baf3-633f21b16f61 (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x87e7650>: Failed to establish a new connection: [Errno 111] ECONNREFUSED',))
2017-01-02 04:46:25.496 2309 ERROR nova.compute.manager [instance: bcaa06fe-99ca-4db7-baf3-633f21b16f61]
任何启动 nova 计算服务的尝试都失败并出现错误HypervisorUnavailable: Connection to the hypervisor is broken on host:
跟踪日志如下(取自/var/log/nova/nova-compute.log
)
AUDIT nova.service [-] Starting compute node (version 2014.1.1)
ERROR nova.virt.libvirt.driver [-] Connection to libvirt failed: Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory
TRACE nova.virt.libvirt.driver Traceback (most recent call last):
TRACE nova.virt.libvirt.driver File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 787, in _connect
TRACE nova.virt.libvirt.driver libvirt.openAuth, uri, auth, flags)
TRACE nova.virt.libvirt.driver File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
TRACE nova.virt.libvirt.driver rv = execute(f,*args,**kwargs)
TRACE nova.virt.libvirt.driver File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
TRACE nova.virt.libvirt.driver rv = meth(*args,**kwargs)
TRACE nova.virt.libvirt.driver File "/usr/lib/python2.7/dist-packages/libvirt.py", line 105, in openAuth
TRACE nova.virt.libvirt.driver if ret is None:raise libvirtError('virConnectOpenAuth() failed')
TRACE nova.virt.libvirt.driver libvirtError: Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory
TRACE nova.virt.libvirt.driver
ERROR nova.openstack.common.threadgroup [-] Connection to the hypervisor is broken on host: <HOST_NAME>
TRACE nova.openstack.common.threadgroup Traceback (most recent call last):
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/threadgroup.py", line 117, in wait
TRACE nova.openstack.common.threadgroup x.wait()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/threadgroup.py", line 49, in wait
TRACE nova.openstack.common.threadgroup return self.thread.wait()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait
TRACE nova.openstack.common.threadgroup return self._exit_event.wait()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
TRACE nova.openstack.common.threadgroup return hubs.get_hub().switch()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 187, in switch
TRACE nova.openstack.common.threadgroup return self.greenlet.switch()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
TRACE nova.openstack.common.threadgroup result = function(*args, **kwargs)
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/openstack/common/service.py", line 483, in run_service
TRACE nova.openstack.common.threadgroup service.start()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/service.py", line 163, in start
TRACE nova.openstack.common.threadgroup self.manager.init_host()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1006, in init_host
TRACE nova.openstack.common.threadgroup self.driver.init_host(host=self.host)
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 656, in init_host
TRACE nova.openstack.common.threadgroup self._do_quality_warnings()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 639, in _do_quality_warnings
TRACE nova.openstack.common.threadgroup caps = self.get_host_capabilities()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2849, in get_host_capabilities
TRACE nova.openstack.common.threadgroup xmlstr = self._conn.getCapabilities()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 721, in _get_connection
TRACE nova.openstack.common.threadgroup wrapped_conn = self._get_new_connection()
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 674, in _get_new_connection
TRACE nova.openstack.common.threadgroup wrapped_conn = self._connect(self.uri(), self.read_only)
TRACE nova.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 796, in _connect
TRACE nova.openstack.common.threadgroup raise exception.HypervisorUnavailable(host=CONF.host)
TRACE nova.openstack.common.threadgroup HypervisorUnavailable: Connection to the hypervisor is broken on host: <HOST_NAME>
没有其他日志文件指示任何错误
syslog
,dmesg
也 /var/log/libvirt/libvirtd.log
没有显示任何问题
libvirt 配置 ( /etc/libvirt/libvirtd.conf
) 设置为记录错误
log_outputs="3:syslog:libvirtd"
在出现错误之前,节点运行平稳,没有进行任何更改。