Comment 6 for bug 1017418

Revision history for this message
Kevin Jackson (kevin-linuxservices) wrote :

I re-ran that script above, adding --poll to the end of the nova boot command:

Run 1, Num Errors: 0, Num Active: 30
Run 2, Num Errors: 0, Num Active: 30
Run 3, Num Errors: 0, Num Active: 30
Run 4, Num Errors: 0, Num Active: 30
Run 5, Num Errors: 0, Num Active: 30
Run 6, Num Errors: 0, Num Active: 30
Run 7, Num Errors: 0, Num Active: 30
Run 8, Num Errors: 0, Num Active: 30
Run 9, Num Errors: 0, Num Active: 30
Run 10, Num Errors: 0, Num Active: 30
Run 11, Num Errors: 0, Num Active: 30
Run 12, Num Errors: 0, Num Active: 30
Run 13, Num Errors: 0, Num Active: 30
Run 14, Num Errors: 0, Num Active: 30
Run 15, Num Errors: 0, Num Active: 30

sudo nova-manage floating list
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.1 Missing instance 7469 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.2 Missing instance 7472 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.3 Missing instance 7475 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.4 Missing instance 7478 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.5 Missing instance 7481 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.6 Missing instance 7484 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.7 Missing instance 7487 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.8 Missing instance 7490 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.9 Missing instance 7493 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.10 Missing instance 7496 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.4.11 Missing instance 7499 nova bond0
...
None 172.29.4.244 None nova bond0
None 172.29.4.245 None nova bond0
None 172.29.4.246 None nova bond0
None 172.29.4.247 None nova bond0
None 172.29.4.248 None nova bond0
None 172.29.4.249 None nova bond0
None 172.29.4.250 None nova bond0
None 172.29.4.251 None nova bond0
None 172.29.4.252 None nova bond0
None 172.29.4.253 None nova bond0
None 172.29.4.254 None nova bond0

Re-running again

Run 1, Num Errors: 0, Num Active: 30
Run 2, Num Errors: 2, Num Active: 28
Run 3, Num Errors: 30, Num Active: 0
Run 4, Num Errors: 30, Num Active: 0
Run 5, Num Errors: 30, Num Active: 0
Run 6, Num Errors: 30, Num Active: 0
Run 7, Num Errors: 30, Num Active: 0
Run 8, Num Errors: 30, Num Active: 0

when running

sudo nova-manage floating list

b3ecef20bbb842929cee0d7523a0b2e4 172.29.3.250 Missing instance 8974 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.3.251 Missing instance 8977 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.3.252 Missing instance 8980 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.3.253 Missing instance 8983 nova bond0
b3ecef20bbb842929cee0d7523a0b2e4 172.29.3.254 Missing instance 8986 nova bond0

all now show as Missing.

/var/log/nova/nova-network.log

012-06-26 12:57:51 ERROR nova.rpc.amqp [req-f4557acc-e19e-4289-8216-a5dc15623ce6 cb704aa5159b4aa887f17f0349a7f7c9 b3ecef20bbb842929cee0d7523a0b2e4] Exception during message handling
2012-06-26 12:57:51 TRACE nova.rpc.amqp Traceback (most recent call last):
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 252, in _process_data
2012-06-26 12:57:51 TRACE nova.rpc.amqp rval = node_func(context=ctxt, **node_args)
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 258, in wrapped
2012-06-26 12:57:51 TRACE nova.rpc.amqp return func(self, context, *args, **kwargs)
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 324, in allocate_for_instance
2012-06-26 12:57:51 TRACE nova.rpc.amqp floating_address = self.allocate_floating_ip(context, project_id)
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 258, in wrapped
2012-06-26 12:57:51 TRACE nova.rpc.amqp return func(self, context, *args, **kwargs)
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 408, in allocate_floating_ip
2012-06-26 12:57:51 TRACE nova.rpc.amqp pool)
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 246, in floating_ip_allocate_address
2012-06-26 12:57:51 TRACE nova.rpc.amqp return IMPL.floating_ip_allocate_address(context, project_id, pool)
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 120, in wrapper
2012-06-26 12:57:51 TRACE nova.rpc.amqp return f(*args, **kwargs)
2012-06-26 12:57:51 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 642, in floating_ip_allocate_address
2012-06-26 12:57:51 TRACE nova.rpc.amqp raise exception.NoMoreFloatingIps()
2012-06-26 12:57:51 TRACE nova.rpc.amqp NoMoreFloatingIps: Zero floating ips available.
2012-06-26 12:57:51 TRACE nova.rpc.amqp
2012-06-26 12:57:51 ERROR nova.rpc.amqp [req-f4557acc-e19e-4289-8216-a5dc15623ce6 cb704aa5159b4aa887f17f0349a7f7c9 b3ecef20bbb842929cee0d7523a0b2e4] Returning exception Zero floating ips available. to caller
2012-06-26 12:57:51 ERROR nova.rpc.amqp [req-f4557acc-e19e-4289-8216-a5dc15623ce6 cb704aa5159b4aa887f17f0349a7f7c9 b3ecef20bbb842929cee0d7523a0b2e4] ['Traceback (most recent call last):\n', ' File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 252, in _process_data\n rval = node_func(context=ctxt, **node_args)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 258, in wrapped\n return func(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 324, in allocate_for_instance\n floating_address = self.allocate_floating_ip(context, project_id)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 258, in wrapped\n return func(self, context, *args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 408, in allocate_floating_ip\n pool)\n', ' File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 246, in floating_ip_allocate_address\n return IMPL.floating_ip_allocate_address(context, project_id, pool)\n', ' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 120, in wrapper\n return f(*args, **kwargs)\n', ' File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 642, in floating_ip_allocate_address\n raise exception.NoMoreFloatingIps()\n', 'NoMoreFloatingIps: Zero floating ips available.\n']