Fix a dead-lock due to xcb_poll_for_reply