Here are the directions for how to shutdown or restart in Xfce4 without a password. It will also enable the shutdown and restart buttons.
Open a terminal use visudo and add the following:
username ALL = NOPASSWD: /usr/sbin/xfsm-shutdown-helper
This could need to be /usr/libexec/xfsm-shutdown-helper on non-Debian based systems.
