$ sudo apt-get install gnome-panel gnome-settings-daemon metacity nautilus gnome-terminal
And then add the following lines to the bottom of your ~/.vnc/xstartup:
gnome-panel &
gnome-settings-daemon &
metacity &
nautilus &
Kill vncserver:n and restart it and you should be golden.