I don't like Gnome anyway, so after looking around I found something I didn't know about before (even though it has always been in an obvious spot, lol): "Spins". So I got the XFCE Spin 64-bit ISO and installed it instead of the default.
And Guest Additions works perfectly! I'm using it right now in Seamless mode.