With a well-timed spin fall cancel and double jump, you can make your way underneath the skull face without hitting the switch to raise it. The interesting thing, though, is that then the skull starts to rise and fall as if I hit the switch, even though I never did. Maybe this says something about certain triggers in this game...?