Not possible to switch back from visual<->emacs mode to normal mode
Enter visual mode with "v", enter emacs mode with C-z, exit emacs mode with C-z. Now you are back in visual mode. I would expect that <escape> brings me back to normal mode, but it returns me to emacs mode. The only way I see to return to normal mode is through M-x normal-mode command.