OSX box has remote management enabled (AppleVNCServer) and port 5900 open. Using tightvnc/ultravnc/realvnc can't connect because of "security protocol mismatch" (don't have the exact phrase). Googling yields only to posts that say "use OSXVnc" or other remote desktop solutions.
How do I connect to apple's default remote management using Linux / Windows?
be sure to activate the VNC password: go to
System Preferences
/Sharing
/Remote Management
, press theComputer Settings...
button, check theVNC Viewers may control....
, and add a password there.I'm successfully using Vinagre (version 3.10.2 on Linux) to connect to OS X Yosemite; I didn't need to enable the "VNC Viewers may control..." option in OS X.
It works fine with a range of VNC clients I've tried - including VNC on my iPad and iPhone - I'd recommend you keep trying different clients or check your client and server configurations.