Sounds silly but took a while to figure out how to allow SSH access on Mac OS X.
I expected that it would act the similar way as in Linux.
But it was different, at least from user interface.
Just to remember for myself, this is what I did:
"System Preferences" -> "Sharing" -> "Services" -> Check on "Remote Login"
Also activated Firewall:
"System Preferences" -> "Sharing" -> "Firewall" -> Click on "Start" button
The main problem is that Google search doesn't provide the answer.
When I search for an answer for Linux related question, Google search usually gives me a very good hit. But that is not the case for Mac OS X.