Disable public key authentication in SSH

You can disable the public key authentication and allow password authentication (you have received your password in the server installation finished e-mail)

1. Log into SSH
2. Edit the file with your favorite editor: /etc/ssh/sshd_config
3. Lookup the variable: PasswordAuthentication and change 'no' to 'yes'
4. Save and close the file
5. Run this command: service sshd reload

Now you will be able to SSH into your server without public keys.