Disable password access in sshd
/etc/ssh/sshd_config
ChallengeResponseAuthentication no PasswordAuthentication no UsePAM no