I'll expand this to something more comprehensive later but mainly wanted to record something odd that happened to me using Gentoo.
When PasswordAuthetication=no is ignored
Set KeyboardInteractive to no
PasswordAuthentication no KbdInteractiveAuthentication no