In Germany, where do I get my "Certificate of Good Standing" from?

This varies from state to state. In some of the Bundesländer the Landesprüfungsamt will issue the certificates, in others it is the responsibility of the Landesärztekammer. Some bodies work rather quickly, requiring a phone call only; others are more difficult and need a written application.