And yet many Germans don’t have passports because they don’t need passports, and similarly many people from nearby countries can visit Germany legally without carrying a passport. There are other types of legal identification commonly used.
For travelers who are obviously coming from farther abroad, staff are likely to ask you for the passport, but it doesn’t mean that you couldn’t use another document instead, should you have an acceptable one on hand.