What’s insane about that assumption? People had very limited information in the past. You see this, you think giant vicious fierce carnivore. You see this or this, you think giant one-eyed human.
And those are the skulls of hippos and elephants. What would you imagine when you see this then?