Yep. I took a language psych class in college, and we saw some examples of this that were crazy, especially being one of the people that can’t hear the difference.
I can’t remember the example, but just imagine somebody saying the same word to you twice and then a third party telling you the first person just said two different words.