Human will immediately adopt anything they can carry with them. But humans have a very strong repulsion to adopting anything they have to wear or in general have permanently on them. It is uncomfortable, it is hot, it is annoying, it is visible, it is a wall between them and the world. There are people who don’t wear their correction glasses because they don’t like having something on their faces. There are people who don’t even withstand contact glasses. There are deaf people who refuse to use hearing implants. Wrist watches are tolerated because they are more peripheral and easier to remove.
This is a way more fundamental flaw on the concept of VR than technology, applications, software availability, etc. You can make VR as tiny and practical as contact glasses and people will still refuse to adopt it.