There shouldn’t be a distinction between quantum and non-quantum objects. That’s the mystery. Why can’t large objects exhibit quantum properties? Nobody knows, all we know is they don’t. We’ve attempted to figure it out by creating larger and larger objects that still exhibit quantum properties, but we know, at some point, it just stops exhibiting these properties and we don’t know why, but it doesn’t require an observer to collapse the wave function.
Also, can you define physical for me? It seems we have a misunderstanding here, because I’m defining physical as having a tangible effect on reality. If it wasn’t real, it could not interact with reality. It seems you’re using a different definition.