Without the proprioceptive sensation, your brain loses track of where the mouse is in the operational space. Meaning it takes a large amount of concentration to operate anything with just the aid of visualization.
There’s already a “ping cursor” system in operating systems, but most would probably just move it in circles real fast so they see it like everyone else who forgets where their mouse cursor is.
And the more permanent something like this is, the more issues you get. We should be moving to something as easy to put on as a hat, not something that requires brain surgery to update