Well, that's the question at hand. Who? Definitely not, people have an innate right to think about what they observe, whether that thing was made by someone else, or not.
What? I'd argue that's a much different question.
Let's take an extreme case. Entertainment industry producers tried to write language into the SAG-AFTRA contract that said that, if an extra is hired for a production, they can use that extra's image -- including 3D spatial body scans -- in perpetuity, for any purpose, and that privilege of eternal image storage and re-use was included in the price of hiring an extra for 1 day of work.
The producers would make precisely the same argument you are -- how dare you tell them how they can use the images that they captured, even if it's to use and re-use a person's image and shape in visual media, forever. The actors argue that their physiognomy is part of their brand and copyright, and using their image without their express permission (and, should they require it, compensation) is a violation of their rights.
Or, I could just take pictures of somebody in public places without their consent and feed them into an AI to create pictures of the subject flashing children. They were my pictures, taken by me, and how dare anybody get to make rules about who or what experiences them, right?
The fact is, we have rules about the capture and re-use of created works that have applied to society for a very long time. I don't think we should give copyright holders eternal locks on their work, but neither is it clear that a 100% free use policy on created work is the right answer. It is reasonable to propose something in between.