That is already done, as a way to improve AI, in a technique called Generative Adversarial Neural Networks (GANN).
One network’s task is to produce fake content. The other network’s task is to detect it. These networks then evolve together, each getting better and better.
What that means is that if we develop a means to detect AI-generated content, then that mechanism becomes the stepping stone to better AI.