Researchers looking at AI have determined that training the AI on a dataset that INCLUDES previous outputs of the AI will quickly descend into repetitive boredom.
The same thing happens in human creativity. When I started writing courseware for money in 1996, I quickly found that I needed to avoid looking at similar work. I’m not dumb enough to simply copy, but I could feel the similar work both pulling and pushing on my work.. Pulling me toward certain tendencies without realizing it, and pushing me away from the formats or styles of the similar work.
I apply the same restriction with my writing here. When I see a writer who seems to be taking the same path, I restrict my diet of his work to avoid the pulls and pushes.
AI would only be pulled, not pushed, so it would tend to converge into sameness without any negative feedback.
Polistra's Mill 