“Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease,” they added. “We term this condition Model Autophagy Disorder (MAD).”
Interestingly, this might be a more challenging problem as we increase the use of generative AI models online.
I forget where I heard this quote:
So, the most valuable Reddit archives are the ones that were already made before they set ruinous prices on their APIs. Nice.
gonna file this away for five or ten years from now…