Back to the periodic table
56ba-56
Mc
Collapse
Severity5/10
Model Collapse
Phenomenon in generative models where the model loses diversity in its outputs and converges to repeatedly generating a limited set of similar samples.
Periodic recordReliabilityarXiv2024
Matthias Gerstgrasser, Rylan Schaeffer, Apratim Dey, Rafael Rafailov, Henry Sleight, John Hughes, Tomasz Korbak, Rajashree Agrawal, Dhruv Pai, Andrey Gromov, Daniel A. Roberts, Diyi Yang, David L. Donoho, Sanmi Koyejo
Mitigation Strategy
Intentional diversification of training data, specific regularization techniques (minibatch discrimination), and hyperparameter tuning.
Atomic Number
56
Mc
Risk ID
ba-56
Severity
5/10
Severity Level