Lack of diversity in pre-training data

1. The Dark Side of Fine-tuning Models (AI Secrets)