Synthetic Data

What is synthetic data?

Artificially generated data used to train LLMs, offering potential for expanding training datasets but posing risks of compounding hallucinations and model collapse.