2023 open LLMs trend: BLOOM, OPT, GLM-130B go open — impact on reproducibility and cost

AI Impact Summary

2023 marks a pivot toward openly accessible LLM artifacts that teams can inspect, reproduce, and adapt. Key open models such as BLOOM, OPT, GLM-130B, Galactica, and GPT-NeoX-20B demonstrate that sizable capabilities can be published with transparent data and weights. Hugging Face's ecosystem amplifies this trend by enabling checkpoint reuse, which lowers compute and carbon footprint while speeding experimentation. The discussion on model size versus data (e.g., Chinchilla findings) informs budgeting for training versus fine-tuning, and organizations must prepare governance around licensing, data provenance, and bias auditing when adopting open models.