Pre-1900 LLM Relativity Test

Wanted to share one of my personal projects, since similar work has been shared here. TLDR is that I trained an LLM from scratch on pre-1900 text to see if it could come up with quantum mechanics and relativity. The model was too small to do meaningful reasoning, but it has glimpses of intuition. When given observations from past landmark experiments, the model can declare that “light is made up of definite quantities of energy” and even suggest that gravity and acceleration are locally equivalent. I’m releasing the dataset + models and leave this as an open problem. You can play with one of the early instruction tuned models here (not physics post trained): gpt1900.com Blog post: https://michaelhla.com/blog/machina-mirabilis.html GitHub: https://github.com/michaelhla/gpt1900 submitted by