Open source is moving faster than closed source in the development of large language models.

"It only took open source two months to get this far...how do you compete with that?"

Smaller, fine-tuned models may be more effective than larger ones.

"Maybe large isn't a competitive advantage. Maybe actually a smaller model with lots of different people fine tuning it...can move faster"

High-quality data loops are crucial for large language models.

"The first party data loops are probably going to be the most important going forward"