- What Will Be Left For Us To Work On
- Nice to see a balanced perspective, despite the absolutely alarming title “what will be left for us to work on”. When one thinks about it, the fact that this title is even possible to have as a keynote talk at one of the biggest scientific conferences of the planet is… completely insane.
- Really liked the “Hawaii Effect” analogy and how as we are getting closer to the destination, we need to be more precise about where we want to go, and that there are many directions in which we could possibly be going. AGI is not only “one thing that we will reach and that will be it.
- Really like the shift in focus from development to benchmarking - he puts big emphasis on evals now being where subtelties are now in - and that’s aligned with what most of ICML was about this year - so he’s spot on. Loved the “Evals are the new IPs [for companies]”.
- Favourite quote: “I’ve learned that if I don’t feel exhausted at the end of the day, I’ve done something wrong. I’ve offloaded too much to AI. […] Growth and productivity are two legs of a three-legged stool […] and the third leg of that stool is staying in control.”