@ben
Families of specialized hardware becomes normalized and increases flops/sec by >10x.
Matrix algebra becomes 50% more efficient with new algorithms #AlphaTensor.
Such specifications get abstracted into #Jax … TF and Torch become deprecated.
Early proof-of-concept advancements in RL lead by #selfsupervised learning on how-to videos.
Generative AI becomes commonplace in CGI, GameDev, WebDev, Marketing for economic reasons, displacing many creatives.
@ben more of a hope than a prediction: Python is dethroned as the DS go-to for scripting model build/train. Google introduces and open sources a JIT compiled, high-level language with built-in advanced data structures and XLA much like #julialang but with wider adoption, improved interoperability and #golang -like support for distributed compute