Keep pulling the thread on Andrej Karpathy.
A "Software 3.0" approach using Gemini and Nano Banana can generate images of menu items directly onto a photo of a menu, obviating the need for a separate application like Menugen.
Andrej Karpathy predicts a future computing paradigm of "neural computers" where the neural network is the host process and the CPU becomes a co-processor.
The training method for LLMs, which relies on verifiable rewards, causes their capabilities to become highly advanced in domains like math and code while stagnating in areas that are not easily verifiable.
Andrej Karpathy states the significant improvement in chess-playing ability from GPT-3.5 to GPT-4 was a direct result of someone at OpenAI adding a very large amount of chess data to the pre-training set.
Andrej Karpathy defines "agentic engineering" as a discipline focused on using AI agents to increase development speed while preserving the quality and security standards of professional software.
Andrej Karpathy believes the productivity gain for engineers who master "agentic engineering" will be significantly greater than the traditional "10x engineer" benchmark.
Andrej Karpathy argues that most software infrastructure and documentation is still designed for human users and needs to be rewritten to be "agent-native."
Andrej Karpathy predicts a future where individuals and organizations will have dedicated AI agents that communicate with each other to handle tasks like scheduling meetings.
Andrej Karpathy observed a fundamental improvement in the capabilities of AI models, particularly in agentic and coherent workflows, starting around December 2023.
Andrej Karpathy defines the "Software 3.0" paradigm as programming by prompting a Large Language Model within its context window.
The installation process for OpenClaw uses a text prompt for an AI agent rather than a traditional shell script, which Andrej Karpathy cites as an example of the "Software 3.0" paradigm.
Andrej Karpathy believes his Menugen application, built with traditional web development tools on Vercel, is an example of an "old paradigm" app that should not exist in the "Software 3.0" world.