AI Reading for Sunday June 30

Jun 30, 2024

For a while, all AI has been agentic. ChatGPT is GPT + tools like web search. QA like Perplexity, combines AI for language understanding and generation, with tools like retrieval, and with AI determining control flow. RAG has more on the retrieval side, AutoGPT has more on the control flow. But everything combines language + tools + control flow.

The AI Agent Infrastructure Stack - Madrona

Bill Gates podcast, says superhuman AI might be closer than you think. - Next Big Idea Club

Google's long-context models aren't as good at understanding long texts as Google claims. - TechCrunch

Stores powered by Shopify get more AI features. - Reuters

Dust grabs $16m for enterprise AI assistants. - TechCrunch

Shipments of servers for AI workloads now the leading market / purchase target. Of course AI is still just a fraction of overall server shipments and the others have a much greater installed base so AI will take years to dominate the power requirements but it will probably happen eventually. - Tom's Hardware

Goldman Sachs CIO says LLMs might make people superhumanly productive but not superhumanly smart. - Fortune

I don’t really agree, superhumanly productive at accomplishing smart tasks is superhumanly smart. Creativity is often a search problem. Google AlphaGo Move 37. It’s combining multiple ideas in a new way. If you can do it faster you can be superhumanly smart.

There’s an impedance mismatch between left-brain coding and modeling and right-brain language and imagination. If you give the LLM a problem that involves a database lookup, training will never solve it directly since a database lookup is not differentiable. At some point that applies to complex logic too. You have to go back and forth between ideating and coding and trying different things, combining language and tools and exploring a search space.

But if you give it a probability problem and let it code up 20 solutions using different counting methods and try them (search), if it's very fast it will look superhumanly smart for sure. You probably still want to use it as an assistant, ask it questions, let it ask questions, try different things.

LaVague is an open source Large Action Model frmework - GitHub

Superhuman AI, but just for turning the universe into fake Morgan Freeman memes instead of paperclips.

Asking various image generators to do stuff with hands, Midjourney comes out on top. - Reddit

AI experiences developer burnout - Reddit

An LLM-based game you can talk fast to - ReadWrite

Today in nightmare fuel / mad scientists high as a kite on cocaine, robots with living tissue... doesn't anyone around here listen to Jeff Goldblum? - NYT

Follow the latest AI headlines via SkynetAndChill.com on Bluesky

AI Reading for Sunday June 30

Discussion about this post