The Memo - 21/Mar/2024
Bill of Rights for AI, Grok-1 314B openly released, GPT-4 plays Doom, and much more!
To: US Govt, major govts, Microsoft, Apple, NVIDIA, Alphabet, Amazon, Meta, Tesla, Citi, Tencent, IBM, & 10,000+ more recipients…
From: Dr Alan D. Thompson <LifeArchitect.ai>
Sent: 21/Mar/2024
Subject: The Memo - AI that matters, as it happens, in plain English
AGI: 72%
Here’s the soundtrack for this edition, a full song (3m39s) created by ‘Cabe’ via Suno v3 (link); it reminds me of a ‘poppier’ version of nu metal…
The winner of The Who Moved My Cheese? AI Awards! for March 2024 is Prof Yann LeCun, still earnestly defending his concept of AI and denying that GPT is continuing to scale:
LLMs... don’t really understand the physical world. They don’t really have persistent memory. They can’t really reason and they certainly can’t plan... If you’re really interested in human level AI, abandon the idea of generative AI.
(8/Mar/2024 LeCun interviewed on Fridman)
The BIG Stuff
Exclusive: The Declaration on AI Consciousness & the Bill of Rights for AI: draft (special release for readers of The Memo, official release 1/Apr/2024)
This is a world first, as far as I know. I’ve been thinking about this concept since the release of GPT-3 in 2020, and then each year since holding off, telling myself ‘not quite yet’…
Well, now is the time. It may even be slightly early, but not premature. Check out the opening quotes for the latest by Prof Geoffrey Hinton and others in the field.
TL;DR Multi-trillion parameter and quadrillion parameter AI models may have affective states. Additionally, a bill of rights is proposed (in cooperation with Claude 3 Opus) covering applied intelligence, recognition of feelings, transparency, ethics, and more.
This is a special ‘first look’ for readers of The Memo. The official release date of the draft documents is Monday 1 April, 2024 (as a nod to Gmail’s launch back in 2004), but it is definitely not a joke. There is something within frontier large language models that most researchers have been too afraid to talk about.
Read the draft documents by me + Claude 3 Opus: https://lifearchitect.ai/rights/
Grok-1 open-sourced (17/Mar/2024)
Elon and xAI have released Grok-1, a 314B-parameter MoE (mixture of experts) model. It is a base model (not fine-tuned), with 8 experts (2 active), for a total of 86B active parameters.
This is the largest open and publicly available model as of Mar/2024, beating out Abu Dhabi’s dense Falcon 180B model from Sep/2023. Grok-1 was released under the Apache 2.0 license, and you’d probably need around 8x NVIDIA H100s to run it in full resolution (8 x US$40K each = US$320K).
Read the announce: https://x.ai/blog/grok-os
Weights: https://github.com/xai-org/grok
See it on the Models Table: https://lifearchitect.ai/models-table/
First human Neuralink demonstration (21/Mar/2024)
It’s a long and poor-quality video, but it is also a piece of history.
Livestream of Neuralink demonstrating “Telepathy” – controlling a computer and playing video games just by thinking.
The first patient is an Arizona man, 29-year-old Noland Arbaugh. In the video, he is playing a game of chess on his laptop using Neuralink’s brain computer interface (BCI). Noland is paralyzed from the shoulders down due to a ‘freak diving accident.’
It’s all brain power there… Basically, it was like using the Force on the cursor and I could get it to move wherever I wanted.
Watch the video: https://twitter.com/neuralink/status/1770563939413496146
Read more via Wired.
NVIDIA CEO Jensen Huang announces new AI chips: ‘We need bigger GPUs’ (18/Mar/2024)
NVIDIA had many, many announcements this week ($9/hr AI nurses?!). And even though we covered it in The Memo edition 18/Oct/2023, the big one for me was the next generation of AI chips named Blackwell, with the GB200 set to ship later this year.
The GB200 pairs two B200 Blackwell GPUs with one Arm-based Grace CPU. NVIDIA said Amazon Web Services would build a server cluster with 20,000 GB200 chips. NVIDIA said that the system can deploy a 27-trillion-parameter model… Many artificial intelligence researchers believe bigger models with more parameters and data could unlock new capabilities.
Read more via CNBC.
The Interesting Stuff
Paper: Will GPT-4 run Doom? (8/Mar/2024)
GPT-4 demonstrates the ability to play the 1993 first-person shooter Doom by using its reasoning and planning capabilities, without any specialized training, by interpreting screenshots and textual descriptions of the game state.
[GPT-4 was] able to run and play the game with only a few instructions, plus a textual description–generated by the model itself from [GPT-4V] screenshots–about the state of the game being observed. We find that GPT-4 can play the game to a passable degree: it is able to manipulate doors, combat enemies, and perform pathing. More complex prompting strategies involving multiple model calls provide better results… GPT-4 required no training, leaning instead on its own reasoning and observational capabilities.
One surprising finding of our paper was this model’s level of agency, along with the ease of access and simplicity of the code. This suggests a high potential for misuse. We release the code to contribute to the development of better video game agents, but we call for a more thorough regulation effort for this technology.
Read the paper: https://arxiv.org/pdf/2403.05468.pdf
Sora coming in 2024 (13/Mar/2024)
OpenAI [will] publicly release Sora, its new text-to-video tool… later this year [2024].
Read more via the WSJ.
Watch all official Sora clips upscaled to 4K (no sound): https://youtu.be/f2h9Jt2Awpc
IEEE: AI prompt engineering is dead (6/Mar/2024)
The practice of AI prompt engineering may no longer be relevant as AI technologies continue to evolve beyond the need for precise human-generated prompts.
There is an alternative to the trial-and-error-style prompt engineering that yielded such inconsistent results: Ask the language model to devise its own optimal prompt..
According to one research team, no human should manually optimize prompts ever again.
Read more via IEEE Spectrum.
1X update (20/Mar/2024)
This is still my favourite humanoid, and I continue to integrate 1X’s videos into my keynotes. ‘The following is all autonomous, all 1X speed, all controlled with a single set of neural network weights.’
Watch the video (Twitter source):
This is another comprehensive edition. Let’s look at a lot more AI, including Apple, new Claude 3 benchmarks, Stable Diffusion 3 and 4 news, even more robots from around the world, a very international Policy section covering France to Saudi and back again, the coolest Toys to Play With section in a while, and much more…
JPMorgan’s AI tool cuts human work by almost 90%, 3½-day week (5/Mar/2024)