The Memo - 19/Mar/2023 (20+ announcements)
ERNIE Bot, Stanford Alpaca 7B, Midjourney v5 with hands, ChatGLM-6B, and much more!
FOR IMMEDIATE RELEASE: 19/Mar/2023
Welcome back to The Memo.
There are over 20 major announcements in this edition.
If you’ve been following my work on post-2020 AI, you will have noticed that I tend towards optimistic. In my recent livestream about GPT-4 (watch the replay), I commented—for perhaps the first time—that the GPT-4 model and its implications are ‘scary’. I’ve generally avoided using that word, and even chastised media for using it, preferring the word ‘exhilarating’ and sometimes ‘confronting’ to describe post-2020 AI.
A few hours after my livestream, OpenAI’s CEO also went live, admitting that he feels the same way. On 17/Mar/2023, he told ABC America:
We've got to be careful here… we are a little bit scared of this.
The reasons for my fear around this particular model are many, and I address each of them in the livestream (replay). They include:
OpenAI cronyism and preferential treatment. Some ‘friends’ of OpenAI got access to the GPT-4 model 8 months ago, in August 2022. This included OpenAI’s President giving his former company Stripe early access to the model. I find this to be especially egregious given that OpenAI planned on ‘delaying deployment of GPT-4 by a further six months [to Sep/2023]’ (paper) before making the model more generally available.
OpenAI trade secrets. OpenAI hid all technical details about the model, including token and parameter counts, architecture, and training dataset. We don’t know what’s in it. OpenAI’s Chief Scientist went on record to confirm that they were ‘wrong’ to ever publish details about models (16/Mar/2023).
GPT-4 capabilities. The performance of GPT-4 has been understated. GPT-4 is in the 90th percentile of human testing for many metrics, including one particularly difficult competitive Olympiad (99.5th percentile), and now vastly outperforms the human average in many fields ranging from medicine to law to wine tasting theory (LifeArchitect.ai/GPT-4#capabilities).
GPT-4 power-seeking. As discussed in The Memo edition 12/Feb/2023, AI safety is about more than just alignment with humanity. The GPT-4 model was tested for ‘power-seeking,’ including setting it loose (in a sandbox) and giving it money and VMs to see if it could replicate itself and hoard resources. Additionally, GPT-4 was allowed to (successfully) socially engineer (deceive) a real human worker at TaskRabbit to solve a Captcha for it, which they did. (I hope you can see exactly why I’m a little concerned here!)
Economic impacts without a mitigation strategy. UBI—universal basic income—is not ready, and workers are beginning to be displaced already. As previously reported in The Memo edition 2/Mar/2023, 48% of surveyed companies admitted that they have already replaced workers with GPT-4’s predecessor (25/Feb/2023).
I’m using a temporary new format for this very-long edition, due to the sheer depth and breadth of AI releases in the last few days. Format is:
Organization name: AI announcement or tool (date)
In the Toys to play with section, we look at the first book written with GPT-4, available for free download.
An eagle-eyed reader has pointed out that The Memo sits very high in the leaderboard for all paid technology newsletters worldwide!
I’d also like to invite you to test out a little pilot roundtable for paid subscribers. This is a video call in an informal setting, an opportunity for you to ask me any questions you have, and to meet other paid readers. The first roundtable will be:
Life Architect - The Memo - Roundtable #1
Saturday 1/Apr/2023 at 5PM Los Angeles
Saturday 1/Apr/2023 at 8PM New York
Sunday 2/Apr/2023 at 8AM Perth
or check your timezone.
You don’t need to do anything for this; there’s no registration or forms to fill in, I don’t want your email, you don’t even need to turn on your camera or give your real name!
Join the roundtable at the date and time above using this Google Meet link.
Add to calendar (fixed).
The BIG Stuff
Microsoft: Microsoft 365 Copilot (17/Mar/2023)
What is it: GPT-4 built-in to the big Microsoft productivity apps. Above, it writes an email based on a short prompt.
Read more (Microsoft announce).
Google: AI inside apps like Google Docs (14/Mar/2023)
What is it: AI (probably LaMDA 2 and PaLM) built-in to the big Google apps. Above, it writes an entire document based on a short prompt.
Midjourney: v5 released - with working hands and fingers! (16/Mar/2023)
What is it: In my opinion, Midjourney is the best text-to-image model in the world. The images above were ‘conceptualised’ by the AI, and these images didn’t exist until Midjourney v5 ‘thought’ about what these images should look like.
Read more (Midjourney announce on Discord).
Try it out (rough interface via Discord): https://www.midjourney.com/
Baidu: ERNIE Bot (17/Mar/2023)
When it comes to AI, China continues to keep pace with the US. 650 companies have already signed up to use ERNIE Bot, with another 90,000 enterprise customers applying, parameter count undisclosed.
Read more (LifeArchitect.ai/ERNIE).
Stanford: Alpaca 7B fine-tune of Meta LLaMA 7B/65B (16/Mar/2023)
We introduce Alpaca 7B, a model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations. On our preliminary evaluation of single-turn instruction following, Alpaca behaves qualitatively similarly to OpenAI’s text-davinci-003, while being surprisingly small and easy/cheap to reproduce (<600$).
Note: I am not particularly impressed with this model. Stanford used GPT-3 to generate training data, which breaks OpenAI’s T&Cs:
2. Usage Requirements
c. Restrictions
You may not (iii) use output from the Services to develop models that compete with OpenAI.
While it’s great to have a small model that runs on home hardware, my tests on the demo—before the demo was suspended a few days later for ‘safety’ reasons—showed that the performance was sub-par.
Read more (Stanford announce).
The Interesting Stuff
Stability: Stable Diffusion Reimagine (18/Mar/2023)
What is it: Reimagine is a new text-to-image tool, allowing users to create infinite variations of uploaded images.
Read more: https://stability.ai/blog/stable-diffusion-reimagine
Tsinghua ChatGLM-6B (19/Mar/2023)
Tsinghua fine-tuned their GLM-130B model with dialogue, for an open-source ChatGLM-6B. ‘With the quantization technique, users can deploy locally on consumer-grade graphics cards (only 6GB of GPU memory is required at the INT4 quantization level).’
Read more: https://github.com/THUDM/ChatGLM-6B/blob/main/README_en.md
Boston Consulting Group: BCG X to use GPT-4 (Mar/2023)
…we have established the Center for Responsible Generative AI within BCG X, with dedicated teams supporting our clients in realizing the power of OpenAI technologies.
We launched BCG X—home to nearly 3,000 technologists, scientists, programmers, engineers, and human-centered designers—to turbocharge BCG’s deep industry and functional expertise…
At BCG, we are at the forefront of responsible AI and were the first in our industry to launch an AI Code of Conduct.
PwC Legal: Exclusive partnership with Harvey/GPT-4 (15/Mar/2023)
Harvey will help generate insights and recommendations based on large volumes of data, delivering richer information that will enable PwC professionals to identify solutions faster. All outputs will be overseen and reviewed by PwC professionals.
Morgan Stanley: GPT-4 chatbot for internal use (14/Mar/2023)
You essentially have the knowledge of the most knowledgeable person in Wealth Management—instantly. We believe that is a transformative capability for our company… [the tool is trained on] 60,000 research reports on parts of the global economy, but also 40,000 other internal documents from the firm — making it an expert on any financial subject that a financial adviser might want to look up.
Be My Eyes: GPT-4 visual integration (14/Mar/2023)
…powered by OpenAI’s new GPT-4 language model, which contains a dynamic new image-to-text generator. Users can send images via the app to an AI-powered Virtual Volunteer, which will answer any question about that image and provide instantaneous visual assistance for a wide variety of tasks.
I have been contacted by several readers with vision impairment who are very excited for this release.
Read more (official announce).
Khan Academy: GPT-4 Khanmigo chat bot (14/Mar/2023)
Read more (Khan announce 1, Khan announce 2).
Duolingo: Duolingo Max powered by GPT-4 (14/Mar/2023)
Duolingo, an app for learning languages, got access to GPT-4 in the fall, and employees said that CEO Luis von Ahn was so taken with it that he called a meeting for 8 a.m. the following morning and immediately changed people’s jobs…the company has crafted 1,000-2,000 word prompts for GPT-4 that power the bots.
Read more (Duolingo announce).
Google: New API to access PaLM 540B (14/Mar/2023)
‘Select developers can access the PaLM API and MakerSuite in Private Preview today, and stay tuned for our waitlist soon.’
Google: Med-PaLM 2 (14/Mar/2023)
‘…Med-PaLM 2, consistently performed at an “expert” doctor level on medical exam questions, scoring 85%. This is an 18% improvement from Med-PaLM’s previous performance and far surpasses similar AI models.’
Anthropic: Claude (RL-CAI 52B) access via application process (14/Mar/2023)
‘After working for the past few months with key partners like Notion, Quora, and DuckDuckGo in a closed alpha, we’ve been able to carefully test out our systems in the wild, and are ready to offer Claude more broadly so it can power crucial, cutting-edge use cases at scale.’
Read more (Anthropic announce).
Try it via Quora Poe (now $19.99/m or $199.99/y): https://poe.com/
Zapier: (NLA) Natural Language Actions with AI API (17/Mar/2023)
Read more (Zapier summary with many links).
British Government: US$1B funding for new AI supercomputer (16/Mar/2023)
On the AI and the quantum strategy Jeremy Hunt said the government was accepting all of Sir Patrick Vallance's recommendations including a core BCS recommendation that sandboxes be established to create a “safe space” to work with regulators on innovation: "We will launch an AI sandbox to trial new, faster approaches to help innovators get cutting edge products to market, work at pace with the Intellectual Property Office to provide clarity on IP rules so generative AI companies can access the material they need,” he said.
He added: "Because AI needs computing horsepower, I today commit around £900m of funding to implement the recommendations in the independent Future of Compute Review for an Exascale supercomputer. - via BCS
Read more via The Guardian: UK to invest £900m [US$1.08B] in supercomputer in bid to build own ‘BritGPT’
New GPT-4 viz (16/Mar/2023)
A quick reminder that my visualizations have been featured at NYU, Harvard, Accenture, and in many other places. All examples at LifeArchitect.ai are for you to use openly, with citation intact. Here are three new visualizations from this week:
GPT-4 enterprise customers (19/Mar/2023)
Thanks to Joanna for supporting the creation of this list. It seems to be the most comprehensive list of GPT-4 clients so far, with just over 20 organizations to 19/Mar/2023, all supported by primary source references. We will keep this up-to-date until the end of Mar/2023 (or for the first 50 or so customers).
Take a look: https://lifearchitect.ai/gpt-4/#customers
Paper: ‘Modern language models refute Chomsky’s approach to language’ by Steven Piantadosi (12/Mar/2023)
This language paper was written by UC Berkeley Psychology and Neuroscience Professor Steven Piantadosi. It was a fun read, and reminded me of my ruthless bashing of Chomsky’s silly assertions about GPT-3 in one of my videos (timecode).
Read the paper: https://lingbuzz.net/lingbuzz/007180
Toys to Play With
Milo: GPT-4 Copilot for parents and families (17/Mar/2023)
‘…a simple SMS copilot that can take in all manners of chaos - grocery list, reminders by voice, bday party screenshots, school newsletter pdfs… and get them back to you (and everyone else in the family) as work cal invites or SMS reminders or easy lists.’
Apply for beta testing: https://www.joinmilo.com/
Read the first book co-authored by GPT-4 (16/Mar/2023)
Reid Hoffman: I wrote a new book with OpenAI’s latest, most powerful large language model [GPT-4]. It’s called Impromptu: Amplifying our Humanity through AI. This, as far as I know, is the first book written with GPT-4… Last summer [August 2022, more than 8 months before release], I got access to GPT-4. It felt like I had a new kind of passport. - via Twitter
(I resolutely condemn cronyism, nepotism, and other favoritism in the distribution of intelligence and artificial intelligence technology. This kind of unjustifiable preferential treatment is contemptible, and the antithesis of the equity available through AI. - Alan)
Download here:
Next
All my very best,
Alan
LifeArchitect.ai
Archives | Unsubscribe new account | Unsubscribe old account (before Aug/2022)