The Memo - 30/Dec/2022
IQ testing GPT-3.5 with Raven's, OpenAI CEO/Bill Gates/Ray Kurzweil on 2023 AI, Med-PaLM, and much more!
FOR IMMEDIATE RELEASE: 30/Dec/2022
Welcome back to The Memo.
I’m based in California for the next few months. If your organization is interested in a hands-on workshop or keynote on AI and language models, you can reply to this email and we’ll see what we can cook up...
In the Toys to play with section, we look at a new ChatGPT clone with web search, a text-to-Powerpoint platform (text-davinci-003 + DALL-E 2), 24/7 AI-generated radio, entire magazines generated with GPT-3 and DALL-E 2/SD for 1 cent per article(!), and a new playground for complex maths using questions from Google PaLM Minerva.
If you were hoping for a quiet end to the year, this is not it!
The BIG Stuff
Latest GPT-3.5 model outperforming humans on real IQ tests (19/Dec/2022)
For brief context, I entered this AI field nearly three years ago while serving as Chairman for Mensa International’s Gifted Families committee, serving prodigies and gifted children through coaching via Harvard Medical School, and speaking at gifted education conferences around the world. That all ended with my May/2020 article and presentation, The New Irrelevance of Intelligence. I immediately began working with these large language models, and co-presented a session to the 2021 World Gifted Conference with Leta AI (now at Episode 65!).
Given Leta’s smarts, I had approached several of my psychologist colleagues in 2021 to run formal IQ assessments with GPT-3. It was viewed as a daunting challenge, as the standard assessments from Stanford-Binet or Wechsler rely on several subtests including kinaesthetic testing, which a large language model simply cannot undertake.
Researchers at UCLA weren’t as phased as we were, and flipped the Raven’s Progressive Matrices into numbers and letters to feed to GPT-3.5:
They found that the latest GPT-3.5 model (text-davinci-003) from 28/Nov/2022 outperformed humans in most settings.
GPT-3 [actually GPT-3.5, InstructGPT, text-davinci-003] displayed a surprisingly strong capacity for abstract pattern induction, matching or even surpassing human capabilities in most settings… achieves the analogical capacity that is often considered the core of human intelligence… it has been forced to develop mechanisms similar to those thought to underlie human analogical reasoning – despite not being explicitly trained to do so… through a radically different route than that taken by biological intelligence.
My longer article on this (26/Dec/2022): https://lifearchitect.ai/ravens/
Summary and viz of IQ + AI: https://lifearchitect.ai/iq-testing-ai/
Paper: https://arxiv.org/abs/2212.09196v1
Thread by UCLA: https://twitter.com/TaylorWWebb/status/1605395851081224193
OpenAI invests in four new companies (Dec/2022)
When we launched the OpenAI Startup Fund, we committed to invest early in a small number of startups that are pushing the boundaries of how powerful AI can positively impact the world and profoundly change people’s lives.
Descript (video editor).
Harvey AI (legal workflows).
Mem (workspace manager).
Speak (language learning).
Read more: https://openai.fund/news/introducing-our-first-investments
GPT-3 can detect dementia in voice samples (22/Dec/2022)
Any successful application of large language models to health and medicine belongs in ‘big stuff’!
Researchers at Drexel used GPT-3 embeddings to analyze voice samples, and found that GPT-3 can provide early diagnosis of dementia, with 80% accuracy on a challenge dataset of speech recordings.
Release: https://www.eurekalert.org/news-releases/975246
Paper: https://journals.plos.org/digitalhealth/article/file?id=10.1371/journal.pdig.0000168&type=printable
Google announces Med-PaLM 540B (26/Dec/2022)
Also in the medical field, Google further fine-tuned Flan-PaLM (Finetuned Language model, Pathways Language Model) on clinical data, to produce Med-PaLM.
This became an interesting collab between Google and DeepMind: While the project was mainly Google's, Dr Nenad Tomasev from DeepMind was also involved and cited in the paper. This model builds on the enormous Pathways family driven by Dr Jeff Dean. See my long paper about all the different models in this family: https://lifearchitect.ai/pathways
Here’s my take…
In 2016, ‘Johns Hopkins patient safety experts calculated that more than 250,000 deaths per year are due to medical error in the U.S… third leading cause of death.’
In the new Med-PaLM paper, the model was outperforming its nearest leading model significantly in minimising answers potentially leading to harmful outcomes (pp3):
Flan-PaLM: 29.7% harmful outcomes
Human clinician: 6.5% harmful outcomes
Med-PaLM: 5.8% harmful outcomes (a 10% improvement on human doctors)
I am not a medical doctor, but as a 2017 Fellow of the IOC at Harvard Medical School, I am reminded of the dictum, ‘First, do no harm’…
To my mind, just as self-driving cars can save thousands of lives, if post-2020 large language models are improving clinical outcomes by even a few percentage points (compared to human doctors), and that had a flow-on effect directly impacting whether a patient lives or dies, I wonder if we are on our way to having current AI with the capacity to save even more human lives…
Med-PaLM paper: https://arxiv.org/abs/2212.13138
The Interesting Stuff
ChatGPT public acceptance (28/Dec/2022)
When ChatGPT was announced on 30/Nov/2022, I started a livestream demo as soon as the notification hit my inbox. I remember googling for the term in quotes, “ChatGPT”. There were zero results, and Google actually tried to correct me to the term “chatbot”.
28 days later, on 28/Dec/2022, Google shows 77,300,000 results for the term “ChatGPT”.
77.3 million new references to a new technology within less than 30 days…
AI is now essential infrastructure (26/Dec/2022)
Very generally, the mainstream media are not good at recognizing and documenting artificial intelligence. They settle for cliche, usually with a header image of a killer robot, and can’t seem to grasp the societal implications of this natural evolution for humanity. Wired did a decent job with this short article, though:
For governments to fully deliver on the promise of AI, however, they will need to invest. Soon, a comprehensive digital infrastructure… will be as important to a country as roads, rail, and public water supply. In 2023, more and more countries will accelerate the building of such nationwide digital architectures, allowing them to deliver more AI-powered responsive services that cater to the individual and help the population at large. In 2023, bold governments will be making this move—and they will be examples to follow for the rest of the world.
Read: https://www.wired.com/story/digital-infrastructure-artificial-intelligence/
OpenAI CEO on AI in 2023 (26/Dec/2022)
there will be scary moments as we move towards AGI-level systems, and significant disruptions, but the upsides can be so amazing that it's well worth overcoming the great challenges to get there.
and we’ll see great benefits all along the way—they will make ChatGPT look like a boring toy.
in particular, there are going to be significant problems with the use of OpenAI tech over time; we will do our best but will not successfully anticipate every issue.
we will run a very tight feedback loop for improvement, and try to make our mistakes while the stakes are low.
nut its impossible to get this right with no contact with reality. we are learning so much from ChatGPT; its going to get a lot better, less annoying, and more useful fast. — via Twitter, 26/Dec/2022
Bill Gates on AI in 2023 (21/Dec/2022)
…the positive impact that artificial intelligence can have. Over the next few years, people are going to see the incredible progress in AI. I’m committed to making sure that these advances benefit everyone, and not just people in rich countries—for example, by using AI to help with developing new drugs, diagnosing diseases, and supporting students and teachers…
Read: https://www.gatesnotes.com/About-Bill-Gates/The-Year-Ahead-2023
First AI-generated speech in British parliament via ChatGPT (22/Dec/2022)
Luke Evans has become the first MP to deliver a Commons speech written entirely by Artificial Intelligence (AI) via ChatGPT. Speaking just before the House adjourned for Christmas, Evans read the 324-word speech.
The prompt was: Write a Churchillian speech on the state of the United Kingdom over the past 12 months.
The response began:
Ladies and gentlemen,
Over the past 12 months, the United Kingdom has faced many challenges and has made many important decisions. In the face of these challenges, the country has remained steadfast in its commitment to its values and principles.
Read the whole speech: https://order-order.com/2022/12/22/luke-evans-delivers-first-ai-generated-speech-in-commons/
Writing books with ChatGPT (25/Dec/2022)
I’ve been covering books written by AI (GPT-3) for more than two years. ChatGPT streamlines this process even further; you can literally give it instructions, and it will write the title, plot, and can then do the whole book by chapter.
In an interview on 25/Dec/2022, Leanne Leeds revealed one of her prompts, and the fact that ChatGPT has written the plots of six new murder mystery books for her!
The prompt is in The ChatGPT Prompt Book from a recent edition of The Memo.
Read more: https://www.theverge.com/23520625/chatgpt-openai-amazon-kindle-novel
Dr Ray Kurzweil gives an update on AI (Dec/2022)
– ChatGPT is a ‘sizeable advance’, but ‘not quite right’.
– Large language models (LLMs) are moving in the direction of sentience.
– LLMs carry risks, just as all tech does, including railroads.
Transcription (by OpenAI Whisper). (Note: I used OpenAI Whisper this time instead of Otter.ai, and the output was great! Whisper does punctuation, grammar, capitalization, and line breaks. Here’s the Google colab notebook if you’d like to generate your own transcripts of YouTube videos for free. It took about 5mins of processing for a 20min video.)
Midjourney Toddler Series (21/Dec/2022)
Yep, that’s Harry Potter as a toddler.
The prompt is: cute baby [character name], hyper realistic, unreal engine, studio lighting, HDR, 8k, cute toddler face expression
Take a look at the full series by Ben: https://www.instagram.com/benmornin/
AI for UI/UX design (23/Dec/2022)
50+ examples of UI design by Midjourney v4. Just beautiful!
Check it out: https://medium.muz.li/ai-powered-design-the-future-of-user-interfaces-399bd3f10472
Poly AI art asset generation library (28/Dec/2022)
You’re going to hear more about this AI-generated asset library. I can see them driving assets for Pixar and Weta and more very soon. Poly AI is Y-Combinator backed, and even though they are mainly 3D textures right now, Poly’s CEO has alluded to ‘perfect icon, illustration, font or sound effect’ generation.
Check them out: https://withpoly.com/
Related article: https://techcrunch.com/2022/12/27/y-combinator-backed-poly-uses-ai-to-generate-art-assets/
South Park creators secure $20M funding for AI media (22/Dec/2022)
Trey Parker and Matt Stone have been using a new-ish synthetic media generation platform for two years. There first clip was of Donald Trump, but the platform also famously generated Kendrick Lamar’s “The Heart Part 5” music video, released in May 2022, in which Lamar’s face transforms into the visages of OJ Simpson, Jussie Smollett, Nipsey Hussle, Kobe Bryant and Kanye West.
Toys to Play With
You.com’s ChatGPT clone (23/Dec/2022)
We first mentioned You.com back in the 6/Aug/2022 edition of The Memo. They’ve put their $25M to good use. Given that YouWrite was powered by GPT-3, I wonder if this is as well. Anyway, this is fun! Built right into the web search.
Try it here: https://you.com/search?q=what%20was%20the%20recent%20breakthrough%20in%20fusion%20research%3F
Generate slides with text-davinci-003 + DALL-E 2 with one click (28/Dec/2022)
ChatBCG was launched by two students at Stanford as ‘the world’s first Text-to-PowerPoint AI’. And I love the name, a shoutout to the Boston Consulting Group:
Try it: https://www.chatbcg.com/
Understanding Transformers (Dec/2022)
This is not just for data scientists; it is helpful to understand the maths (and English!) behind post-2020 AI.
Learn: https://e2eml.school/transformers.html
Even more: https://lifearchitect.ai/learn/
GPT Math (27/Dec/2022)
Colleague James Weaver from IBM has created a hands-on demonstration of GPT-3.5’s capabilities with numbers. Some of the ‘one-click’ examples are confronting. Try the Google PaLM Minerva examples, and the colored object examples.
The demo is ‘bring your own key’ (OpenAI), but you can still see the prompts even without one.
Try it: https://huggingface.co/spaces/JavaFXpert/gpt-math-techniques
24/7 AI-generated radio (20/Dec/2022)
By HarmonAI. Whoah!
Have a listen to the AI music: https://youtu.be/uGRLOMf2hSc
Edit: This livestream was just pulled a few minutes ago, but I’m sure they’ll be back. Here’s their channel page: https://www.youtube.com/@harmonai4151/streams
Magazines generated by GPT (27/Dec/2022)
‘[Using the OpenAI API to deliver a…] completely automated online magazine. The bot chooses the titles, writes the articles, and generates an image for them [using DALL-E 2]’
Look: https://thelatestbot.vercel.app/
The GPT Times takes tweets as inputs and uses GPT-3 to generate an article and a prompt for a thumbnail, which is sent to Stable Diffusion to generate an image. The response is then compiled and posted here…
In less than two weeks 7,281 articles have been generated on the prototype at a cost of about $0.012 [1 cent] per article….
I think the project prompts interesting questions about the state and future of journalism and the role of AI in it. Some outputs are surprisingly good.
Have a read: https://www.thegpttimes.com/
Next
Someone beat me to the punch with this chart of hilarious/frustrating view of luddites slamming new technology from trains to planes to computers. Sound familiar?
2023 is going to be explosive. See you there!
All my very best,
Alan
LifeArchitect.ai
p.s. I realized that I hadn’t added the ‘new ChatGPT with web access’ link to the automated email for new paid subscribers this month. Apologies, and fixed. It was mentioned in a Dec/2022 edition of The Memo, and it is called Perplexity. Here’s the direct link: https://www.perplexity.ai/
Housekeeping…
Unsubscribe:
Older subscriptions before 17/Jul/2022, please use the older interface or just reply to this email and we’ll stop your payments and take you off the list!
Newer subscriptions from 17/Jul/2022, please use Substack as usual.
Note that the subscription fee for new subscribers will increase from 1/Jan/2023. If you’re a current subscriber, you’ll always be on your old/original rate while you’re subbed.
Gift a subscription to a friend or colleague for the holiday season: