The Memo - Special edition: Llama 2 70B
Meta AI's Llama 2 model is 70B parameters trained on 2T tokens
FOR IMMEDIATE RELEASE: 18/July/2023
Welcome back to The Memo.
The BIG Stuff
Meta AI releases Llama 2
I’ve spent a few minutes summarizing the paper and playing with the model directly. Once again, we have this out to The Memo readers within 12 hours of model release.
Key points:
Completely open model with commercial license.
70B model trained on 2T tokens; better than Chinchilla (29:1).
New alignment dataset.
In my report card, I close with the line: ‘It’s not the biggest model, but it will be the leader in open-source LLMs run on ‘normal’ consumer-grade hardware, at least for the next ~3 months.‘
Exclusive: There are a couple of very interesting clauses in the T&Cs:
I’m calling this one the ‘Apple ban,’ as it looks to ring-fence the more than 900 million active iPhones.
2. Additional Commercial Terms. If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under this Agreement unless or until Meta otherwise expressly grants you such rights.
Given our exploration of defense platforms like Palantir’s AIP (The Memo 30/Apr/2023 edition) and ScaleAI’s Donovan (The Memo 9/Jul/2023 edition), I was interested to see the ban on military use for this model.
Prohibited Uses. You agree you will not use, or allow others to use, Llama 2 to: 2. Engage in, promote, incite, facilitate, or assist in the planning or development of activities that present a risk of death or bodily harm to individuals, including use of Llama 2 related to the following: a. Military, warfare, nuclear industries or applications, espionage, use for materials or activities that are subject to the International Traffic Arms Regulations (ITAR) maintained by the United States Department of State
Read Meta AI’s announce and summary.
Read the paper (76 pages).
Download my report card (B+). See also Models table and Timeline.
Already available on Microsoft Azure.
Try the 13B chat version via Replicate (free, GitHub login).
Try the 13B chat version via Streamlit (free, no login): https://www.llama2.ai/
Watch my livestreamed video (link):
All my very best,
Alan
LifeArchitect.ai