Weekly AI Review in 7 Keys (22/05/23)
1 essay (Meta open-source AI approach), 1 paper (Tree of Thoughts), 1 tool (ChatGPT iOS), 1 topic (Sam Altman Senate hearing), 1 tweet (LeCun vs everyone), 1 quote (ChatGPT paywall?), 1 curiosity (Ethical hacking with AI)
In contrast to OpenAI, Google, Microsoft, Anthropic, etc. Meta continues a hardcore open-source approach to AI. This is good for developers. Is it good for the world?
“The growing secrecy at Google and OpenAI is a ‘huge mistake,’ Dr. LeCun said, and a ‘really bad take on what is happening.’ He argues that consumers and governments will refuse to embrace A.I. unless it is outside the control of companies like Google and Meta. ‘Do you want every A.I. system to be under the control of a couple of powerful American companies?’ he asked.”
Tree of Thoughts is an improvement over the popular prompt engineering paradigm Chain of Thought where you guide a language model (e.g., ChatGPT) through a given task by asking for intermediate “thoughts” resulting in performance improvements.
“ToT allows LMs to perform deliberate decision making by considering multiple different reasoning paths and self-evaluating choices to decide the next course of action, as well as looking ahead or backtracking when necessary to make global choices.”
“The ChatGPT app is free to use and syncs your history across devices. It also integrates Whisper, our open-source speech-recognition system, enabling voice input. ChatGPT Plus subscribers get exclusive access to GPT-4’s capabilities, early access to features and faster response times, all on iOS … We’re starting our rollout in the US and will expand to additional countries in the coming weeks.”
What’s going to happen with all the non-official ChatGPT apps now?