What's Left Before AGI? PaLM-E, 'GPT 4' and Multi-Modality
What is the one task that is left before we get AGI? This video will delve into PaLM-E, multi-modality, long-term memory, compute accelerationism, safety and so much more. I will cover Anthropic's update this week on the state of the art of language models and go in depth into their eye-opening thoughts on AGI timelines.
I cover Sam Altman's statements on a 'compute truce' and analyse what remaining weaknesses PaLM (and likely GPT 4) have. I show what people thought would be road blocks and how they turned out not to be, with specific examples from Bing Chat and ChatGPT. I also delve into Meta's Llama model, showing that not everything is exponential.
Topics also covered into Claude, Big Bench tests, SIQA, mechanistic interpretability, Universal Turing Machines, Midjourney version 5 (v5) and more!
https://www.patreon.com/AIExplained
https://palm-e.github.io/#demo
https://www.anthropic.com/index/core-views-on-ai-safety
https://palm-e.github.io/assets/palm-e.pdf
https://twitter.com/NandoDF/status/1525397036325019649
https://en.wikipedia.org/wiki/Artificial_general_intelligence
https://www.wired.com/story/adaptation-if-computers-are-so-smart-how-come-they-cant-read/
https://www.searchenginejournal.com/gpt-4-is-multimodal/481993/#close
https://arxiv.org/pdf/2204.02311.pdf
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/mnist_ascii
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/temporal_sequences
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/simple_text_editing
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hyperbaton
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hhh_alignment
https://arxiv.org/pdf/2301.04589.pdf
https://poe.com/claude
https://arxiv.org/pdf/2302.13971.pdf
https://storage.googleapis.com/pub-tools-public-publication-data/pdf/b8c26e4347adc3453c15d96a09e6f7f102293f71.pdf
https://openai.com/blog/planning-for-agi-and-beyond
https://www.lesswrong.com/posts/PE22QJSww8mpwh7bt/agi-in-sight-our-look-at-the-game-board
https://www.lesswrong.com/posts/HguqQSY8mR7NxGopc/2022-was-the-year-agi-arrived-just-don-t-call-it-that
https://arxiv.org/pdf/2210.00881.pdf
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/gre_reading_comprehension
https://ai.googleblog.com/2023/03/palm-e-embodied-multimodal-language.html
https://www.patreon.com/AIExplained
What is the one task that is left before we get AGI? This video will delve into PaLM-E, multi-modality, long-term memory, compute accelerationism, safety and so much more. I will cover Anthropic’s update this week on the state of the art of language models and go in depth into their eye-opening thoughts on AGI timelines.
I cover Sam Altman’s statements on a ‘compute truce’ and analyse what remaining weaknesses PaLM (and likely GPT 4) have. I show what people thought would be road blocks and how they turned out not to be, with specific examples from Bing Chat and ChatGPT. I also delve into Meta’s Llama model, showing that not everything is exponential.
Topics also covered into Claude, Big Bench tests, SIQA, mechanistic interpretability, Universal Turing Machines, Midjourney version 5 (v5) and more!
https://www.patreon.com/AIExplained
https://palm-e.github.io/#demo
https://www.anthropic.com/index/core-views-on-ai-safety
https://palm-e.github.io/assets/palm-e.pdf
https://twitter.com/NandoDF/status/1525397036325019649
https://en.wikipedia.org/wiki/Artificial_general_intelligence
https://www.wired.com/story/adaptation-if-computers-are-so-smart-how-come-they-cant-read/
https://www.searchenginejournal.com/gpt-4-is-multimodal/481993/#close
https://arxiv.org/pdf/2204.02311.pdf
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/mnist_ascii
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/temporal_sequences
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/simple_text_editing
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hyperbaton
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hhh_alignment
https://arxiv.org/pdf/2301.04589.pdf
https://poe.com/claude
https://arxiv.org/pdf/2302.13971.pdf
https://storage.googleapis.com/pub-tools-public-publication-data/pdf/b8c26e4347adc3453c15d96a09e6f7f102293f71.pdf
https://openai.com/blog/planning-for-agi-and-beyond
https://www.lesswrong.com/posts/PE22QJSww8mpwh7bt/agi-in-sight-our-look-at-the-game-board
https://www.lesswrong.com/posts/HguqQSY8mR7NxGopc/2022-was-the-year-agi-arrived-just-don-t-call-it-that
https://arxiv.org/pdf/2210.00881.pdf
https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/gre_reading_comprehension
https://ai.googleblog.com/2023/03/palm-e-embodied-multimodal-language.html
https://www.patreon.com/AIExplained
