Tune in to today's special episode airing a recent panel with the founders of Scale AI, Anthropic, and AI Fund who gathered in Washington DC to discuss China as an adversary. They argue that the papers out of Tsinghua University are just as impressive as those coming out of American universities. China is just as creative, but maybe even more motivated. While discussions of regulations have encompassed certain restraints, Alex Wang, Andrew Ng, and Jack Clark argue that we’re not moving fast enough (moderated by US senator Cory Booker). This session was recorded live at The Hill & Valley Forum in 2024, a private bipartisan community of lawmakers and innovators committed to harnessing the power of technology to address America's most pressing national security challenges. The Hill & Valley podcast is part of the Turpentine podcast network. Learn more: www.turpentine.co RECOMMENDED PODCAST - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

In this episode from the Autopilot podcast, Sergiy Nesterenko, founder of Quilter (backed by Benchmark), discusses designing PCB circuitboards end-to-end using reinforcement learning. "Autopilot" host Will Summerlin and Nesterenko cover how current PCB boards are designed and how Quilter’s tech stack enables faster board design, what better circuit boards enable in the future, their GTM and where they are seeing most market pull right now, and much more. Subscribe to Autopilot: Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333&nd=1&dlsi=18fee5e95b284d02 Apple: https://podcasts.apple.com/us/podcast/autopilot-with-will-summerlin/id1738163836 YouTube: https://www.youtube.com/@AutopilotwithWillSummerlin Check out Nathan's new chatbot on www.cognitiverevolution.ai SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. LINKS: Quilter: https://www.quilter.ai/ Autopilot Ventures: https://www.apv.vc/ X/SOCIAL: @labenz (Nathan) @WSummerlinAI (Will) @sergiynest (Sergiy) @quilterai (Quilter) TIMESTAMPS: (00:00) Intro & Sergiy’s Background (04:31) What Sergiy learned from SpaceX (05:53) Founding thesis of Quilter and Quilter’s journey (06:57) Where would one find circuit boards? (08:11) What is the process of designing a circuit board? (09:39) Design process today with Quilter (14:34) Sponsor: Omneky (16:01) Quilter’s thesis and designing more complex circuits (18:25) How much are humans currently paid for board design (19:41) Labor dynamics in board design (20:30) Do most companies have board designers in-house? (21:14) Incentive structure (22:44) What does a high-performance circuit board look like vs low-performance? (26:37) Quilter’s technology stack (29:15) Sponsor: Plumb | Squad (31:15) How Quilter can grow with scale? (33:50) Where is circuit manufacturing happening (37:17) What other parts of knowledge work can be solved with reinforcement learning (41:03) GTM and who Quilter is selling to (42:48) Pricing (44:04) Where Quilter is seeing the most market pull right now (45:21) What makes Quilter an exciting company to work at or invest (47:14) The effects of closed research in private companies for the industry (49:25) Open source vs closed source (51:14) What Sergiy would advise to himself in his early founder (53:59) What drew Sergiy to working with Benchmark (56:19) Wrap

In this episode, we explore the Chinese AI ecosystem with 'L-squared,' an anonymous tech worker based in Beijing. We discuss major players, model quality, public engagement, regulation, and the US 'chip ban.' Discover the similarities and differences between US and Chinese AI landscapes, and gain a nuanced perspective on the current state of AI in China. USEFUL RESOURCES: Testing Chinese models: Yi-34B-Chat (made by Kai-Fu Lee's team 01.AI) can be tried out via Replicate (https://replicate.com/01-ai/yi-34b-chat) or Hugging Face. You can also use the ChatGLM playground (https://open.bigmodel.cn/trialcenter) and Baidu's ERNIE (https://yiyan.baidu.com/) without a Chinese SIM card. Benchmarking models: SuperCLUE is one of the most prominent benchmarks - the latest results are on GitHub (https://github.com/CLUEbenchmark/SuperCLUE) and the paper explaining the methodology is here (https://arxiv.org/abs/2307.15020). Regulation: Explainer (https://carnegieendowment.org/2023/07/10/china-s-ai-regulations-and-how-they-get-made-pub-90117) from Matt Sheehan; piece (https://www.chinatalk.media/p/how-tight-ai-regs-hurt-chinese-firms) on how genAI regs are affecting Chinese companies. US-China competition: Jeff Ding's work (https://www.tandfonline.com/doi/full/10.1080/09692290.2023.2173633) on the diffusion deficit in S&T; Bloomberg piece (https://www.bloomberg.com/graphics/2023-china-huawei-semiconductor/) on Huawei's semiconductor development efforts. Staying up to date: Sign up to alerts from CSET's Scout tool (https://scout.eto.tech/); subscribe to Concordia AI's AI safety (https://aisafetychina.substack.com/) in China newsletter (disclaimer: I used to work at Concordia!) A 2016 profile (https://chinai.substack.com/p/chinai-37-happy-20th-anniversary) on Microsoft Research Asia by Wang Jingjing, covered in Jeff Ding's ChinAI newsletter SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off http://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. TIMESTAMPS: (00:00) Introduction (07:24) China's AI Ecosystem (13:40) Public AI Engagement (17:33) Sponsors : OCI / Omneky (18:50) AI Tools Comparison (35:37) Sponsors : Brave / Squad / Plumb (39:14) AI Regulatory Maze (51:02) AI Performance, Censorship (55:28) Chinese AI Regulations (01:04:37) Tech, Research Role (01:12:11) Global AI Ecosystem (01:23:22) Cultural AI Perspectives (01:29:14) AI Safety, Cooperation

In this episode, Nathan sits down with Andrew Lee, founder of Shortwave, an AI-powered email app that describes itself as “the smartest email app on planet earth.” They discuss Shortwave’s RAG stack, how the AI assistant works, the models Shortwave is using, and much more. This is truly a masterclass in RAG app development. Sponsors :  Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00) - Intro (01:07) - Shortwave: AI-Powered Email (06:22) - Genesis of Shortwave (15:25) - Sponsors: Oracle / Omneky (16:46) - Data Processing Pipeline (21:57) - Choosing a Vector Database (26:34) - How the AI Assistant Works (36:24) - Sponsors: Brave / Plumb / Squad (40:53) - Fine-Tuning & Hosting Models (45:11) - Email Automation (47:55) - Email Retrieval (51:44) - Optimizing AI Performance (53:20) - Safety & Embedded Ethics (01:04:51) - Strategic Product Launches (01:09:58) - Inbox Management (01:12:24) - The Future of Collaborative AI (01:18:54) - Scaling Personalized Outreach (01:26:04) - Closing Thoughts & What's Next

In this episode, we dive deep into the inner workings of large language models with Professor David Bau and grad students Koyena Pal and Eric Todd from Northeastern University. Koyena shares insights from her Future Lens paper, which shows that even mid-sized language models think multiple tokens ahead. Eric discusses the fascinating concept of Function Vectors - complex patterns of activity spread across transformer layers that enable in-context learning. Professor Bau connects the dots between these projects and the lab's broader interpretability research agenda, identifying key abstractions that link low-level computations to higher-level model behaviors. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00) Intro (04:03) Reverse Engineering AI (10:10) Factual Knowledge Localization (16:34) Sponsors: Oracle | Omneky | On Deck (18:27) Future Lens Paper Intro (23:54) Choosing GPT-J (26:54) Vocabulary Prediction (30:36) Sponsors: Brave | Plumb | Squad (33:13) Fixed Prompt (35:57) Soft Prompt (41:32) Future Lens Results Analysis (51:50) Tooling & Open Source Code (56:07) Larger Models & Mamba Probes (1:04:10) Function Vectors Paper (1:09:39) Extracting & Patching Vectors (1:13:30) Encoding Task Understanding (1:15:36) Expert Models Implications (1:18:09) Conclusion

In this second part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discusstMamba's application to computer vision, experiments in extending effective context length, the potential problem of internal rotting states, and the use of hybrid SSMs in biology.Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing Nathan's original Mamba Deep Dive Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58 Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566 X/SOCIAL: @labenz (Nathan) SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS: (00:00) - Episode Start (00:01:14) - Nathan and Jason’s Bet (00:04:51) - U-Mamba (00:15:10) - Sponsors: Oracle | Omneky (00:06:08) - Swin U-Mamba (00:18:59) - Vision Mamba (00:24:30 - VMamba (00:27:26) - VM-UNet (00:30:37) - Sponsors: Brave | On Deck (00:35:15) - SegMamba (00:36:59) - Vivim (00:37:31) - Mamba Morph (00:39:01) - Graph Mamba  (00:43:15) - Long Mamba (00:59:54) - Evo and StripedHyena The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture. Producer: Vivian Meng Editor: Graham Bessellieu For sponsor or guest inquiries, email: [email protected] 

In this first part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discuss the mechanistic underpinnings of Mamba architecture, Mamba's context capabilities, multi-modal applications in image segmentation and computer vision tasks, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries. Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333 Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836 LINKS: Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing Nathan's original Mamba Deep Dive Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58 Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566 X/SOCIAL: @labenz (Nathan) SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

In this episode, Nathan sits down with Adam Gleave, founder of Far AI, for a masterclass on AI exploitability. They dissect Adam's findings on vulnerabilities in GPT-4's fine-tuning and Assistant PIs, Far AI's work exposing exploitable flaws in "superhuman" Go AIs through innovative adversarial strategies, accidental jailbreaking by naive developers during fine-tuning, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries. Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333 Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836LINKS: LINKS: Far AI: https://far.ai/author/adam-gleave/ X/SOCIAL: @labenz (Nathan) @ARGleave (Adam) @FARAIResearch (Far.AI) SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS: (00:00:00) Episode Preview (00:01:25) The alarming reality of AI exploits: from accidental jailbreaking to malicious attacks. (00:16:45) The Assistants API: a new frontier for AI exploitation. (00:41:54) The ethical dilemma of AI security research and disclosure. (00:51:36) Exploring AI vulnerabilities: a deep dive into GPT-4's exploits. (00:51:47) The challenge of AI robustness and the 'Accidental Jailbreaking' phenomenon. (00:52:39) Navigating the Assistants API: security risks and malicious exploits. (00:53:27) The robustness tax: balancing AI safety with performance. (01:07:42) Unveiling flaws in superhuman Go-playing AIs: a gray-box investigation. (01:36:50) Empirical scaling laws for adversarial robustness: a future focus. (01:41:53) Closing remarks and opportunities at FAR AI

In this episode, Nathan sits down with Tim Reutemann, author of “Liquid Reign”. They discuss liquid democracy, reshaping political participation using AI and biometrics, and practical advances in technology and their impacts on identity verification, rehabilitation, and gaming. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Liquid Reign Book: https://www.amazon.ca/Liquid-Reign-Tim-Reutemann/dp/1981029176 Tim Reutemann's Medium: https://tim-reutemann.medium.com/ Audrey Tang: https://en.wikipedia.org/wiki/Audrey_Tang X/SOCIAL: @labenz (Nathan) @TimReutemann (Tim) SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS: (00:00:00) - Exploring the power of your vote in a futuristic AI world. (00:01:25) - Imagining a positive future with advanced AI. (00:02:35) - Diving into 'Liquid Reign’: A vision of AI-transformed society. (00:05:58) - The journey of writing 'Liquid Reign’: From thought experiment to novel. (00:09:07) - The mechanics of liquid democracy and AI integration. (00:15:59) - Sponsors: Oracle | Omneky  (00:12:51) - Unpacking the technology stack behind the futuristic society. (00:16:00) - Exploring the progress and challenges in AI and cryptography. (00:25:28) - Switzerland’s unique way of getting citizens involved in democracy (00:28:45) - Sponsors: Brave | On Deck  (00:47:58) - The future of open source and security in an AI-driven world. (00:52:02) - Exploring the depths of cybersecurity and paranoia. (00:52:47) - The future of human-computer interfaces: Chips, VR, and beyond. (00:54:11) - The ethical dilemma of invasive technologies. (00:56:45) - The evolution of VR: From gaming to rehabilitation. (01:30:48) - Navigating the complexities of AI and privacy. (01:37:27) - Envisioning a positive future: The role of AI in society.

In this episode, Nathan sits down with Pablo Arredondo, VP of CoCounsel for Thomson Reuters. They discuss the evolution of legal research, how GPT-4 has changed legal practices, security and privacy in AI driven legal services, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api X/SOCIAL: @labenz (Nathan) @tweetatpablo (Pablo) @casetext  LINKS: Casetext: https://casetext.com/ Cognitive Revolution (new feed): https://cognitiverevolution.ai/ SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS (00:00:00) Episode preview (00:01:42) The evolution of legal research: From books to AI (00:02:19) The game-changing impact of GPT-4 on legal practices (00:04:01) Exploring the future of legal AI with Pablo Arredondo (00:04:34) The birth and evolution of CaseText (00:07:06) Revolutionizing legal research with AI and large language models (00:14:42) The leap to GPT-4: A new era for legal tech (00:16:42) Navigating the challenges and opportunities of AI in law (00:27:41) The continuous evolution of AI in legal tech (00:43:46) The importance of rigorous testing in AI deployment (00:45:19) The importance of testing in legal tech (00:45:46) Merging with Thomson Reuters: A new era of quality control (00:46:49) Harnessing GPT-4 for legal document review (00:48:27) Innovations in legal tech: Beyond GPT-4 (00:49:00) The evolution of legal research and document management (00:49:54) Exploring the potential of AI in legal firms (00:51:37) Security and privacy in AI-driven legal services (00:52:43) The future of vector databases in legal tech (00:54:10) AI-assisted legal assistance: A new frontier (00:58:41) The pricing strategy and market response to AI legal tools (01:10:18) The future of law and AI integration (01:23:18) Reflections on being acquired by Thomson Reuters (01:26:07) Closing thoughts: The impact of LLMs on justice

In this episode, Nathan sits down with Itamar Friedman, CEO of Codium AI, the company on the mission to create the code integrity paradigm. They discuss harnessing LLMs for code integrity, task decomposition, workflow engineering, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api X/SOCIAL: @labenz (Nathan) @itamar_mar (Itamar) @CodiumAI (Sodium) LINKS: Codium: https://www.codium.ai/ Cognitive Revolution Feed: https://cognitiverevolution.ai/ SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS: (00:00:00) Episode Preview (00:06:32) The evolution of AI in software development: beyond code generation (00:09:51) The shift towards code integrity and its impact (00:14:23) Unveiling Alpha Codium: A leap in AI-assisted code integrity (00:16:53) The broader impact of AI on software development processes (00:17:11) Sponsor break: Oraclel | Omneky (00:18:52) The future of AI in coding: enhancements, testing, and more (00:24:41) AI's role in enhancing code quality and developer efficiency (00:43:38) Exploring the challenges of large codebases (00:44:03) The impact of LLM context growth on code understanding (00:45:19) Innovative approaches to data retention and context computation (00:46:08) Deep dive into repo analysis and future directions (00:42:31) Personal experiences and the quest for efficient code management (00:48:26) Dynamic graph strategies and future features in IDEs (00:49:10) From code testing to advanced flow engineering: a new paradigm (00:52:37) Unveiling Alpha Codium: A leap in coding challenge solutions (01:07:31) Reflecting on workflows (01:23:30) Final thoughts and recommendations for AI enthusiasts

In this episode, Nathan sits down with Will Bryk, CEO of Exa.ai. They discuss how Exa enables complex, research-based searches that differ from traditional keyword-based search, how their AI uses neural and non-neural methods, why they are using their own vector database, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: - Exa.ai: https://exa.ai/ X/SOCIAL: @WilliamBryk (William) @labenz (Nathan) @ExaAILabs (Exa) SPONSORS: NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS (00:00:00) - Preview (00:01:52) - Exploring the landscape of information retrieval tools (00:14:19) - Exa: AI librarian for the web (00:15:32) - Sponsors: Netsuite | Omneky (00:16:57) - AI Project Ideas (00:22:26) - What does search built for AI mean? (00:25:40) - Ranking with neural and non-neural methods (00:30:50) - Sponsors: Brave | On Deck (00:33:13) - Best practices for Exa prompting (00:34:01) - The power of keyword search (00:37:26) - Breaking down complex queries (00:34:37) - The evolution of search engines (00:39:53) - The business side of Exa (00:40:17) - The challenges of building a web scale index (00:39:53) - The business side of Exa (00:50:59) - Vector DBs (00:58:17) - Company culture and core values at Exa

In this episode, Nathan sits down with Richard Socher, CEO and Founder of You.com, a personalized AI search assistant. They discuss the rise of the AI chatbot paradigm and how that's changed the game for search, You.com's various modes, with particular emphasis on Genius mode and above all Research mode, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: - You.com: https://you.com/ -Richard Socher's site: https://www.socher.org/ SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz @RichardSocher (Richard) @YouSearchEngine @CogRev_Podcast TIMESTAMPS: (00:00) Preview (01:38) Interview with Richard Socher: AI pioneer (02:26) Exploring the You.com product (02:55) The AI Bundle (05:23) Richard Socher's journey in deep learning (16:43) You.com comparison to competitors (31:16) The future of AI search engines (41:38) The changing landscape of search engines (41:44) The impact of chatbots and AI on search (42:16) How the market will shape up (43:33) The power of open source (01:02:32) The role of AI in advancing science (51:42) The future of AI: philosophical and practical considerations (55:06) The future of AI: risks and regulations (01:11:07) The future of AI: agency and emergence (01:26:57) The future of AI: retrieval, memory, and online learning

In this episode, Nathan sits down with Robin Hanson, associate professor of economics at George Mason University and researcher at Oxford’s Future of Humanity Institute. They discuss the comparison of human brains to LLMs and legacy software systems, what it would take for AI and automation to significantly impact the economy, our relationships with AI and the moral weight it has, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Robin’s Book, The Age of Em: https://ageofem.com/ Robin’s essay on Automation: https://www.overcomingbias.com/p/no-recent-automation-revolutionhtml Robin’s Blog: https://www.overcomingbias.com/ AI Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&list=PLVfJCYRuaJIXooK_KWju5djdVmEpH81ee&pp=iAQB Dr. Isaac Kohane Episode: https://www.youtube.com/watch?v=pS5Vye671Xg SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz @robinhanson (Robin) @CogRev_Podcast TIMESTAMPS (00:00) Preview (07:10) Why our current time is a “dream time” and the move back to a Malthusian world (13:30) What sort of world should we be striving for? (13:40) Sponsor - Brave (17:50) Distinguishing value talk from factual talk (18:00) Comparing and contrasting Ems to LLMs (22:30) The comparison of human brains to legacy software systems (30:52) Sponsor - Netsuite (41:01) AIs in medicine (53:30) A several century innovation pause (55:30) Achieving full human level AI in the next 60-90 years (1:03:55) Chess and routine benchmarks not a good predictor of AI performance in the economy (1:07:44) Reaching and exceeding human-level AI in the next 1000 years (1:11:40) Losing technologies tied to scale economies (1:12:00) Why AI is hard to maintain in the long run (1:12:20) Standard deviation in automation (1:14:05) Computing power grows exponentially but automation grows steadily (1:15:50) AI art generation and deepfakes (01:21:42) The economics of AI-powered coding (1:33:51) Merging LLMs (1:36:02) Rot in software and the human brain (1:40:18) Parallelism in LLMs and brain design (1:41:00]) Moral weight for AIs, enslavement, and cooperation with AI (1:47:10) What would change Robin’s mind about the future (1:49:18) Wrap

In this conversation, Nathan is joined by Azeem Azhar, founder and writer of the Exponential View. They discuss why startups are likely to drive the true disruption in the industry, what forward thinking leaders are doing today to retrain their teams for AI, why Azeem agrees with Sam Altman’s comments that AGI will likely arrive soon, new governance mechanisms for the AI age, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Exponential View: https://www.exponentialview.co/ Exponential Age, written by Azeem Azhar: https://www.amazon.com/Exponential-Age-Digital-Revolution-Rewire/dp/1635769094 X/SOCIAL: @azeem @labenz (Nathan) @CogRev_Podcast  SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. TIMESTAMPS: (02:34) The Great Embedding: predictions for the future of AI (14:37) - Sponsor: Brave (22:53) The future of AI in medicine (25:57) The role of AI in customer service and data entry (28:05) - Sponsors: Netsuite | Omneky (40:45) The concept of transition and the role of big banks and tech companies (42:13) The adoption of AI in large companies and its impact (44:47) The potential disruption of industries by AI (47:12) The future of AI: Opportunities and challenges (01:18:02) The benefits and challenges of bot-to-bot communication (01:20:54) The future of AI: Opportunities and threats (01:22:53) The role of governance in AI development (01:39:39) The role of trust and responsibility in AI development (01:46:57) The importance of public trust in AI technology (01:51:16) The need for checks and balances in AI development (01:53:42) The role of government and academia in AI development

In this episode, Zvi Mowshowitz returns to the show to discuss OpenAI’s Sora model, Google’s Gemini announcement, Anthropic’s Sleeper Agents, and other live player analysis. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase  (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. LINKS: -Zvi’s Blog: https://thezvi.substack.com/ - Waymark The Frost Episode: https://www.youtube.com/watch?v=c1pPiGD7cBw -Anthropic Sleeper Agents: https://www.anthropic.com/news/sleeper-agents-training-deceptive-llms-that-persist-through-safety-training SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/Social: @TheZvi (Zvi) @labenz (Nathan) @CogRev_Podcast TIMESTAMPS: (00:04:37) - Zvi’s feedback on the type of content the show should create (00:05:33) - Zvi’s experience with Gemini (00:09:42) - Speculating on Google Gemini’s launch timing (00:12:54) - Advantages of Gemini  (00:16:11) - Sponsors: Brave (00:25:00) - Speculating on Gemini 1.5 and market dynamics for foundational models.  (00:28:18) How long context windows change things (00:30:57) - Sponsor: Netsuite | Omneky  (00:41:06) - LLM Leaderboards  (00:43:37) - Physics world modelling in OpenAI Sora (00:57:25) - Object permanence in Sora (01:04:40) - Experiments Zvi would run on Sora  (01:06:21) - Superalignment and Anthropic Sleeper Agent (01:10:47) - When do agents actually start to work?  (01:16:00) - Raising the standard for AI app developers  (01:22:07) - Dangers of open soure development  (01:30:53) - The future of compact models  (01:33:58) - Superalignment  (01:53:00) - Meta (01:54:20) - Mistral’s hold over the regulatory environment  (02:04:16) - The Impact of Chip Bans on AI Development

Note: This conversation contains themes of suicidal ideation, in the context of academic research. Please watch from (21:41) onwards if you would like to skip past this content. In this conversation, Nathan sits down with Eugenia Kuyda, Replika's Founder and CEO. They discuss recent research published in Nature conducted by Stanford on Replika user interactions, how Replika is providing their users with a relationship they can trust and confide in, what Eugenia has found surprising about the evolution of how people are interacting with their Replikas, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS Loneliness and suicide mitigation for students using GPT3-enabled chatbots: https://www.nature.com/articles/s44184-023-00047-6 Eugenia Kuyda Part 1 on The Cognitive Revolution: https://www.youtube.com/watch?v=SFKA7T-v6WE SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/Social: @ekuyda (Eugenia) @labenz (Nathan) @CogRev_Podcast  Timestamps: (00:00) Preview and summary (06:41 The evolution of Replika (08:11) Definining the main goal of Replika (09:54) Nature published study by Stanford on Replika and mental health (14:20) Methodology for the research on Replika users (15:19) Sponsor - Brave Search API (19:46) Replika providing people with a relationship they can trust and confide in (23:20) How people are relating and reacting to their AI Replikas (25:49) Stuffed animal analogy (28:20) What people come to Replika for (30:29) Sponsor - Netsuite | Omneky (32:03) How malleable are people’s expectations for their Replika? (36:54) The evolution of how people are interacting with Replika (44:49) Putting Replika on device (46:59) Underappreciated or developed aspects of AI development (56:11) The relationship people have with their Replika is a moat (1:08:46) Building AI to memorialize people after they passed: what are the ethics?

In this episode, a16z partners Justine Moore and Anish Acharya join Nathan to discuss the AI Abundance Agenda, their latest thesis for consumer AI. They discuss the intersection of weird and working, and their investment pillars in AI for creativity and productivity, companionship, and wellness and growth. Looking for a search API? Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Read a16z’s AI Abundance Agenda here: https://gamma.app/docs/a16z-Consumer-Abundance-Agenda-ieotbnzbxj81biu?mode=doc SUBREDDITS MENTIONED: Justine's Deep Dive on AI Subreddits: https://twitter.com/venturetwins/status/1734614118294868115 r/LocalLLaMA: https://www.reddit.com/r/LocalLLaMA/ r/ComfyUI: https://www.reddit.com/r/comfyui/ r/StableDiffusion: https://www.reddit.com/r/StableDiffusion/ r/aivideo: https://www.reddit.com/r/aivideo/ SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/Social: @labenz (Nathan) @venturetwins (Justine) @illscience (Anish) @a16z  TIMESTAMPS: 00:00) Intro and summary (06:29) Introduction to the Abundance Agenda (09:21) AI reducing administrative overhead (09:40) Relationships and companionship (10:30) Wellness and personal growth (11:24 The intersection of weird and working: why weird sometimes works (13:24) How AI helps the pro consumer (15:17) Sponsor | Brave Search API (20:47) Where do Justine and Anish discover new AI products (23:25) The best AI subreddits (27:16) High NPS churn vs Low NPS Churn (28:30) AI Bundle: how it would work (29:34) Sponsor | Netsuite + Omneky (32:01) AI CMO or AI operated back office (33:40) Best AI image to video products (34:53) Why there aren’t currently APIs for AI video products (39:12) AI email composition will be tackled by an incumbent rather than a startup (39:47) The rise of voice-first due to AI (40:40) Startups vs incumbents - 80:20 value capture for startups (41:41) Salesforce vs a startup AI CRM (45:07) Creating artistically opinionated models using fine tuning (47:42) Why isn’t there a push for AI doctors? (51:46) AI mental health apps (55:00) Frameworks for designing non-predatory AI (56:51) Proxy metric for evaluating companion AI products (59:48) Media literacy and intuition for the next generation around AI (1:00:20) Request for startups from Justine and Anish

In this episode, Dr Michael Levin, Distinguished Professor of Biology at Tufts University, joins Nathan to discuss embodied minds, his research into limb regeneration and collective intelligence, cognitive light cones, and much more. Michael and the Levin Lab work at the intersection of biology, artificial life, bioengineering, synthetic morphology, and cognitive science. LINKS: The Levin Lab and Dr. Michael Levin’s research: https://drmichaellevin.org/resources/ Dr Michael Levin’s blog: https://thoughtforms.life/about/ Tufts University Faculty Profile: https://as.tufts.edu/biology/people/faculty/michael-levin Michael Levin @ Wyss Institute: https://wyss.harvard.edu/team/associate-faculty/michael-levin-ph-d/ Dr. Levin’s Research on Limb Regeneration: https://news.uchicago.edu/how-bioelectricity-could-regrow-limbs-and-organs SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL @labenz (Nathan) @drmichaellevin (Michael) @CogRev_Podcast Timestamps: (00:00) Preview (01:07) Intro and summary (05:40) Xenobots, anthrobots and the other creatures created by Mike Levin (09:39) Bioelectric memory rewriting (15:01) Sponsor | BraveSearch API (16:09) The difficulty of conducting simulations, which involve running forward passes to predict and alter electrical patterns (20:30) The concept of backpropagation and mode switching in AI models (23:06) Why humans do not regenerate their limbs (37:10) Sponsor | Netsuite (39:40) Learning from small and biological systems onto the concept of possible emergence (45:16) The criticality of multiple scale questions and would a single scale? (55:49) The concept of the cognitive light cone (59:43) Advice on habits of mind and suggestions for inspiration on the AI side (1:13:36) Mike's suggested directions for the AI developers (1:24:49) Wrap & Sponsor | Omneky

In this episode, Nathan sits down with Max Bennett, author of the book: A Brief History of Intelligence. They discuss the five major breakthroughs in evolution that resulted in human brains and cognition. They delve deeper into the workings of each breakthrough, the evolution of intelligence, and how AI can benefit from understanding these principles. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. LINKS: A Brief History of Intelligence: https://a.co/d/6VPWTf7 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @maxsbennett (Max) @CogRev_Podcast TIMESTAMPS: (00:00) Intro (06:00) Max's background on commercializing AI in technology (09:53) AI has taught us a lot of our intuitions are wrong (11:22) Why we're better off avoiding defining intelligence (14:38) The Five Breakthrough Model - steering, reinforcing, simulating, mentalizing, and speaking (15:43) Sponsor - Brave Search API | Shopify (18:20) The story of the first breakthrough - Steering (21:40) Evolution doesn't have forethought and every generation has to survive (23:05) The study of nematodes - how did this first brain emerge? (27:10) yet in bilaterians, but the idea is you classify things in the world into good and bad. (33:00) Netsuite by Oracle | Omneky (36:16) The story of the second breakthrough - Reinforcing (1:32:44) The story of the fourth breakthrough - Mentalizing (1:45:57) The story of the fourth breakthrough - Speaking (pls listen to the audio book / read the book) (1:46:46) How evolutionary paradigms will shape up in the future (1:55:03) A unified theory of value or moral patienthood that can be applied to the five breakthroughs (1:59:21) Wrap + Sponsor | Omneky

In today's episode Yohei Nakajima, GP at Untapped Capital and Creator of BabyAGI, returns to the show. Together with Nathan, they watch Yohei’s TEDAI Talk, unpacking themes on collective intelligence, identity, and how AI can help us better understand one another. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: - Yohei's TEDAI Talk: https://www.ai-event.ted.com/panelists/yohei-nakajima - Listen to Yohei Nakajima Part 1 on The Cognitive Revolution here: https://www.cognitiverevolution.ai/ai-agents-vc-insights-on-ai-and-building-in-public-with-yohei-nakajima-creator-of-babyagi/ SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @yoheinakajima (Yohei) @CogRev_Podcast TIMESTAMPS: (06:39) Yohei's AI Creation Process (09:50) Differences between models (15:46) Sponsor - Brave Search API | Shopify (20:10) Knowledge Graphs (24:30) Shift to philosophical discussion (27:40) GPT Store (30:28) Sponsor - NetSuite | Omneky (35:40) Eastern Philosophy and Identity (36:22) How different societies will relate to Ai (37:00) Appreciate how much philosophy is embedded into language (39:03) Japan's policy towards AI and individual privacy (40:15) Eastern philosophy view of the brain  (40:51) AI is a tool much like real intelligence (42:20) AI in China (42:46) Collective, extended cognition (44:10) Emergence in ants (44:51) Language model performance in different languages (47:06) Nationalism and AI (48:31) Tokenization, unicode, and cost structure between languages (56:54) Accepting, not understanding (59:24) AI bridging connection

In this episode, Nathan sits down with Sander Schulhoff, Cofounder and CEO of Learnprompting.org. They discuss the business model, the keys to prompting that every user of language models should know, negative prompting, prompt hacking, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: - Learnprompting.org: https://learnprompting.org/ - Learnprompting.org Prompt Hacking: https://learnprompting.org/docs/category/-prompt-hacking - Ignore This Title and Hackaprompt: https://arxiv.org/abs/2311.16119 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @SanderSchulhoff @learnprompting @CogRev_Podcast TIMESTAMPS: (04:50) What is Learnprompting.org (06:30) Learnprompting.org's adoption stats and the transition from open source to a business (10:21) Are we done with prompt engineering or is there more to be discovered? The key 2-3 things every user of GPT should know (19:11) The format trick (21:32) Role casting / persona prompting (24:44) Does the level of vocabulary you bring to a LM impact its performance  (26:10) Contrastive chain of thought (28:30) Language models responding well to negative instructions (32:29) Benchmarking techniques (34:00) Answer engineering (37:29) Debugging a prompt  (41:13) Sander's favourite models today Best practices for image prompting - maybe cut out (48:50) Productivity improvement with language models (51:25) Tips for coding with prompts (56:06) The current state of prompt engineering and how it'll evolve  (58:30) 2024 will be the year of agents and Sander's favourite agents (59:57) How will agents impact the future of prompt engineering  (1:04:10) How to start agent engineering (Adversarial attacks  (1:19:40) Model to model hijacking (1:25:24) Chinese character attack  (1:28:33) Taxonomy of attacks

In this episode, Nathan sits down with Suhail Doshi, founder of Playground AI. They discuss the current state of AI image generation, how Suhail is building Playground while the technology for vision and image generation is still maturing, thought to image reconstruction, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: - Playground AI: https://playgroundai.com/ SPONSORS: The Brave search API can be used to assemble a data set to train your A I models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @Suhail @CogRev_Podcast TIMESTAMPS: (00:00) Episode Preview (00:44) The current state of AI image generation (08:04) Are we currently at a GPT-2 level for image gen? (15:40) Sponsor - Brave Search API | Shopify (20:46) Shortcomings and use cases for GPT-4V (22:46) Benefits of vision vs language (28:30) Trajectory for what Playground will build next (33:28) Sponsor - NetSuite by Oracle | Omneky (34:48) How will the image generation experience change over time (40:06) Thought to image reconstruction (47:49) What if OpenAI fully focused on image (50:09) Lack of training data in vision and the use of synthetic data (51:30) Multimodal models increasing performance (55:03) Images are information rich but lack the right annotation (57:00) Building Playground while vision technology is maturing (1:03:25) What should the rules for generative AI be? (1:09:19) Parallel to the music industry and streaming for rev share (1:12:21) What are the minimum standards that AI application developers should be expected to uphold? (1:16:48) Wrap

In this episode, Nathan sits down with tech lawyer Cecilia Zeniti, Founder & CEO of GC AI, the AI for in-house counsel. They discuss the origins of IP law in the US Constitution to promote creativity, the "fair use doctrine" and how OpenAI could argue ChatGPT is transformative, Google's patenting strategy around the transformer, and much more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: GC AI: https://getgc.ai/ Cecilia's Twitter/X: https://twitter.com/CeciliaZin SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @CeciliaZin (Cecilia) @CogRev_Podcast TIMESTAMPS: (00:04:30) - Introduction to Intellectual Property law (00:07:30) - Overview of main types of intellectual property - patents, trademarks, copyrights (00:10:30) - Could Google have patented the transformer? Google’s patent strategy (00:16:30) - Claim construction and its parallel to LLMs (00:17:17) - Sponsor: Shopify (00:18:46) - Practical impact of open source on ability to enforce IP rights (00:21:47) - Litigation, internal data privacy, and communication (00:24:30) - Copyright law and fair use doctrine for transformative works (00:30:22) - Sponsor: Netsuite | Omneky (00:31:42) - Big tech company lawsuits when money starts shifting between incumbents and newcomers (00:34:10) - When judges like a technology… (00:34:57) - Scraping and LinkedIn’s suit (00:38:50) - NYTimes vs OpenAI (00:40:00) - Copyright, creators, and music industry licensing (00:42:35) - Transformative nature of work and “fair use” (00:50:29) - Limits on getting injunctions and ongoing royalties from courts (00:56:39) - Legalities of other modalities, like DALL-E images of copyrighted IP (01:01:00) - OpenAI’s opt-out for licensing on the text modality (01:03:58) - OpenAI’s weak to strong generalization (01:07:00) - Pharmaceuticals and software, AI doctors, public good balancing (01:10:40) - Why licensed professionals aren’t pushing back against AI (01:15:36) - Duty to use tools for efficiency to a client (01:17:04) - Impact of open source and ability to find someone to sue (01:20:30) - Forward-looking thoughts on what IP laws should be for AI (01:27:38) - Overview of Cecilia's company GC AI for lawyers

In this episode, Nathan sits down with Div Garg, founder of Multion, to discuss the current state and future outlook of AI agents. They discuss benchmarking real-world tasks, the promise and perils of consumer AI adoption, predictions that 2024 may be a breakout year for personal bots, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: MultiOn: https://www.multion.ai/ Part 1 with Div Garg: https://www.youtube.com/watch?v=PR2Mdlx5eik SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @divgarg9 @MultiON_AI (MultiOn) @CogRev_Podcast TIMESTAMPS: (00:00) - Episode Preview (00:06:06) - Current state of AI agents - still early with chat abilities, but logical reasoning lacking (00:12:32) - Estimated timeline for usable everyday AI agents - focused on adoption and reliability (00:17:41) - Architectures beyond language models - action transformers and process optimization (00:22:00) - Context limits of current AI models - efficient context compression is key (00:25:00 - Managing memory and knowledge retrieval in agents (00:29:40) - MultiOn's own model creation (00:30:16) - Sponsors: Netsuite | Omneky (00:49:00) - Maturing agent capabilities beyond language with planning systems (00:32:00) - Benchmarking agent capabilities on real-world website tasks (00:59:30) - Inspiration from computer OS thread scheduling and coordination (01:02:30) - Expanding agents to mobile for voice commands and authentication (01:06:47) - AI agents complementing vs substituting human roles (01:09:00) - Removing repetitive "digital chores" to change job landscapes (01:11:36) - Sourcing high-quality demonstrator data at scale (01:13:00) - Privacy protections when collecting user data

In this episode, Nathan sits down with Juan Sequeda, Principal Scientist and Head of AI Lab at data.world. They discuss how knowledge graphs can be your organization's "brain" for AI, integrating structured and unstructured data, benchmarking enterprise AI systems, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- LINKS: Data.world: https://data.world/ SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @juansequeda (Juan) @datadotworld (data.world) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Introduction to Juan Sequeda and data.world (00:01:11) - Discussion on data and generative ai (00:06:15) - Data.world's origins as an open data catalog platform ("Github for data") (00:09:35) - Using knowledge graphs and semantics to integrate and query data (00:12:52) - Main use cases for data catalogs: search/discovery, governance, data operations (00:15:00) - The process of building knowledge graphs automatically from data (00:24:29) - AI for unlocking and capturing tribal business knowledge (00:34:24) - Understanding the data landscape in enterprises (00:38:32) - The emergence of knowledge engineers and data product managers (00:40:44) - The consumer experience in data.world (00:45:36) - The importance of context in data analysis (00:46:58) - The role of AI in improving data analysis (00:48:08) - The importance of accuracy and explainability in data analysis (00:50:08) - Question cataloging in data analysis (00:51:44) - The future potential of "chat with your data" interfaces (01:18:02) - Finetuning with data vs metadata (01:29:24) - Future of enterprise data teams

In this episode, Nathan sits down with Gabe Gomes, Assistant Professor at Carnegie Mellon University, and researcher behind Coscientist: the first non-organic, intelligent being to design, plan, and execute a chemistry experiment. They discuss how Coscientist allows scientists to use natural language to control remote experiments on Emerald Cloud Lab, how it will democratize scientific knowledge, and accelerate the pace of research. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. TIMESTAMPS: (00:00:00) - Episode Intro (00:05:00) - Introduction Gabe Gomes, his research (00:15:02) - Emerald Cloud Labs for remote chemical experimentation (00:15:18) - Sponsor: Shopify (00:22:40) - How AI is addressing the pain point of chemistry research (00:29:12) - Sponsors: Netsuite | Omneky (00:31:00) - Democratizing science and access to chemistry techniques (00:38:00) - Modular CoScientist architecture (00:46:00) - The power of CoScientist to address more than just chemistry (01:17:00) - The explosion of the context window (01:30:00) - AI Safety (01:45:00) - How is Copilot already helping expedite chemistry and scientific research?

In this episode, Nathan sits down with Dan O’Connell, Chief Strategy Officer at Dialpad. They discuss building their own language models using 5 billion minutes of business calls, custom speech recognition models for every customer, and the challenges of bringing AI into business. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today, Shane Legg, Cofounder at Deepmind and its current Chief AGI Scientist, shares his insights with Dwarkesh Patel on AGI's timeline, the new architectures needed for AGI, and why multimodality will be the next big landmark. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @dialdoc (Dan) @dialpad @CogRev_Podcast (Cognitive Revolution)

We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today, Shane Legg, Cofounder at Deepmind and its current Chief AGI Scientist, shares his insights with Dwarkesh Patel on AGI's timeline, the new architectures needed for AGI, and why multimodality will be the next big landmark. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. You can subscribe to The Dwarkesh Podcast here: https://www.youtube.com/@DwarkeshPatel We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @dwarkesh_sp (Dwarkesh) @shanelegg (Shane) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00:00) - Episode Preview with Nathan’s Intro (00:02:45) - Conversation with Dwarkesh and Shane begins (00:14:26) - Do we need new architectures? (00:17:31) - Sponsors: Shopify  (00:19:40) - Is search needed for creativity? (00:31:46) - Impact of Deepmind on safety vs capabilities (00:32:48) - Sponsors: Netsuite | Omneky (00:37:10) - Timelines (00:45:18) - Multimodality

We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today: Nita Farahani shares her insights with 80,000 Hours' Luisa Rodriguez on the current state of neurotechnology and its potential impacts on various fields, including work, healthcare, privacy, and even human cognition. The discussion includes Farahani's assessment of devices like SmartCap and Neuralink, the concept of cognitive liberty, the risks of the technology, and the need for proper regulation and ethical considerations. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Nita Farahany is a professor of law and philosophy at Duke Law School and discusses the applications of cutting-edge neurotechnology. You can subscribe to The 80,000 Hours Podcast here: https://80000hours.org/podcast/ --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @8000hours (The 8000 Hours podcast) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00) Nathan intro's this episode with Nita Farahany (03:26) The Future of Neurotechnology: From Neuralink to Meta (05:40) The Potential of Brain-Computer Interfaces in Military Applications (07:27) The Future of Neurotechnology in Security and Surveillance (11:29) The Role of Neurotechnology in National Security (15:20) SPONSORS: SHOPIFY | NETSUITE (18:14) The Potential of Brain-Computer Interfaces in Communication and Data Transfer (21:19) The Future of Super Soldiers and Brain-Controlled Drones (32:20) SPONSORS: OMNEKY (41:05) The Controversial Realm of Neurotechnology Weapons (45:16) Ideal International Agreements for Weapon Regulation (46:53) Potential Risks of Military Applications of Neurotechnology (47:01) The Threat of Hacking in Neurotechnology (50:36) Brain Signatures for Identification (01:11:28) The Future of Neurotechnology in the Workplace (01:24:59) The Intrusion of Brain Decoding into Personal Relationships (01:27:36) The Implications of Mind Reading and Brain Transparency (01:30:00) Regulating Brain Decoding: A Call for a Change in Worldview (01:32:22) The Potential of Neuralink in Therapeutic Applications (01:38:03) The Impact of Neurotechnology on Identity and Self-Perception (01:41:47) The Future of Cognitive Enhancement and Transhumanism (01:46:21) The Role of Neurotechnology in Addressing Neurological Diseases (01:51:04) The Dark Side of Neurotechnology: Hacking and Manipulation (01:54:50) The Importance of Cognitive Liberty in Neurotechnology (01:55:15) The Future of Neurotechnology: Best and Worst Case Scenarios

In today's conversation, Nathan joins Rob Wiblin, host of The 80,000 Hours podcast to discuss why we need more AI scouts, OpenAI's safety record, and redteaming frontier models. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive MasterClass https://masterclass.com/cognitive get two memberships for the price of 1 Learn from the best to become your best. Learn how to negotiate a raise with Chris Voss or manage your relationships with Esther Perel. Boost your confidence and find practical takeaways you can apply to your life and at work. If you own a business or are a team leader, use MasterClass to empower and create future-ready employees and leaders. Moment of Zen listeners will get two memberships for the price of one at https://masterclass.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @robertwiblin (Robert) @CogRev_Podcast LINKS: 80,000 Hours Episode Show Notes: https://80000hours.org/podcast/episodes/nathan-labenz-openai-red-team-safety/ TIMESTAMPS: (00:00:00) - Episode Preview (00:05:12) - Rob’s intro (00:10:50) - Interview begins (00:15:50) - Intro toThe Cognitive Revolution excerpt (00:19:13) - Excerpt from The Cognitive Revolution: Nathan’s narrative (01:22:10) - Why it’s hard to imagine a much better game board (01:28:14) - What OpenAI has been doing right (01:40:12) - Arms racing and China (01:46:10) - OpenAI’s single-minded focus on AGI (01:56:55) - Transparency about capabilities (02:05:56) - Benefits of releasing models (02:17:14) - Was it ok to release GPT-4? (02:35:31) - Why no statement from the OpenAI board (02:55:59) - Ezra Klein on the OpenAI story (03:16:59) - The upside of AI merits taking some risk (03:31:44) - Meta and open source (03:42:26) - Nathan’s journey into the AI world (03:48:18) - Rob’s outro

In this episode, Marius Hobbhahn, CEO of Apollo Research, sits down with Nathan Labenz to discuss Apollo’s research in AI deception, interpretability, and affordances. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive MasterClass https://masterclass.com/cognitive get two memberships for the price of 1 Learn from the best to become your best. Learn how to negotiate a raise with Chris Voss or manage your relationships with Esther Perel. Boost your confidence and find practical takeaways you can apply to your life and at work. If you own a business or are a team leader, use MasterClass to empower and create future-ready employees and leaders. Moment of Zen listeners will get two memberships for the price of one at https://masterclass.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @MariusHobbhahn (Marius) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Preview (00:05:40) - Understanding the Role of Apollo Research  (00:08:02) - The Evolution of AI Safety (00:11:30) - Apollo’s Framework (00:15:10) - Sponsors: Shopify  (00:16:49) - Understanding AI Affordances and Resulting Interactions in the World (00:31:00) - Sponsors: Omneky (00:39:00) - Interpretability and deceptive alignment  (00:45:55) - Why might deception arise in the first place? (00:47:46) - Understanding deceptive alignment  (00:57:49) - New Architectures (01:02:23) - Interpretability at deployment phase (01:03:35) - Deception in AI | A Case Study (01:09:03) - Deceptive AI Stock Trader (01:18:51) - Impact of discouragement on unethical AI behaviour (01:19:45) - Giving the AI a Reasoning Scratchpad and Impact on Deception (01:21:06) - Double-edged sword of removing the scratchpad (01:23:00) - Analyzing impact of model size on insider training  (01:28:00) - Challenges and necessity of 3rd Party Auditing (01:31:00) - Role of government in regulation  (01:52:17) - How can individuals get involved in red teaming?

Balaji Srinivasan, investor, former CTO at Coinbase and GP at a16z, and writer of The Network State, joins Nathan to discuss polytheistic AI and AI gods, human-AI symbiosis, how AI will be controlled, and much more. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @balajis (Balaji) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00) - Episode Preview (00:06:07) - Evolution of AI Systems (00:09:39) - Challenges of AI Robustness (00:29:54) - Intersection of AI and Politics (00:52:14) - Regulation (00:52:44) - Slippery slope of precedent setting (00:54:00) - Role of AI in political chaos (00:54:41) - Emergence of decentralized AI (01:05:39) - AI's future as amplified intelligence (01:1300) - Polytheistic model of AI (01:32:00) - Role of AI in Habitat Degradation (01:33:32) - AI's ability to do differential diagnosis (01:34:04) - ABC of economic apocalypse: AI, Bitcoin, China (01:36:00) - Evolution of AI in chess and medicine (01:38:22) - Difference between AI existential threat and economic disruption (01:40:19) - Impact of cryptography on public infrastructure (02:07:40) - Role of tribalism in AI

In this episode, Nathan chats with Josh Albrecht, CTO of Imbue. They discuss how to create agents for reasoning, reliability, and robustness. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.  RECOMMENDED PODCAST: Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://www.youtube.com/@TheRiffPodcast SPONSORS:  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive MasterClass https://masterclass.com/zen get two memberships for the price of 1 Learn from the best to become your best. Learn how to negotiate a raise with Chris Voss or manage your relationships with Esther Perel. Boost your confidence and find practical takeaways you can apply to your life and at work. If you own a business or are a team leader, use MasterClass to empower and create future-ready employees and leaders. Moment of Zen listeners will get two memberships for the price of one at https://masterclass.com/zen Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) – Episode Preview (00:07:14) – What does it mean to be a research company? (00:10:25) – How is the reasoning landscape these days and how might it evolve? (00:11:03) – Data quality is highly important (00:21:15) – What’s the difference between good features and a good world model? (00:27:31) – The impact of new modalities on reasoning (00:29:15) – How much can reasoning and knowledge be separated? (00:45:13) – Imbue demo and are they building their own LLMs or using others? (00:49:37) – Does Imbue have a deal with Nvidia? (00:57:48) – Carbs framework (01:12:57) – Imbue’s involvement with policy and and AI safety (01:16:23) – Takeaways from AI Safety Summit and Biden’s Order

In this episode, Nathan chats with Guillermo Rauch, CEO of Vercel, to discuss how AI might shape the future of code, software 2.0, and the open source question in AI. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @rauchg (Guillermo) @CogRev_Podcast TIMESTAMPS (00:00:00) - Introductory comments (00:03:43) - Rauch's background in open source software like Mootools and Next.js (00:04:27) - Overview of Vercel and the front-end cloud concept (00:06:15) - Productivity gains from Vercel's front-end infrastructure (00:14:50) - Sponsors: Shopify | Omneky (00:21:00) - Rauch getting inspired by GitHub Copilot code auto-completion (00:24:00) - Launching Vercel's own AI product vZero: production-ready UI code from natural language prompts (00:29:17) - Sponsors: Oracle | Netsuite (00:30:00) - Transition to discussing the future of software development (00:34:12) - vZero surpassing Rauch's own hand-coded website on accessibility (00:51:00) - Discussion about focusing on the full stack beyond just the AI model (00:54:00) - Concept of Software 2.0 using data and AI instead of classical code (00:56:00) - Maintaining software 1.0 while aggressively expanding into 2.0 paradigm (00:56:12) - Philosophical support for open source and skepticism about risks (00:57:12) - How open source software tends to quickly improve over time (00:57:47) - Prediction that AI may "ossify" existing software 1.0 technologies (01:01:12) - AI enabling more grassroots innovation like Mark Zuckerberg originally did (01:07:00) - Concerns about regulatory suppression of open source AI progress (01:03:00) - Unpredictability of new risks that could emerge like impersonation (01:11:00) - Rejecting AI doom narratives but staying vigilant on capabilities (01:12:00) - Concluding thoughts on embracing AI progress with appropriate caution

Nathan shares his perspective on Sam Altman’s firing from OpenAI, after being a part of the red team for GPT-4 and seeing how the board handled safety concerns. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.  This is a developing story. This podcast was recorded on 11/21 at 12pm PST. SPONSORS:  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries. From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: 00:00:00) - Preview (00:03:00) - Getting early access to test GPT-4 (00:05:38) - Realizing the immense capabilities and lack of safety measures in GPT-4 (00:08:03) - Concerns over OpenAI's slow start on safety after testing GPT-4 (00:15:38) - Sponsors: Shopify | Omneky (00:17:34) - GPT-4's lack of safety measures and willingness to provide harmful information (00:18:20) - GPT-4 suggesting assassination to slow AI progress (00:21:00) - OpenAI unable to provide details on plans to control future models (00:23:00) - The failure of GPT-4's "safety edition" to properly constrain unsafe behavior (00:29:00) - Sponsors: Netsuite | Oracle (00:29:39) - Discussing concerns over GPT-4 capabilities with AI experts and leaders (00:33:00) - An OpenAI board member not having tried GPT-4 despite its importance (00:35:00) - Urging the board member to investigate the divergence between capabilities and controls (00:36:00) - Getting removed from the GPT-4 testing program by OpenAI (00:44:00) - OpenAI subsequently showing more seriousness on safety after the GPT-4 experience (00:54:00) - An example safety issue in GPT-4 that still persists (01:00:00) - Speculation on what may have triggered the OpenAI board's removal of Sam Altman as CEO (01:06:00) - Altman's "quaint" remark and acknowledgement of GPT-5 training (01:21:57) - The absence of explanation from the board (01:23:56) - How Microsoft will emerge (01:28:00) - Questioning if pursuing AGI should be the singular goal (01:32:36) - Should OpenAI be open source? (01:42:00) - Innane regulation of AI  The Cognitive Revolution is brought to you by the Turpentine Media network.  Producer: Vivian Meng Executive Producers: Natalie Toren, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email [email protected]

In this episode, Nathan and Erik discuss research out of Google Deepmind suggesting LLMs, Hemant Teneja’s responsible VC commitments, and why now is not the time for an ideological war on AI regulation. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.  RECOMMENDED PODCAST: Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://link.chtbl.com/theriff SPONSORS:  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Opening discussion of recent viral tweet claiming LLMs can't generalize (00:03:27) - Waymo Safety Research  (00:07:09) - Use of GPT-4V for medicine (00:10:12) - Response to Google Deepmind’s research claiming LLMs can’t generalize (00:15:08) - Sponsors: Shopify | Omneky  (00:21:38) - Reproduction of the DeepMind research showing noise allows generalization (00:26:02) - Helen of Transforrmers  (00:30:15) - Sponsors: Oracle | Netsuite (00:32:36) - Continuation of Google Deepmind discussion (00:36:49) - Google Med-PaLM LLM resulting in novel insights  (00:42:47) - “The AI Executive Order will only continue to look more foolish from here”  (00:44:09) - The AI Scout mindset (00:45:22) - Few humans can extrapolate beyond their training data (00:48:45) - When does GPT-4 deceive its user?  (00:49:58) - Voluntary Responsible AI Commitments from VCs  (00:54:00) - Analysis of the commitments as basic common sense practices (00:56:30) - No need for an ideological war  (00:57:00) - Discussion of critical reactions framing the commitments as capitulation (01:00:00) - Concerns about the voluntary commitments enabling harmful regulation (01:03:00) - Rebuttal that self-regulation can avoid heavy handed regulation  (01:08:00) - Self driving cars: the invisible lives you can save (01:11:00) - Mysticism when it comes to AI (01:12:03) - Suggestion that product liability law could address concerns (01:15:00) - Challenge to defend rejecting product liability for AI systems

In this episode, Flo Crivello, founder of Lindy AI, joins Nathan to chat about Biden’s executive order, and the state of AI safety. They discuss Flo’s thoughts on the executive order, building AGI kill switches, self driving cars, and more. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: Oracle | Netsuite | Omneky With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: NVIDIA’s Eureka: https://blogs.nvidia.com/blog/2023/10/20/eureka-robotics-research/ X/SOCIAL:@labenz (Nathan) @Altimor (Flo) @CogRev_Podcast TIMESTAMPS: (00:00) Episode Preview (00:06:42) The natural order of technological progress (00:07:00) Self driving cars (00:10:57) Where is Flo accelerationist? (00:12:34) Artificial intelligence as a new form of life (00:17:08) - Sponsors: Oracle | Omneky (00:18:05) Silicon-based intelligence vs carbon-based intelligence (00:24:36) Executive Order (00:29:32) How would a GPU kill switch work? (00:31:24) “Let’s not regulate model development, but applications” (00:32:08) - Sponsor: Netsuite (00:36:00) GPT-4 is the most critical component for AGI (00:38:00) AGI in 2-8 years (00:39:26) Eureka moment from a general system (00:48:00) AI research with China (00:52:00) Does AI have subjective experience? The Mu response The Cognitive Revolution is brought to you by the Turpentine Media network. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email [email protected]

Mark Humphries is a Professor of History at Wilfrid Laurier University, where he has published widely on various aspects of Canadian history. We invited Mark to do an episode after he reached out to tell us that hearing about how Nathan fine-tuned GPT-3.5 on GPT-4 reasoning helped him get over some hurdles in his own archival research. In addition, he chats about all the things that he'd tried that hadn't worked, and in the process proved himself to be one of the world's leading adopters of AI technology in the field of history. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: Mark’s Substack, Generative History: https://generativehistory.substack.com/ X/SOCIAL: @labenz @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Preview (00:03:00) - The state of AI in history before recent advances like GPT-3 (00:06:00) - Mark's background and how he first got interested in AI (00:09:00) - Using AI to process and search through vast amounts of archival material (00:12:00) - The challenges of digitizing and searching handwritten historical documents (00:15:00) - The massive scale of undiscovered archival material that could be processed by AI (00:18:00) - How AI can help historians process more archival material than ever before (00:20:11) - Sponsors: Netsuite | Omneky (00:21:00) - Limitations on using commercial APIs for private archival documents (00:24:00) - The cost of processing archival documents compared to hiring human transcribers (00:27:00) - Comparing GPT's ability to transcribe historical handwriting vs more recent scripts (00:33:00) - Tracing individuals through complex fur trade records using AI (00:36:00) - Mark's approach to fine-tuning models for specific historical tasks (00:39:00) - Challenges teaching AI models the nuances of historical writing (00:42:00) - Privacy issues limiting the use of commercial APIs on restricted archival material (00:45:00) - The gap between people's expectations of AI and what it can really do right now (00:51:00) - Adapting assignments and student expectations to AI's current capabilities (00:52:28) - Using chain of thought prompting to teach models precise historical tasks (00:52:46) - Getting high accuracy on keyword tagging of archival documents using fine-tuning (00:57:00) - Mark has crossed the threshold from promise to accelerating archival research (01:00:00) - How to frame classification tasks to get the most value from AI models (01:03:00) - Teaching AI models to pronounce tricky historical names and terms (01:06:19) - Mark's experience using AI in the classroom over two semesters (01:09:00) - Assignments that are better suited to the current strengths and weaknesses of AI (01:11:45) - AI progress in education is lagging due to lack of institutional adoption (01:12:00) - The trajectory of AI capabilities and the need for humans to exceed the model baseline (01:27:49) - Lessons from history on economic transitions and the social contract The Cognitive Revolution is brought to you by the Turpentine Media network. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email [email protected]

In this episode, Yohei Nakajima, creator of BabyAGI and GP at Untapped Capital, chats with Nathan about the opportunity for AI to strengthen human understanding, AI agents, and his insights on investing in AI projects. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: BabyAGI: https://github.com/yoheinakajima/babyagi Yohei's site: https://yoheinakajima.com/ X/SOCIAL @labenz (Nathan) @yoheinakajima (Yohei) @CogRev_Podcast TIMESTAMPS: (00:10:59) - A large part of AI is trying to map human cognitive processes onto our software stack (00:11:14) - Yohei’s TED AI talk: the opportunity for AI to strengthen human understanding (00:13:29) - Yohei's journey to build AI projects and building in public  (00:14:04) - Yohei's lifelong interest in building tools and automating workflows for efficiency (00:16:29) - Sponsors: Netsuite | Omneky  (00:22:05) - Building projects as a fun and exploratory practice  (00:23:53) - Single use software (00:24:18) - Yohei’s home assessment price contesting project  (00:24:58) - The origins of BabyAGI as an autonomous startup founder prototype (00:27:44) - Create as many paper clips as possible  (00:30:10) - Thoughts on going all in on a project and turning it into a company vs pursuing it on the side  (00:33:00) - Forking different versions of Baby AGI based on animal names (00:34:24) - Yohei’s learnings about agents after iterating on six versions of Baby AGI  (00:36:24) - Yohei’s thoughts on generalist agents (00:37:28) - Replit (00:40:54) - Begin exploring AI automation with tasks you wish you had time for, not critical workflows (00:42:32) - Automating outbound sales and recruiting workflows with AI (00:46:19) - Where should people start learning about AI agents? (00:48:23) - Will agents come online with GPT-4V? (00:52:40) - The unique moment where both executives and engineers both want to implement AI (00:54:59) - AI layers: hardware, software, tooling  (00:57:20) - Taxonomy of AI business models  (01:10:47) - Designing AI to provide value for senior citizens (01:15:14) - The responsibility to nudge people positively with influential AI assistants (01:19:24) - Advice on when and how startups should build in public (01:22:24) - Perspective on existential risk from AI vs. its potential benefits (01:15:30) - Responsibility to handle AI-human emotional connections well  (01:19:24) - Advice on when and how startups should build in public (01:22:24) - Perspective on existential risk from AI vs. its potential benefits The Cognitive Revolution is brought to you by the Turpentine Media network.  Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email [email protected]

Anton Troynikov, cofounder of Chroma, joins Nathan Labenz to discuss the importance of keeping the retrieval-augmented generation (RAG) loop in house, what it means for Chroma to be in “wartime” mode right now, and how much of the data going into Chroma has never been in a database before. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: Part 1 with Anton: https://youtu.be/ogy37CdIljg X/SOCIAL: @labenz (Nathan) @atroyn (Anton) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Introduction by Nathan, setting up the conversation with Anton (00:02:16) - Anton articulates Chroma's mission to build a horizontally scalable system (00:03:06) - Rise in popularity of retrieval-augmented generation (RAG) (00:05:00) - Anton explains what it means for Chroma to be in "wartime" mode right now (00:06:03) - Chroma's focus on delivering a horizontally scalable cloud service for vector search and storage (00:08:07) - Nathan describes his experience building a RAG application for a client profiling use case (00:10:27) - Anton advises measuring retrieval quality and maximizing relevant information returned (00:15:05) - Sponsors: Netsuite | Omneky (00:17:02) - Popular use of open source vs. proprietary embedding models like Anthropic's Ada (00:19:30) - The importance of keeping the RAG loop in house and not relying solely on external APIs (00:23:31) - Approaches for adapting the embedding space based on user feedback (00:27:41) - The huge amount of unstructured data that can now be processed by AI (00:30:40) - Providing a unified interface to structured and unstructured data (00:31:21) - Chroma's plans to bring more intelligence into the data layer (00:32:13) - Analogies to Salesforce and Oracle in enterprise software partnerships (00:33:15) - Much of the data going into Chroma has never been in a database before (00:38:47) - Categories of organizations adapting to AI: legacy, AI-native, and AI-first (00:40:55) - Where Chroma is seeing most of its growth right now (00:42:48) - Retrieval as an important component for developing good agents (00:46:20) - Interpretability work like Anthropic's circuit evaluation (00:52:23) - Anton believes new tooling can make latent spaces accessible without AI expertise (01:03:32) - Thinking of data as a control loop rather than static (01:06:08) - Scaling constraints between search indexes vs. application databases (01:09:10) - Potential for time as a dimension in embedding spaces (01:10:55) - Language models discovering implicit representations of time and space (01:13:46) - Likelihood of missing results due to representational issues vs. approximate nearest neighbor (01:15:22) - Automatically handling small data sets without needing elaborate indexing (01:16:11) - Partnerships with AI labs to mutually reinforce RAG applications (01:17:20) - Anton's perspective on whether OpenAI will build its own database (01:19:43) - Partnering with OpenAI and other labs to increase use of their models (01:21:19) - Anton's experiments probing GPT's reasoning abilities with Game of Life (01:25:41) - Closing thoughts on the conversation

Trey Kollmer returns to discuss the latest AI research revelations with Nathan Labenz. They explore how new techniques will shave 10% off global compute needs, how analogical prompting beats few-shot prompting, and how compressive historical records can increase LLM memory and retention abilities. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: 🎬 The show outline: https://docs.google.com/document/d/1oiSu9X4EVNMf90aRnk4mrfogSmq3QUsRg4GtI95mMCw/edit Think Before You Speak: https://browse.arxiv.org/pdf/2310.02226.pdf SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with Backtracking: https://arxiv.org/pdf/2306.05426.pdf StreamingLLMs: https://arxiv.org/abs/2309.17453 Large Language Models as Analogical Reasoners: https://arxiv.org/abs/2310.01714 Ring Attention: https://arxiv.org/abs/2310.01889 TIMESTAMPS: (00:00:00) - Episode Preview (00:01:11) - Paper: Think Before You Speak (00:03:13) - Multimodal models for combining vision and language (00:04:19) - Backspace Paper (00:06:25) - Chain of thought prompting for step-by-step reasoning (00:09:14) - Backspacing in language models to correct mistakes (00:12:05) - Attention sinks for expanding context length (0012:41) - Paper: Large Language Models as Analogical Reasoners (00:15:24) - Pause tokens for language models to "think" (00:18:23) - Analogical prompting to recall relevant examples (00:20:52) - Long context windows for language models (00:23:20) - Markdown works best for OpenAI (00:24:23) - Ring attention to break memory constraints (00:26:15) - Paper: StreamingLLMs (00:27:46) - Potential for superhuman performance with longer contexts (00:31:01) - Dynamic context window adjustment at runtime (00:33:53) - Retention and memory capabilities for transformers (00:37:12) - Planning algorithms combined with memory and scale (00:39:49) - Paper: Ring Attention (00:42:35) - Executive assistant prompting and critique (00:45:23) - Self-RAG for language models to find own examples (00:48:02) - Timelines and predictions for future capabilities (00:50:37) - Applications like analyzing long texts and scripts (00:53:15) - Local versus global attention in transformers (00:55:59) - Architectural changes versus just training adjustments (00:58:41) - Pre-training strategies like random start points

In this episode, Nathan is joined by James Yu, Founder of Sudowrite, an AI writing tool.They discuss how James started Sudowrite after using GPT-3 for his own fiction writing, how Sudowrite is able to be a supportive writing partner, and Yu's experience developing its tech stack and working through the backlash he's received. f you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Subscribe to the show Substack to join future conversations and submit questions to upcoming guests! https://cognitiverevolution.substack.com/ SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: Sudowrite: https://www.sudowrite.com/ X: @jamesjyu (James) @labenz (Nathan) @eriktorenberg @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Preview (00:04:28)– How James started using GPT-3 for fiction writing in early beta (00:06:24) – Working within the constraints of the small context window in early GPT models (00:08:47) - Using few-shot learning to get good results from early GPT-3 (00:10:25) – Focusing messaging on being a supportive AI writing partner (00:12:08) – Helping fiction writers feel less lonely through pseudo-conversations with AI (00:16:01) - Sponsors: Netsuite | Omneky (00:17:22) - Evolving from paragraph-level assistance to full story understanding (00:20:19) - Building the product for centaurs: half Human, half AI (00:21:50) - Trying to create an "IDE" for fiction writing to reduce repetitive work (00:32:15) - Using multiple models together to "kitbash" the best outputs (00:39:21) - Iterating on prompts over time to get a customized "garden" (00:45:18) - Keeping temperature high for creative writing, but avoiding cliches (00:54:21) - Separate paths for professional writers vs casual creators (00:55:06) - The future of mass-customized and personalized media (00:57:30) – The continued role of human-centric art and culture (01:00:10) - The potential for automation to replace repetitive jobs (01:07:48) - Yu’s experience launching an AI writing tool and the backlash he received (01:16:24). - Advice for future AI product launches to avoid or minimize backlash (01:17:17) - Sudowrite's funding and team (01:18:25) - Focusing on delivering value to customers during controversy (01:22:00) - Monetization challenges for AI startups and the role of churn (01:28:44) - The idea of an "AI bundle" to reduce churn and customer acquisition costs (01:42:06) - Recommendations for underrated AI apps - Claude, Pika, Midjourney The Cognitive Revolution is brought to you by the Turpentine Media network. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email [email protected]

In this episode, Aravind Srinivas of Perplexity AI returns to the show. They discuss Perplexity’s growth to millions of queries per day, CEO Aravind’s favourite Perplexity use cases, and how Perplexity ships fast in a competitive landscape against Google and major AI live players creating their own search engines. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X: @labenz (Nathan) @AravSrinivas (Aravind) @eriktorenberg (Erik) @cogrev_podcast  LINKS: - Perplexity AI: https://www.perplexity.ai/ - Part 1 with Aravind: https://www.youtube.com/watch?v=YSYQZZu4MEM TIMESTAMPS: (00:00:00) - Episode Preview (00:01:12) - Introducing Aravind Srinivas and Perplexity AI (00:05:05) - Perplexity's growth to millions of queries per day (00:06:21) - Perplexity's retention and market share vs. ChatGPT (00:08:32) - Improving reliability, speed, accuracy, and new features (00:10:33) - Getting to daily usage from weekly usage (00:13:21) - Aravind's favorite Perplexity use cases (00:18:34) - Issues with lack of sufficient web coverage for hard queries (00:18:38) - Sponsors: Netsuite | Omneky (00:23:13) - Building their own search index and models for self-sufficiency (00:26:29) - Using their own index vs real-time web queries (00:28:43) - Integrating default search and Copilot companion experiences (00:31:49) - Training their own models as the only viable long-term option (00:36:56) - The web becoming more like an API accessed via AI assistants (00:41:23) - Not trying to copy Google's business model (00:44:36) - Spending more on compute than people to get scale efficiencies (00:49:35) - Replacing all parts of the stack with their own proprietary versions (00:53:59) - Shipping fast out of necessity in a competitive war zone (00:58:00) - AI assistants becoming a significant part of human digital activity The Cognitive Revolution is brought to you by the Turpentine Media network.  Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email [email protected]

In this episode, Nathan sits down with Jon Noronha, co-founder of Gamma. Gamma is a new medium for presenting ideas, allowing you to focus on your ideas and receive beautiful, engaging content without the formatting work. In this episode, Jon and Nathan discuss the journey of building Gamma, how to coax AI to do things well, and the opportunity for AI A/B testing. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive TIMESTAMPS: (00:00:00) - Preview (00:01:23) - Nathan introduces Jon Noronha (00:06:36) - Intro - Jon Noronha introduces himself and Gamma (00:09:36) - Gamma's origin story: building the "anti-PowerPoint" pre-GPT-3 (00:13:15) - From using AI for onboarding to generating near-complete presentations. (00:15:11) - Sponsors: Netsuite | Omneky (00:18:01) - If Notion and Canva had a baby (00:23:35) - Searching for the right structure for AI, landing on HTML (00:28:16) - Degrees of freedom - developing a constrained vocabulary of semantic blocks (00:29:30) - Choice of model(s) – weighing cost, speed, and quality tradeoffs (00:35:18) - Editing UI - getting AI to edit slides per user command (00:38:04) - UI for gathering training data - following Midjourney's example (00:40:00) AI A/B Testing: a big opportunity space (00:43:22) - Image generation models - Baseten and Gamma's deployment of it (00:45:37) - Pacing feature development - Trying to stay ahead of innovations like 3D, video, voice etc. (00:47:45) Image generation for slidedecks and AI involvement (00:50:29) Gamma's main building priorities and AI generated websites (00:52:34) - Competing with giants like Microsoft and Google (00:55:04) - Enterprise AI shipping challenges - Startups pioneer new patterns; giants will eventually follow. (00:57:45) - Simplifying complexity - will models smooth over the complexity of bloated product suites? (00:59:22) - Conclusion and final thoughts X/TWITTER: @thatsjonsense (Jon) @labenz (Nathan) @eriktorenberg @CogRev_Podcast LINKS: Gamma: https://gamma.app/ SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.

Nathan Labenz sits down with Lili Yu, a researcher of Meta AI to discuss the paper she authored: MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. In this conversation, they discuss the architecture and breakthroughs of their research, and the opportunity to eliminate the need for tokenization. The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: www.turpentine.co LINK: MEGABYTE Paper: https://arxiv.org/pdf/2305.07185.pdf TIMESTAMPS: (00:00) Episode preview (07:41) Takeaways from Lili Yu's paper: MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers (17:00) Architecture (24:59) Embeddings (27:43) Different local models (34:23) Encoder model (36:35) Transformer Architecture (48:10) Choosing patch size (01:08) What happens when you scale up? (01:19:20) Big picture for Meta AI (01:22:57) Responsible AI (01:27:02) China and AI TWITTER: @labenz (Nathan) @liliyu_lili (Lili) @eriktorenberg (Erik) @cogrev_podcast SPONSOR: Thank you Omneky (www.omneky.com) for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM:

People have long been imagining AI assistants. Flo Crivello (founder of Teamflow) is turning that dream into a reality with the ambitious project Lindy. Flo sits down with Nathan on Lindy's announcement day to talk about this unique moment in AI, Lindy's capabilities, single-use apps, and how he sees the global impact that AI-powered employees can have on the future of work. Anyone who mentions "The Cognitive Revolution" when signing up for the Lindy beta will get priority access.  (0:00) Preview  (1:05) Sponsor: Omneky  (4:50) Flo demos Lindy (9:21) Security and user experience  (11:55) How this AI moment compares to the Industrial Revolution and single use apps  (15:00) The dream AI assistant (19:54) Competition and advantages of startups  (24:28) Cost vs Quality  (31:19) How Lindy uses user data  (32:37) Context and data injection  (28:11) Comfort with ambiguity  (43:10) Use of guardrails and trust concerns  (47:26) AI safety and edge cases  (49:16) Impact on labor markets  (50:27) Economic resilience  (52:09) Future of work  (55:49) Rapid fire questions    *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.  Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack  Websites: lindy.ai *mention "The Cognitive Revolution" when you sign up for the waitlist to get priority access*  thecognitiverevolution.ai  Twitter: @CogRev_Podcast  @labenz (Nathan)  @Altimor (Flo)

How will GPT4 change the world? How will US-China 'racing dynamics' play out and what are the implications for AI safety? Nathan Labenz was invited to record a special "emergency" episode of ChinaTalk podcast this week to discuss the implications GPT4 will have for policy, economics, and society. Thanks to Jordan Schneider of ChinaTalk, and fellow "AI justice league" guests Zvi Mowshowitz of 'Don't Worry About the Vase' and Matthew Mittelsteadt of Mercatus.    (0:00) Intro (2:09) GPT-4 emergency podcast (9:26) GPT-4 use cases (22:51) What GPT-4 can and can’t do (35:50) AI safety (45:38) OpenAI v. Anthropic  (48:54) Governments’ role in AI (55:50) AI will improve physical health and healthcare the most (59:19) Facebook’s LLaMA model (01:05:55) VR/AR (01:08:59) Concerns with GPT4 (01:15:26) GPT-5 and GPT-6 (01:18:45) Optimism in the AI revolution Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.   Twitter:@CogRev_Podcast@labenz (Nathan)@jordanschnyc (Jordan)  Websites:cognitivervolution.ai

We talked to Aravind Srinivas about competing with the tech giants, Perplexity's product philosophy and obsession with maximizing value delivered to the user per unit time, and the features that makes Perplexity unique.(0:00) Preview(1:31) Introduction & Context(08:06) Aravind’s vision for Perplexity as the world’s most truth-centric company(9:29)  Raising the average IQ of the world(12:00) Aravind’s favorite tech entrepreneur(15:12) “Anthropics” - Building your own model vs user experience(33:00) Why is perplexity free(43:00) Talking shop: Perplexity’s tech stack and speed(1:06:00) Perplexity’s stance on guardrails on search(1:19:48) Forecasting weakly general AGI: The four criteria(1:28:00) Aravind’s perspective on OpenAI and the future of AGI(1:39:00) The Cognitive Revolution’s rapid fire questions: Neuralink implant? Most used AI tools? AI hopes and fears? Twitter handles:@CogRev_Podcast@AravSrinivas (Aravind)@labenz (Nathan)@eriktorenberg (Erik) Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/ References & Shownotes:Flamingo: https://www.deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-modelDecision Transformer Paper: https://arxiv.org/abs/2106.01345Aravind on TalkRL Podcast: https://www.talkrl.com/episodes/aravind-srinivas-2Weakly General AGI Criteria: https://www.metaculus.com/questions/3479/date-weakly-general-ai-is-publicly-known/

As recently as January 2021, the challenge of "interpreting what is going on in a photograph" was considered "nowhere near solved."  Today's guests Junnan Li and Dongxu Li changed that with their publication and open-sourcing of BLIP, which delivered state-of-the-art performance on image captioning and other vision-language tasks. BLIP became the #18 most-cited AI paper of 2022, and now Junnan and Dongxu are back with BLIP-2, this time showing how small models can harness the power of existing foundation models to do multi-modal tasks. We talked to Junnan and Dongxu about their research and how they see the trend toward connector models shaping the future.Timestamps: (00:00) Preview (01:17) Sponsor (01:35) Intro (05:50) Convergence of AI techniques (07:33) Evolution of BLIP to BLIP-2 (08:12) How BLIP-2 unlocked multimodal functionality (12:43) The size, training dynamics, and optimization function of BLIP (20:15) Practical/Business applications of BLIP (29:43) Efficiency of BLIP-2 compared to other models (41:52) Two-stage pre-training (47:11) Architecture of Blip-2’s connector model (58:52) Language models as the executive function of the brain (01:07:32) Vision for an ultimate multimodal system and democratized pre-training for models (01:12:59) Useful AI tools in these researchers’ day-to-day (01:14:56) Upcoming projects   *Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.   Twitter: @CogRev_Podcast @LiJunnan0409 (Junnan Li) @DongxuLi_(Dongxu Li) @labenz (Nathan) @eriktorenberg (Erik)   Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com   Websites: Episode transcript at Cognitivervolution.ai huggingface.co/spaces/Salesforce/BLIP huggingface.co/spaces/Salesforce/BLIP2   Show Notes: - Original BLIP demo - BLIP 2 demo - BLIP is the #18 most highly-cited paper in AI - Image captioning comparison tool - Understanding images with AI - for use in language models and image generation - Image Aesthetics - Product & Model Reviews

(0:00)  Preview(1:17) Sponsor (4:00) Anton breaks down the advantages of vector databases(4:45) How embeddings have created an AI-native way to represent data(11:50) Anton identifies the watershed moment and step changes in AI(12:55) Open AI’s pricing(18:50) How chroma works(33:04) Stable Attribution and systematic bias(36:48) How latent diffusion models work(51:26) How AI is like the early days of aviation(56:01) How Disney inspired the release of Stable Attribution(59:53):Why noise can lead to generalization(1:01:04) Nathan’s KPI for The Cognitive Revolution(1:01:59) Other use cases for embedding(1:03: 19) Anton touches on the applications for biotech(1:04:35) Anton on doomerism hysteria and what actually worries him(1:11:43) - Nathan sums up a plausible doomer scenario(1:20:17)What AI tools does Anton use and why?(1:22:55) Anton’s hopes*Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.  Twitter:@CogRev_Podcast @atroyn (Anton) @labenz (Nathan) @eriktorenberg (Erik)Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack.com/ Websites: cognitivervolution.ai trychroma.com/ omneky.com  Show Notes & references: -https://same.energy/ (Beta) -Wright Brothers Bio (https://www.amazon.com/Wright-Brothers-David-McCullough/dp/1476728755) -Ajeya Cotra article in Less Wrong (https://www.lesswrong.com/posts/pRkFkzwKZ2zfa3R6H/without-specific-countermeasures-the-easiest-path-to)

(0:00) Preview of the debate (2:23) Sponsor (3:10) Flo’s take on the AI moment and AGI (5:45) Amjad’s take on the AI moment (8:03) Antonio's skepticism about transhumanism (9:10) Human tendencies color the debate about agency (11:25) The inflection point is a jump in generality (13:14) AI's effect on coding (16:57) Weakness in current models (19:18) Bounties and the future of work (21:48) Antonio's skepticism around bounties (25:00) Who will capture value, incumbents or startups? (27:26) "All knowledge work will be automated in 20 years" (30:10) Who will be the biggest beneficiaries of this shift? (31:50) What AI companies should VCs invest in? (32:26) SponsorThank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data, to generate personalized experiences at scale.  Twitter: @CogRev_Podcast @amasad (Amjad) @antoniogm (Antonio) @altimor (Flo) @dwr (Dan) @eriktorenberg (Erik) @labenz (Nathan) Subscribe to our Substack: https://cognitiverevolution.substack.com/  Websites: cognitivervolution.ai replit.com teamflowhq.com omneky.com   Show Notes & references: Eliezer Yudkowsky: https://www.lesswrong.com/posts/FKNtgZrGYwgsz3nHT/bankless-podcast-159-we-re-all-gonna-die-with-eliezer Paul Christiano: https://paulfchristiano.com/ AI Feedback: https://www.anthropic.com/constitutional.pdf  

(01:08) Sponsor(01:37) Introducing Eugenia (03:25) Replika’s controversial choice to limit erotic roleplay functionality(04:25) Eugenia's vision for Replika(05:58) Augmented Reality is the Ultimate Modality(07:52) Using Replika(13:11)  Profound stories about virtual assistants(15:55) Eugenia on why Replika is more than just a painkiller or vitamin(28:50) Replika's business model and profitability(34:12) Users want their Replika to surprise them(36:12) Why ChatGPT is not a conversational model(49:26) Eugenia's prediction for the "next Iphone of personal AI"(1:03:00) Eugenia’s AI tools/stack  (1:15:00) Eugenia comes back  to discuss Erotic Roleplay controversy (1:18:00) Replika’s first reaction to users ERP(1: 22:00) How the product evolved from 90% scripts & retrieval models(1:24:00) The definitive focus for Replika to stay in a PG13 zone(1:26:00) “Normal” evolution given sci-fi depictions of AI romances(1:30:00) Current AI ethics on sexuality(1:37:07) Response to journalists misportrayal(1:40:29) SponsorThank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale. Twitter: @CogRev_Podcast @eriktorenberg (Erik) @labenz (Nathan) @ekuyda (Eugenia)   Websites: cognitivervolution.ai https://replika.ai/

00:00 Coming Up 01:00 The Cognitive Revolution 01:20 Sponsor 01:39 Intro 02:09 Nathan’s path to AI  04:27 Founding Waymark 06:56 The future of AI is just starting  10:00 AI dramatically enhances human capabilities  10:50 Why we started The Cognitive Revolution and what to expect 14:55 Which guests will appear on the show and topics that will be discussed 18:59 Being replaced by an AI host 20:42 Unpacking the future of AI with “no new breakthroughs”  32:21 What’s underhyped and overhyped 43:46 The dangers of AI 44:51 Applying AI safely  52:19 Losing faith in technology 53:38 A new AI ecology 55:14 Facebook, Google and Open AI 58:00 Upside and downside case for AI  58:18 Sam Altman’s case for AI 01:09:25 Starting an AI company 01:18:22 Closing 01:18:46 Sponsor  Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.   Twitter: @CogRev_Podcast @eriktorenberg (Erik) @labenz (Nathan)   Websites: cognitivervolution.ai waymark.com

00:00 Intro 00:30: Image technology breakthroughs 00:45 The Cognitive Revolution 03:10 Intro to Suhail 03:43 Sponsor 07:04 Suhail’s path to AI 12:57 Suhail’s vision for Playground 17:58 Suhail’s cancellation on Twitter 19:06 AI artists are artists 20:25 Non-AI artists feel threatened by AI 26:47 Suhail on defensibility at AI companies 30:30 Playground’s product roadmap 33:01 Suhail on good design 35:55 Latent space 44:04 Building Playground with lessons learned from Mighty 53:55 Monitoring led to 2x improvement in the product 55:53 How people use Playground 1:03:48 AI is having it’s mobile moment 01:15:12 Finding, investing and building durable AI companies 01:22:06 Suhail’s kid’s best friends may be AI characters   01:23:20 AI religion 01:24:16 Conclusion   Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.   Twitter: @CogRev_Podcast @eriktorenberg (Erik) @suhail (Suhail) @labenz (Nathan)   Websites: playgroundai.com mixpanel.com  waymark.com