143 episodes

Welcome! We engage in fascinating discussions with pre-eminent figures in the AI field. Our flagship show covers current affairs in AI, cognitive science, neuroscience and philosophy of mind with in-depth analysis. Our approach is unrivalled in terms of scope and rigour – we believe in intellectual diversity in AI, and we touch on all of the main ideas in the field with the hype surgically removed. MLST is run by Tim Scarfe, Ph.D (https://www.linkedin.com/in/ecsquizor/) and features regular appearances from MIT Doctor of Philosophy Keith Duggar (https://www.linkedin.com/in/dr-keith-duggar/).

Machine Learning Street Talk (MLST‪)‬ Machine Learning Street Talk (MLST)

    • Technology
    • 4.7 • 63 Ratings

Welcome! We engage in fascinating discussions with pre-eminent figures in the AI field. Our flagship show covers current affairs in AI, cognitive science, neuroscience and philosophy of mind with in-depth analysis. Our approach is unrivalled in terms of scope and rigour – we believe in intellectual diversity in AI, and we touch on all of the main ideas in the field with the hype surgically removed. MLST is run by Tim Scarfe, Ph.D (https://www.linkedin.com/in/ecsquizor/) and features regular appearances from MIT Doctor of Philosophy Keith Duggar (https://www.linkedin.com/in/dr-keith-duggar/).

    Can we build a generalist agent? Dr. Minqi Jiang and Dr. Marc Rigter

    Can we build a generalist agent? Dr. Minqi Jiang and Dr. Marc Rigter

    Dr. Minqi Jiang and Dr. Marc Rigter explain an innovative new method to make the intelligence of agents more general-purpose by training them to learn many worlds before their usual goal-directed training, which we call "reinforcement learning".

    Their new paper is called "Reward-free curricula for training robust world models" https://arxiv.org/pdf/2306.09205.pdf

    https://twitter.com/MinqiJiang
    https://twitter.com/MarcRigter

    Interviewer: Dr. Tim Scarfe

    Please support us on Patreon, Tim is now doing MLST full-time and taking a massive financial hit. If you love MLST and want this to continue, please show your support! In return you get access to shows very early and private discord and networking. https://patreon.com/mlst

    We are also looking for show sponsors, please get in touch if interested mlstreettalk at gmail.

    MLST Discord: https://discord.gg/machine-learning-street-talk-mlst-937356144060530778

    • 1 hr 57 min
    Prof. Nick Chater - The Language Game (Part 1)

    Prof. Nick Chater - The Language Game (Part 1)

    Nick Chater is Professor of Behavioural Science at Warwick Business School, who works on rationality and language using a range of theoretical and experimental approaches. We discuss his books The Mind is Flat, and the Language Game.



    Please support me on Patreon (this is now my main job!) - https://patreon.com/mlst - Access the private Discord, networking, and early access to content.

    MLST Discord: https://discord.gg/machine-learning-street-talk-mlst-937356144060530778

    https://twitter.com/MLStreetTalk



    Buy The Language Game:

    https://amzn.to/3SRHjPm



    Buy The Mind is Flat:

    https://amzn.to/3P3BUUC



    YT version: https://youtu.be/5cBS6COzLN4



    https://www.wbs.ac.uk/about/person/nick-chater/

    https://twitter.com/nickjchater?lang=en

    • 1 hr 43 min
    Kenneth Stanley created a new social network based on serendipity and divergence

    Kenneth Stanley created a new social network based on serendipity and divergence

    See what Sam Altman advised Kenneth when he left OpenAI! Professor Kenneth Stanley has just launched a brand new type of social network, which he calls a "Serendipity network". The idea is that you follow interests, NOT people. It's a social network without the popularity contest. We discuss the phgilosophy and technology behind the venture in great detail. The main ideas of which came from Kenneth's famous book "Why greatness cannot be planned".



    See what Sam Altman advised Kenneth when he left OpenAI! Professor Kenneth Stanley has just launched a brand new type of social network, which he calls a "Serendipity network".The idea is that you follow interests, NOT people. It's a social network without the popularity contest.


    YT version: https://www.youtube.com/watch?v=pWIrXN-yy8g



    Chapters should be baked into the MP3 file now


    MLST public Discord: https://discord.gg/machine-learning-street-talk-mlst-937356144060530778

    Please support our work on Patreon - get access to interviews months early, private Patreon, networking, exclusive content and regular calls with Tim and Keith.
    https://patreon.com/mlst

    Get Maven here:
    https://www.heymaven.com/

    Kenneth:
    https://twitter.com/kenneth0stanley
    https://www.kenstanley.net/home

    Host - Tim Scarfe:
    https://www.linkedin.com/in/ecsquizor/
    https://www.mlst.ai/

    Original MLST show with Kenneth:
    https://www.youtube.com/watch?v=lhYGXYeMq_E

    Tim explains the book more here:

    https://www.youtube.com/watch?v=wNhaz81OOqw

    • 3 hr 15 min
    Dr. Brandon Rohrer - Robotics, Creativity and Intelligence

    Dr. Brandon Rohrer - Robotics, Creativity and Intelligence

    Brandon Rohrer who obtained his Ph.D from MIT is driven by understanding algorithms ALL the way down to their nuts and bolts, so he can make them accessible to everyone by first explaining them in the way HE himself would have wanted to learn!



    Please support us on Patreon for loads of exclusive content and private Discord:

    https://patreon.com/mlst (public discord)

    https://discord.gg/aNPkGUQtc5

    https://twitter.com/MLStreetTalk



    Brandon Rohrer is a seasoned data science leader and educator with a rich background in creating robust, efficient machine learning algorithms and tools. With a Ph.D. in Mechanical Engineering from MIT, his expertise encompasses a broad spectrum of AI applications — from computer vision and natural language processing to reinforcement learning and robotics. Brandon's career has seen him in Principle-level roles at Microsoft and Facebook. An educator at heart, he also shares his knowledge through detailed tutorials, courses, and his forthcoming book, "How to Train Your Robot."



    YT version: https://www.youtube.com/watch?v=4Ps7ahonRCY



    Brandon's links:

    https://github.com/brohrer

    https://www.youtube.com/channel/UCsBKTrp45lTfHa_p49I2AEQ

    https://www.linkedin.com/in/brohrer/



    How transformers work:

    https://e2eml.school/transformers



    Brandon's End-to-End Machine Learning school courses, posts, and tutorials

    https://e2eml.school



    Free course:

    https://end-to-end-machine-learning.teachable.com/p/complete-course-library-full-end-to-end-machine-learning-catalog



    Blog: https://e2eml.school/blog.html



    Ziptie: Learning Useful Features [Brandon Rohrer]

    https://www.brandonrohrer.com/ziptie



    TOC should be baked into the MP3 file now

    00:00:00 - Intro to Brandon

    00:00:36 - RLHF

    00:01:09 - Limitations of transformers

    00:07:23 - Agency - we are all GPTs

    00:09:07 - BPE / representation bias

    00:12:00 - LLM true believers

    00:16:42 - Brandon's style of teaching

    00:19:50 - ML vs real world = Robotics

    00:29:59 - Reward shaping

    00:37:08 - No true Scotsman - when do we accept capabilities as real

    00:38:50 - Externalism

    00:43:03 - Building flexible robots

    00:45:37 - Is reward enough

    00:54:30 - Optimization curse

    00:58:15 - Collective intelligence

    01:01:51 - Intelligence + creativity

    01:13:35 - ChatGPT + Creativity

    01:25:19 - Transformers Tutorial

    • 1 hr 31 min
    Showdown Between e/acc Leader And Doomer - Connor Leahy + Beff Jezos

    Showdown Between e/acc Leader And Doomer - Connor Leahy + Beff Jezos

    The world's second-most famous AI doomer Connor Leahy sits down with Beff Jezos, the founder of the e/acc movement debating technology, AI policy, and human values. As the two discuss technology, AI safety, civilization advancement, and the future of institutions, they clash on their opposing perspectives on how we steer humanity towards a more optimal path.



    Watch behind the scenes, get early access and join the private Discord by supporting us on Patreon. We have some amazing content going up there with Max Bennett and Kenneth Stanley this week!
    https://patreon.com/mlst (public discord)
    https://discord.gg/aNPkGUQtc5
    https://twitter.com/MLStreetTalk



    Post-interview with Beff and Connor: https://www.patreon.com/posts/97905213

    Pre-interview with Connor and his colleague Dan Clothiaux: https://www.patreon.com/posts/connor-leahy-and-97631416



    Leahy, known for his critical perspectives on AI and technology, challenges Jezos on a variety of assertions related to the accelerationist movement, market dynamics, and the need for regulation in the face of rapid technological advancements. Jezos, on the other hand, provides insights into the e/acc movement's core philosophies, emphasizing growth, adaptability, and the dangers of over-legislation and centralized control in current institutions.



    Throughout the discussion, both speakers explore the concept of entropy, the role of competition in fostering innovation, and the balance needed to mediate order and chaos to ensure the prosperity and survival of civilization. They weigh up the risks and rewards of AI, the importance of maintaining a power equilibrium in society, and the significance of cultural and institutional dynamism.



    Beff Jezos (Guillaume Verdon):
    https://twitter.com/BasedBeffJezos
    https://twitter.com/GillVerd

    Connor Leahy:
    https://twitter.com/npcollapse



    YT: https://www.youtube.com/watch?v=0zxi0xSBOaQ



    TOC:

    00:00:00 - Intro

    00:03:05 - Society library reference

    00:03:35 - Debate starts

    00:05:08 - Should any tech be banned?

    00:20:39 - Leaded Gasoline

    00:28:57 - False vacuum collapse method?

    00:34:56 - What if there are dangerous aliens?

    00:36:56 - Risk tolerances

    00:39:26 - Optimizing for growth vs value

    00:52:38 - Is vs ought

    01:02:29 - AI discussion

    01:07:38 - War / global competition

    01:11:02 - Open source F16 designs

    01:20:37 - Offense vs defense

    01:28:49 - Morality / value

    01:43:34 - What would Conor do

    01:50:36 - Institutions/regulation

    02:26:41 - Competition vs. Regulation Dilemma

    02:32:50 - Existential Risks and Future Planning

    02:41:46 - Conclusion and Reflection



    Note from Tim: I baked the chapter metadata into the mp3 file this time, does that help the chapters show up in your app? Let me know. Also I accidentally exported a few minutes of dead audio at the end of the file - sorry about that just skip on when the episode finishes.

    • 3 hr
    Mahault Albarracin - Cognitive Science

    Mahault Albarracin - Cognitive Science

    Watch behind the scenes, get early access and join the private Discord by supporting us on Patreon:

    https://patreon.com/mlst (public discord)

    https://discord.gg/aNPkGUQtc5

    https://twitter.com/MLStreetTalk



    YT version: https://youtu.be/n8G50ynU0Vg



    In this interview on MLST, Dr. Tim Scarfe interviews Mahault Albarracin, who is the director of product for R&D at VERSES and also a PhD student in cognitive computing at the University of Quebec in Montreal. They discuss a range of topics related to consciousness, cognition, and machine learning.



    Throughout the conversation, they touch upon various philosophical and computational concepts such as panpsychism, computationalism, and materiality. They consider the "hard problem" of consciousness, which is the question of how and why we have subjective experiences.



    Albarracin shares her views on the controversial Integrated Information Theory and the open letter of opposition it received from the scientific community. She reflects on the nature of scientific critique and rivalry, advising caution in declaring entire fields of study as pseudoscientific.



    A substantial part of the discussion is dedicated to the topic of science itself, where Albarracin talks about thresholds between legitimate science and pseudoscience, the role of evidence, and the importance of validating scientific methods and claims.



    They touch upon language models, discussing whether they can be considered as having a "theory of mind" and the implications of assigning such properties to AI systems. Albarracin challenges the idea that there is a pure form of intelligence independent of material constraints and emphasizes the role of sociality in the development of our cognitive abilities.



    Albarracin offers her thoughts on scientific endeavors, the predictability of systems, the nature of intelligence, and the processes of learning and adaptation. She gives insights into the concept of using degeneracy as a way to increase resilience within systems and the role of maintaining a degree of redundancy or extra capacity as a buffer against unforeseen events.



    The conversation concludes with her discussing the potential benefits of collective intelligence, likening the adaptability and resilience of interconnected agent systems to those found in natural ecosystems.



    https://www.linkedin.com/in/mahault-albarracin-1742bb153/



    00:00:00 - Intro / IIT scandal

    00:05:54 - Gaydar paper / What makes good science

    00:10:51 - Language

    00:18:16 - Intelligence

    00:29:06 - X-risk

    00:40:49 - Self modelling

    00:43:56 - Anthropomorphisation

    00:46:41 - Mediation and subjectivity

    00:51:03 - Understanding

    00:56:33 - Resiliency



    Technical topics:

    1. Integrated Information Theory (IIT) - Giulio Tononi

    2. The "hard problem" of consciousness - David Chalmers

    3. Panpsychism and Computationalism in philosophy of mind

    4. Active Inference Framework - Karl Friston

    5. Theory of Mind and its computation in AI systems

    6. Noam Chomsky's views on language models and linguistics

    7. Daniel Dennett's Intentional Stance theory

    8. Collective intelligence and system resilience

    9. Redundancy and degeneracy in complex systems

    10. Michael Levin's research on bioelectricity and pattern formation

    11. The role of phenomenology in cognitive science

    • 1 hr 7 min

Customer Reviews

4.7 out of 5
63 Ratings

63 Ratings

harryoekndn ,

Super informative!

A podcast that has truly changed my life over the past three years. Phenomenal guests, impeccable ideas.

diamond bishop ,

Strong sometimes

Lots of potential and a great host usually but there are too many episodes (most recent included) where he brings on someone who does not know how to debate for a debate. Great example is that Connor keeps taking air time. It really ruins the quality and feels like a high school debate being recorded as he talks down to people and tries to “establish” hypothetical decision points. Go back to the expert discussions and depth over clickbait and you’ll have a great show.

Usability guy ,

Neel Nanda episode was fantastic

Adds to a strong catalog.

Top Podcasts In Technology

Lex Fridman Podcast
Lex Fridman
All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC
No Priors: Artificial Intelligence | Machine Learning | Technology | Startups
Conviction | Pod People
Acquired
Ben Gilbert and David Rosenthal
BG2Pod with Brad Gerstner and Bill Gurley
BG2Pod
Hard Fork
The New York Times

You Might Also Like

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Sam Charrington
Latent Space: The AI Engineer Podcast — Practitioners talking LLMs, CodeGen, Agents, Multimodality, AI UX, GPU Infra and al
Alessio + swyx
Eye On A.I.
Craig S. Smith
"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
Erik Torenberg, Nathan Labenz
Practical AI: Machine Learning, Data Science
Changelog Media
Dwarkesh Podcast
Dwarkesh Patel