“How do we see the evolution of AI algorithms? I’m not sure how’s the best way to understand it, except what neural net seems to mostly do is take a massive amount of information from reality, primarily passive optical, and create a vector space, essentially compress a massive amount of photons into a vector space.”

He shared that earlier that very morning he was wondering, “Have you ever tried accessing the vector space in your mind? Like, we normally take reality just for granted in a kind of analog way. But you can actually access the vector space in your mind and understand what your mind is doing to take in all the world data.”

He explained that what we are actually doing is trying to remember the least amount of information possible. “So it’s taking a massive amount of information, filtering it down, and saying what is relevant. And then how do you create a vector space world that is a very tiny percentage of that original data. Based on that vector space representation, you make decisions.”
— Read on cleantechnica.com/2020/07/09/elon-musk-talks-tesla-ai-chip-autonomy-level-5-accessing-the-vector-space-in-your-mind-more/