151 users here now
account activity
Ilya Sutskever “If you really learn all of these, you’ll know 90% of what matters today”Resources (self.ArtificialInteligence)
submitted 7 days ago by steves1189
For all those interested, and for those interested in the more complex and technical side of machine learning/AI…
Ilya Sutskever gave John Carmack this reading list of approx 30 research papers and said, ‘If you really learn all of these, you’ll know 90% of what matters today.’
Here’s the list
[–]AutoModerator[M] [score hidden] 7 days ago stickied comment (0 children)
Please use the following guidelines in current and future posts:
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
[–]WorkingYou2280 25 points26 points27 points 6 days ago (4 children)
Well, yes, plus the 20 years of training needed to understand them. But still worth a read i think.
[–]thatmfisnotreal 8 points9 points10 points 6 days ago (1 child)
4-6 solid years of effort and you’re good
[–]YoghurtDull1466 0 points1 point2 points 5 days ago (0 children)
Teach me
[–]PsychologicalAct6813 5 points6 points7 points 6 days ago (0 children)
It's truly gobsmacking the latent hubris in this field, of all.
[–]Monarc73 12 points13 points14 points 6 days ago (12 children)
How useful is any of this though? Will I now be a haxor?
[–]GirlNumber20 13 points14 points15 points 6 days ago (6 children)
Not just a haxor but a 1337 h4x0r.
[–]GYN-k4H-Q3z-75B 11 points12 points13 points 6 days ago (3 children)
Once you understand it all, you may finally call yourself a prompt engineer on LinkedIn and be one of the cool guys.
[–]GirlNumber20 16 points17 points18 points 6 days ago (2 children)
I don’t like to brag, but I know a lot about this stuff because I’m dating a model. A language model. 💅🏻
[–]GYN-k4H-Q3z-75B 4 points5 points6 points 6 days ago (0 children)
CEO of Bumble approves. You're avantgarde.
[–]Otherkin 0 points1 point2 points 6 days ago (0 children)
Hahahahaha. Me tooo~! I'll have to remember that one!
[–]StevenAUSoong Type Positronic Brain 0 points1 point2 points 6 days ago (0 children)
This guy pwns
[–]vampyre2000 2 points3 points4 points 6 days ago (2 children)
You need to ensure you wear a black hoodie with the hood over your head and ensure the lights in the room are off when you are using your computer. Bonus points if you wear a mask at the same time. That would make you a 1337 h4x0r. Hack the Planet. Hack the Gibson.
[–]Monarc73 1 point2 points3 points 6 days ago (0 children)
Svv337!!!
[–]jgainit 1 point2 points3 points 6 days ago (0 children)
Save the cheerleader, save the world
[–]PsychologicalAct6813 1 point2 points3 points 6 days ago (0 children)
It's saddening to see everyone stuck in an industrialist education mindset. What you know does not define what you can do any more. What you want to do defines what you can do. The sooner anyone accepts this the better for them. We have created the first technology in history that empowers self efficacy. You don't need to be bright, you just have to be willing. The AI is bright for you.
[–]Metworld 5 points6 points7 points 6 days ago (1 child)
For learning about neural networks maybe, but there is so much more to AI and ML which is completely missed by this, not including all the prerequisites required to even understand those 30 papers.
[–]cunningjames 5 points6 points7 points 6 days ago (0 children)
Honestly, I find the list kind of baffling as “90% of what you need to know”. They’re good papers to read, but some of it’s out of date and there’s way more to the field. You could read all these papers and still not understand the architecture of modern LLMs, let alone AI/ML generally.
[–]Original_Finding2212 4 points5 points6 points 7 days ago (2 children)
There are less than 30 documents (26 + 1 course) there and last one is a link to a course?
What’s the source?
[–]steves1189[S] 1 point2 points3 points 7 days ago (1 child)
It was from X, I followed the source down to multiple people who were tagging John Carmack. It’s not a paid course is it? You don’t have to sign up for anything?
[–]Effective_Rabbit6325 1 point2 points3 points 6 days ago (0 children)
So no source?
[–]phovos 3 points4 points5 points 6 days ago (0 children)
did you just send me a whole browser full of tab?
That is utterly evil.. and brilliant.
Gah! I have enough of MY OWN tabs, you clever bastards!
[–]Alternative_Log3012 4 points5 points6 points 7 days ago (5 children)
I think it’s more like 29 documents actually…
[–]Equivalent_Seesaw_51 2 points3 points4 points 7 days ago (1 child)
You forget Q*
[–]Alternative_Log3012 5 points6 points7 points 7 days ago (0 children)
[–]steves1189[S] 1 point2 points3 points 7 days ago (2 children)
My bad.
[–]Alternative_Log3012 1 point2 points3 points 7 days ago (1 child)
We all make mistakes
[–]Nxt1tothree 0 points1 point2 points 6 days ago (0 children)
We all have those days
[–]Background-Fill-51 4 points5 points6 points 6 days ago (2 children)
Oh I just have to read 30 academic papers that I don’t understand to be up to date… can anyone single out an easy/entertaining one? Excuse my laziness
[–]Particular_Focus_576 2 points3 points4 points 5 days ago (1 child)
This one is useful. The trick is to refuse to move forward without understanding the paper. Stop and converse with a model till the light turns on. It may take a few hours. After though, you will be enlightened. After 4-5 papers, you'll be in a new zone. You won't be an AI research scientist, but you will be very informed relative to most.
Could be best to start with transformer architecture. The models taught me most of what I know. They can be very effective teachers, when properly prompted. I do a lot of 'so if I understand this correctly, this is how I am envisioning x, y, z'. Most of the time you hear politely... 'Sortof.' iterate off that. Ask for real world examples. Read another paper. At some point... I began to be able to parse any paper, at least as a layman. It took a long time. Dense but usually extremely well written.
https://www.reddit.com/r/OpenAI/s/zGxdH0AD4z
[–]Background-Fill-51 1 point2 points3 points 5 days ago (0 children)
Thank you so much 🥳
[–]Realistic-Duck-922 2 points3 points4 points 6 days ago (0 children)
Glad to hear Carmack is interested. He seems cool. I appreciated his honesty with VR instead of just hyping junk. AI seems a good fit for him. Id love to hear him discuss his plans.
[–]roastedantlers 1 point2 points3 points 6 days ago (0 children)
The shadows on those fonts in dark mode.
[–]fractaldesigner[🍰] 1 point2 points3 points 6 days ago (3 children)
any one book that summarizes it?
[–]Delta9SA 1 point2 points3 points 6 days ago (0 children)
One book to summarize it all..
[–]torb 1 point2 points3 points 6 days ago (1 child)
Get gpt to summarize it in one short bullet point list.
[–]gbbenner 0 points1 point2 points 6 days ago (0 children)
Funny, but this is good advice lol.
[–]lhx555 1 point2 points3 points 6 days ago (0 children)
Shall we dub it Sutskever’s 30?
[–]zascar 1 point2 points3 points 6 days ago (0 children)
Can someone give us an easy to understand summary of the key points and of each paper in one document please? That would be swell.
[–][deleted] 5 days ago (2 children)
[removed]
[–]Original_Finding2212 0 points1 point2 points 5 days ago (1 child)
Feed that to a strong model
[–]save_china_uyghurs 0 points1 point2 points 6 days ago (0 children)
Read these and you will hate Altman.
[–]PsychologicalAct6813 0 points1 point2 points 6 days ago (0 children)
So you're saying I should mash these into a vector database and make that my sidekick?
[–]RogueStargun 0 points1 point2 points 6 days ago (0 children)
He told Carmack this 3 years ago though...
[–]Azimn 0 points1 point2 points 6 days ago (0 children)
Can I feed all of these into Claude?
[–]ejpusa 0 points1 point2 points 5 days ago (0 children)
This is why organic chemist, DNA guy has it down. All the math can be translated into molecular biology scenarios.
Little math, more visualization of LLM at work.
[+]flyblackbox -1 points0 points1 point 6 days ago (0 children)
π Rendered by PID 225069 on reddit-service-r2-comment-79b6fc9c9d-sxbrh at 2024-05-18 11:56:12.849922+00:00 running 0ef9712 country code: PH.
[–]AutoModerator[M] [score hidden] stickied comment (0 children)
[–]WorkingYou2280 25 points26 points27 points (4 children)
[–]thatmfisnotreal 8 points9 points10 points (1 child)
[–]YoghurtDull1466 0 points1 point2 points (0 children)
[–]PsychologicalAct6813 5 points6 points7 points (0 children)
[–]Monarc73 12 points13 points14 points (12 children)
[–]GirlNumber20 13 points14 points15 points (6 children)
[–]GYN-k4H-Q3z-75B 11 points12 points13 points (3 children)
[–]GirlNumber20 16 points17 points18 points (2 children)
[–]GYN-k4H-Q3z-75B 4 points5 points6 points (0 children)
[–]Otherkin 0 points1 point2 points (0 children)
[–]StevenAUSoong Type Positronic Brain 0 points1 point2 points (0 children)
[–]vampyre2000 2 points3 points4 points (2 children)
[–]Monarc73 1 point2 points3 points (0 children)
[–]jgainit 1 point2 points3 points (0 children)
[–]PsychologicalAct6813 1 point2 points3 points (0 children)
[–]Metworld 5 points6 points7 points (1 child)
[–]cunningjames 5 points6 points7 points (0 children)
[–]Original_Finding2212 4 points5 points6 points (2 children)
[–]steves1189[S] 1 point2 points3 points (1 child)
[–]Effective_Rabbit6325 1 point2 points3 points (0 children)
[–]phovos 3 points4 points5 points (0 children)
[–]Alternative_Log3012 4 points5 points6 points (5 children)
[–]Equivalent_Seesaw_51 2 points3 points4 points (1 child)
[–]Alternative_Log3012 5 points6 points7 points (0 children)
[–]steves1189[S] 1 point2 points3 points (2 children)
[–]Alternative_Log3012 1 point2 points3 points (1 child)
[–]Nxt1tothree 0 points1 point2 points (0 children)
[–]Background-Fill-51 4 points5 points6 points (2 children)
[–]Particular_Focus_576 2 points3 points4 points (1 child)
[–]Background-Fill-51 1 point2 points3 points (0 children)
[–]Realistic-Duck-922 2 points3 points4 points (0 children)
[–]roastedantlers 1 point2 points3 points (0 children)
[–]fractaldesigner[🍰] 1 point2 points3 points (3 children)
[–]Delta9SA 1 point2 points3 points (0 children)
[–]torb 1 point2 points3 points (1 child)
[–]gbbenner 0 points1 point2 points (0 children)
[–]lhx555 1 point2 points3 points (0 children)
[–]zascar 1 point2 points3 points (0 children)
[–][deleted] (2 children)
[removed]
[–]Original_Finding2212 0 points1 point2 points (1 child)
[–]save_china_uyghurs 0 points1 point2 points (0 children)
[–]PsychologicalAct6813 0 points1 point2 points (0 children)
[–]RogueStargun 0 points1 point2 points (0 children)
[–]Azimn 0 points1 point2 points (0 children)
[–]ejpusa 0 points1 point2 points (0 children)
[+]flyblackbox -1 points0 points1 point (0 children)