Andrej Karpathy has some excellent videos around how to build a GPT style transformer. Here is a recent video on how to build a transformer he made. https://youtu.be/kCc8FmEb1nY?si=mT4zI6eeUJmskuF6
I created a Discord server for learners who are interested in sharing some resources on how to learn transformers. 1) quiz questions to test important knowledge 2) open source projects building on transformers (e.g. sentence transformers, sentiment analysis, chat, etc) 3) weekly video call to share what we are learning 4) place to ask questions 5) place to share links to research, videos, projects
Link to the discord: https://discord.gg/CSkZcPWu (will expire in 7 days)
[link] [comments]