Learn
Lesson 06 / 13

Multi-Head Self-Attention over Patches

Appendix A: softmax(qkᵀ/√D_h) v, k heads with D_h = D/k, O(N²) cost

Sign in to keep going

Create a free account or sign in to continue. Your progress stays saved on this device.