Multi-Head Self-Attention over Patches
Appendix A: softmax(qkᵀ/√D_h) v, k heads with D_h = D/k, O(N²) cost
Sign in to keep going
Create a free account or sign in to continue. Your progress stays saved on this device.
Appendix A: softmax(qkᵀ/√D_h) v, k heads with D_h = D/k, O(N²) cost
Create a free account or sign in to continue. Your progress stays saved on this device.