C.W.K.
Stream
Quiz · 3 questions

Why Look Beyond Attention?

What Transformers do well, where they hit walls, and what "alternative" actually means

Level 0Observer
0 XP0/50 lessons0/14 achievements
0/100 XP to next level100 XP to go0% complete

Quiz

01What is the asymptotic compute complexity of standard self-attention with respect to sequence length n?
02What is the KV-cache and why does it dominate long-context inference cost?
03Which of the following is NOT a real bottleneck of standard Transformers?
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.