Crossword

1234567891011121314
Across
  1. 3. Unaffected by FlashAttention
  2. 4. FlashAttention's key feature
  3. 6. Reduced memory usage
  4. 8. Mechanism in LLMs
  5. 9. Co-design for future
  6. 11. Real-world impact of FA-2
  7. 12. Enabled by longer context
  8. 13. FlashAttention-2's improvement
Down
  1. 1. Scaling of attention
  2. 2. Faster attention mechanism
  3. 5. Limited resource in LLMs
  4. 7. Longer sequences enabled
  5. 10. Application in drug discovery
  6. 14. Computation across sequence