Author of the publication

Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer.

, , , and . CoRR, (2023)

Please choose a person to relate this publication to

To differ between persons with the same name, the academic degree and the title of an important publication will be displayed. You can also use the button next to the name to display some publications already assigned to the person.

 

Other publications of authors with the same name

Lsh-sampling Breaks the Computation Chicken-and-egg Loop in Adaptive Stochastic Gradient Estimation., , and . CoRR, (2019)Efficient Streaming Language Models with Attention Sinks., , , , and . CoRR, (2023)Scatterbrain: Unifying Sparse and Low-rank Attention Approximation., , , , , and . CoRR, (2021)Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models., , , , , , and . CoRR, (2021)Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding., , , , , , and . CoRR, (2024)Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions., , , , , , , , , and 4 other author(s). CoRR, (2023)Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer., , , and . CoRR, (2023)Learn To be Efficient: Build Structured Sparsity in Large Language Models., , , , and . CoRR, (2024)SLIDE : In Defense of Smart Algorithms over Hardware Acceleration for Large-Scale Deep Learning Systems, , , , , and . (2019)cite arxiv:1903.03129Comment: Published at MLSys 2020.SOLAR: Sparse Orthogonal Learned and Random Embeddings., , and . ICLR, OpenReview.net, (2021)