Accelerating Transformers with Spectrum-Preserving Token Merging
Hoai-Chau Tran, Duy M. H. Nguyen, Duy M. Nguyen, Trung-Tin Nguyen, Ngan Le, Pengtao Xie, Daniel Sonntag, James Y. Zou, Binh T. Nguyen, Mathias Niepert
Proceedings of the 38th Annual Conference on Neural Information Processing Systems (NeurIPS2024), 2024.
Abstract
Links
BibTeX
@inproceedings{tran2024acceleratingtransformersspectrumpreservingtoken,
title = {Accelerating Transformers with Spectrum-Preserving Token Merging},
author = {Tran, Hoai-Chau and Nguyen, Duy M. H. and Nguyen, Duy M. and Nguyen, Trung-Tin and Le, Ngan and Xie, Pengtao and Sonntag, Daniel and Zou, James Y. and Nguyen, Binh T. and Niepert, Mathias},
booktitle = {Proceedings of the 38th Annual Conference on Neural Information Processing Systems (NeurIPS2024)},
year = {2024},
eprint = {2405.16148},
archiveprefix = {arXiv},
primaryclass = {cs.LG},
url = {https://arxiv.org/abs/2405.16148}
}