| H2o: Heavy-hitter oracle for efficient generative inference of large language models Z Zhang, Y Sheng, T Zhou, T Chen, L Zheng, R Cai, Z Song, Y Tian, C Ré, ... (NeurIPS) Advances in Neural Information Processing Systems 36, 34661-34710, 2023 | 329 | 2023 |
| Robust overfitting may be mitigated by properly learned smoothening T Chen*, Z Zhang*, S Liu, S Chang, Z Wang (* Equal Contribution, ICLR) International Conference on Learning …, 2021 | 219 | 2021 |
| Galore: Memory-efficient llm training by gradient low-rank projection J Zhao, Z Zhang, B Chen, Z Wang, A Anandkumar, Y Tian (ICML Oral) International Conference on Machine Learning, 2024 | 163* | 2024 |
| Long live the lottery: The existence of winning tickets in lifelong learning T Chen*, Z Zhang*, S Liu, S Chang, Z Wang (* Equal Contribution, ICLR) International Conference on Learning …, 2021 | 79 | 2021 |
| Efficient lottery ticket finding: Less data is more Z Zhang*, X Chen*, T Chen*, Z Wang (* Equal Contribution, ICML) International Conference on Machine Learning, 2021 | 63 | 2021 |
| Gans can play lottery tickets too X Chen*, Z Zhang*, Y Sui, T Chen (* Equal Contribution, ICLR) International Conference on Learning …, 2021 | 61 | 2021 |
| Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity L Yin, Y Wu, Z Zhang, CY Hsieh, Y Wang, Y Jia, M Pechenizkiy, Y Liang, ... (ICML) International Conference on Machine Learning, 2023 | 57 | 2023 |
| " BNN-BN=?": Training Binary Neural Networks Without Batch Normalization T Chen, Z Zhang, X Ouyang, Z Liu, Z Shen, Z Wang (CVPR Workshops Spotlight) IEEE Conference on Computer Vision and Pattern …, 2021 | 57 | 2021 |
| Joma: Demystifying multilayer transformers via joint dynamics of mlp and attention Y Tian, Y Wang, Z Zhang, B Chen, S Du (ICLR) International Conference on Learning Representations, 2023 | 52 | 2023 |
| Sparsity Winning Twice: Better Robust Generalization from More Efficient Training T Chen*, Z Zhang*, P Wang*, S Balachandra*, H Ma*, Z Wang, Z Wang (* Equal Contribution, ICLR) International Conference on Learning …, 2022 | 50* | 2022 |
| Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers T Chen*, Z Zhang*, AK JAISWAL, S Liu, Z Wang (* Equal Contribution, ICLR Spotlight) International Conference on Learning …, 2023 | 48* | 2023 |
| The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy T Chen, Z Zhang, Y Cheng, A Awadallah, Z Wang (CVPR) IEEE Conference on Computer Vision and Pattern Recognition, 2022 | 47 | 2022 |
| Get More with LESS: Synthesizing Recurrence with KV Cache Compression for Efficient LLM Inference H Dong, X Yang, Z Zhang, Z Wang, Y Chi, B Chen (ICML) International Conference on Machine Learning, 2024 | 40* | 2024 |
| Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together! S Liu, T Chen, Z Zhang, X Chen, T Huang, AK JAISWAL, Z Wang (ICLR Spotlight) International Conference on Learning Representations, 2023 | 33 | 2023 |
| You are caught stealing my winning lottery ticket! making a lottery ticket claim its ownership X Chen, T Chen, Z Zhang, Z Wang (NeurIPS) Advances in Neural Information Processing Systems 34, 1780-1791, 2021 | 29 | 2021 |
| Quarantine: Sparsity can uncover the trojan attack trigger for free T Chen*, Z Zhang*, Y Zhang*, S Chang, S Liu, Z Wang (* Equal Contribution, CVPR) IEEE Conference on Computer Vision and Pattern …, 2022 | 27 | 2022 |
| Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy P Li, Z Zhang, P Yadav, YL Sung, Y Cheng, M Bansal, T Chen (ICLR Spotlight) International Conference on Learning Representations, 2023 | 26 | 2023 |
| Sparsity-Guided Holistic Explanation for LLMs with Interpretable Inference-Time Intervention Z Tan, T Chen, Z Zhang, H Liu (AAAI) The 38th Annual AAAI Conference on Artificial Intelligence, 2023 | 25 | 2023 |
| Found in the middle: How language models use long contexts better via plug-and-play positional encoding Z Zhang, R Chen, S Liu, Z Yao, O Ruwase, B Chen, X Wu, Z Wang (NeurIPS) Advances in Neural Information Processing Systems, 2024 | 20 | 2024 |
| Can You Win Everything with A Lottery Ticket? T Chen, Z Zhang, J Wu, R Huang, S Liu, S Chang, Z Wang (TMLR) Transactions on Machine Learning Research, 2022 | 16 | 2022 |
Zhangyang (Atlas) WangXTX Markets & University of Texas at Austinยืนยันอีเมลแล้วที่ utexas.edu