| Bloom: A 176b-parameter open-access multilingual language model T Le Scao, A Fan, C Akiki, E Pavlick, S Ilić, D Hesslow, R Castagné, ... | 1761 | 2023 |
| Zeroquant: Efficient and affordable post-training quantization for large-scale transformers Z Yao, R Yazdani Aminabadi, M Zhang, X Wu, C Li, Y He Advances in Neural Information Processing Systems 35, 27168-27183, 2022 | 392 | 2022 |
| Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale S Rajbhandari, C Li, Z Yao, M Zhang, RY Aminabadi, AA Awan, J Rasley, ... International conference on machine learning, 18332-18346, 2022 | 260 | 2022 |
| OpenFold: Retraining AlphaFold2 yields new insights into its learning mechanisms and capacity for generalization G Ahdritz, N Bouatta, C Floristean, S Kadyan, Q Xia, W Gerecke, ... Nature Methods, 1-11, 2024 | 230 | 2024 |
| Scaling Video Analytics on Constrained Edge Nodes C Canel, T Kim, G Zhou, C Li, H Lim, DG Andersen, M Kaminsky, ... MLSys Conference 2019, 2019 | 194 | 2019 |
| Scheduling Techniques for Hybrid Circuit/Packet Networks H Liu, MK Mukerjee, C Li, N Feltman, G Papen, S Savage, S Seshan, ... 11th International Conference on emerging Networking EXperiments and …, 2015 | 150 | 2015 |
| 1-bit adam: Communication efficient large-scale training with adam’s convergence speed H Tang, S Gan, AA Awan, S Rajbhandari, C Li, X Lian, J Liu, C Zhang, ... International Conference on Machine Learning, 10118-10129, 2021 | 96 | 2021 |
| GD-Wheel: a cost-aware replacement policy for key-value stores C Li, AL Cox Proceedings of the Tenth European Conference on Computer Systems, 5, 2015 | 80 | 2015 |
| Improving approximate nearest neighbor search through learned adaptive early termination C Li, M Zhang, DG Andersen, Y He Proceedings of the 2020 ACM SIGMOD International Conference on Management of …, 2020 | 67 | 2020 |
| The stability-efficiency dilemma: Investigating sequence length warmup for training GPT models C Li, M Zhang, Y He Advances in Neural Information Processing Systems 35, 26736-26750, 2022 | 64* | 2022 |
| Deepspeed-chat: Easy, fast and affordable rlhf training of chatgpt-like models at all scales Z Yao, RY Aminabadi, O Ruwase, S Rajbhandari, X Wu, AA Awan, ... arXiv preprint arXiv:2308.01320, 2023 | 55 | 2023 |
| 1-bit LAMB: communication efficient large-scale large-batch training with LAMB’s convergence speed C Li, AA Awan, H Tang, S Rajbhandari, Y He 2022 IEEE 29th International Conference on High Performance Computing, Data …, 2022 | 36 | 2022 |
| Xtc: Extreme compression for pre-trained transformers made simple and efficient X Wu, Z Yao, M Zhang, C Li, Y He Advances in Neural Information Processing Systems 35, 3217-3231, 2022 | 29 | 2022 |
| Maximizing communication efficiency for large-scale training via 0/1 adam Y Lu, C Li, M Zhang, C De Sa, Y He International Conference on Learning Representations, 2023 | 23 | 2023 |
| Deepspeed data efficiency: Improving deep learning model quality and training efficiency via efficient data sampling and routing C Li, Z Yao, X Wu, M Zhang, C Holmes, C Li, Y He Proceedings of the AAAI Conference on Artificial Intelligence 38 (16), 18490 …, 2024 | 21 | 2024 |
| Random-ltd: Random and layerwise token dropping brings efficient training for large-scale transformers Z Yao, X Wu, C Li, C Holmes, M Zhang, C Li, Y He arXiv preprint arXiv:2211.11586, 2022 | 15 | 2022 |
| Using indirect routing to recover from network traffic scheduling estimation error C Li, MK Mukerjee, DG Andersen, S Seshan, M Kaminsky, G Porter, ... 2017 ACM/IEEE Symposium on Architectures for Networking and Communications …, 2017 | 14 | 2017 |
| Better caching in search advertising systems with rapid refresh predictions C Li, DG Andersen, Q Fu, S Elnikety, Y He Proceedings of the 2018 World Wide Web Conference, 1875-1884, 2018 | 13 | 2018 |
| DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies SL Song, B Kruft, M Zhang, C Li, S Chen, C Zhang, M Tanaka, X Wu, ... arXiv preprint arXiv:2310.04610, 2023 | 12 | 2023 |
| Reducing DRAM row activations with eager read/write clustering M Jeon, C Li, AL Cox, S Rixner ACM Transactions on Architecture and Code Optimization (TACO) 10 (4), 1-25, 2013 | 12 | 2013 |
He YuxiongSnowflakeAdresse e-mail validée de snowflake.com
