Shuaiwen Leon Song

Citée par

	Toutes	Depuis 2020
Citations	3842	2293
indice h	33	26
indice i10	63	49

660

330

165

495

201020112012201320142015201620172018201920202021202220232024202522 38 71 108 114 152 206 201 255 309 322 434 361 458 655 62

Accès public

Tout afficher

62 articles

6 articles

disponibles

non disponibles

Sur la base des exigences liées au financement

Coauteurs

Ang LiPacific Northwest National Laboratory and University of WashingtonAdresse e-mail validée de pnnl.gov
Kirk CameronProfessor of Computer Science, Virginia TechAdresse e-mail validée de cs.vt.edu
Xin FuElectrical and Computer Engineering Department, University of HoustonAdresse e-mail validée de central.uh.edu
Kevin J. BarkerHigh Performance Computing Group Lead, Pacific Northwest National LaboratoryAdresse e-mail validée de pnnl.gov
Xu LiuNorth Carolina State UniversityAdresse e-mail validée de ncsu.edu
Donglin ZhuangThe University of SydneyAdresse e-mail validée de sydney.edu.au
Xingyao Zhang, Ph.D.Software Engineer, GoogleAdresse e-mail validée de google.com
Barry RountreeLawrence Livermore National LaboratoryAdresse e-mail validée de llnl.gov
Haojun XiaUniversity of SydneyAdresse e-mail validée de uni.sydney.edu.au
Nathan R. TallentPacific Northwest National LaboratoryAdresse e-mail validée de pnnl.gov
Akash KumarFull Professor, Chair of Embedded Systems, Ruhr University BochumAdresse e-mail validée de rub.de
Eddy Z. ZhangProfessor of Computer Science, Rutgers UniversityAdresse e-mail validée de scarletmail.rutgers.edu
Yang YouPresidential Young Professor, National University of SingaporeAdresse e-mail validée de comp.nus.edu.sg
Linnan WangBrown UniversityAdresse e-mail validée de brown.edu
Kapil AgarwalSoftware Engineer at FacebookAdresse e-mail validée de fb.com
Amanda (Peters) RandlesDuke UniversityAdresse e-mail validée de duke.edu
Zizhong (Jeffrey) ChenProfessor of Computer Science, University of California, RiversideAdresse e-mail validée de cs.ucr.edu
Michael TaylorProfessor of Computer Science & Engineering and EE, U. WashingtonAdresse e-mail validée de uw.edu
Pavan BalajiArgonne National LaboratoryAdresse e-mail validée de anl.gov
Martin HerbordtProfessor, Electrical and Computer Engineering, Boston UniversityAdresse e-mail validée de bu.edu

Suivre

Shuaiwen Leon Song

VP of Research, Together.ai; Ex-Microsoft; Tenured Professor

Adresse e-mail validée de together.ai - Page d'accueil

Large-Scale ML System Design High Performance Computing Frontier Technologies


Titre Trier par citations Trier par année Trier par titre	Citée par Citée par	Année
Powerpack: Energy profiling and analysis of high-performance systems and applications R Ge, X Feng, S Song, HC Chang, D Li, KW Cameron IEEE Transactions on Parallel and Distributed Systems 21 (5), 658-671, 2009	541	2009
Superneurons: Dynamic GPU memory management for training deep neural networks L Wang, J Ye, Y Zhao, W Wu, A Li, SL Song, Z Xu, T Kraska Proceedings of the 23rd ACM SIGPLAN symposium on principles and practice of …, 2018	318	2018
Evaluating modern gpu interconnect: Pcie, nvlink, nv-sli, nvswitch and gpudirect A Li, SL Song, J Chen, J Li, X Liu, NR Tallent, KJ Barker IEEE Transactions on Parallel and Distributed Systems 31 (1), 94-110, 2019	291	2019
A Simplified and Accurate Model of Power-Performance Efficiency on Emergent GPU Architectures S Song, C Su, B Rountree, KW Cameron 27th IEEE International Parallel & Distributed Processing Symposium (IPDPS), 2013	217	2013
Locality-driven dynamic GPU cache bypassing C Li, SL Song, H Dai, A Sidelnik, SKS Hari, H Zhou Proceedings of the 29th ACM on International Conference on Supercomputing, 67-77, 2015	142	2015
Graphreduce: processing large-scale graphs on accelerator-based systems D Sengupta, SL Song, K Agarwal, K Schwan Proceedings of the International Conference for High Performance Computing …, 2015	116	2015
Locality-aware CTA clustering for modern GPUs A Li, SL Song, W Liu, X Liu, A Kumar, H Corporaal ACM SIGARCH Computer Architecture News 45 (1), 297-311, 2017	96	2017
Randomness in neural network training: Characterizing the impact of tooling D Zhuang, X Zhang, S Song, S Hooker Proceedings of Machine Learning and Systems 4, 316-336, 2022	93	2022
Iso-energy-efficiency: An approach to power-constrained parallel computation S Song, CY Su, R Ge, A Vishnu, KW Cameron 2011 IEEE International Parallel & Distributed Processing Symposium, 128-139, 2011	72	2011
Tartan: evaluating modern GPU interconnect via a multi-GPU benchmark suite A Li, SL Song, J Chen, X Liu, N Tallent, K Barker 2018 IEEE International Symposium on Workload Characterization (IISWC), 191-202, 2018	70	2018
Energy profiling and analysis of the hpc challenge benchmarks S Song, R Ge, X Feng, KW Cameron The International Journal of High Performance Computing Applications 23 (3 …, 2009	68	2009
AStitch: enabling a new multi-dimensional optimization space for memory-intensive ML training and inference on modern SIMT architectures Z Zheng, X Yang, P Zhao, G Long, K Zhu, F Zhu, W Zhao, X Liu, J Yang, ... Proceedings of the 27th ACM International Conference on Architectural …, 2022	66	2022
Unified performance and power modeling of scientific workloads SL Song, K Barker, D Kerbyson Proceedings of the 1st International Workshop on Energy Efficient …, 2013	61	2013
Processing-in-memory enabled graphics processors for 3D rendering C Xie, SL Song, J Wang, W Zhang, X Fu 2017 IEEE International Symposium on High Performance Computer Architecture …, 2017	60	2017
Exploring and analyzing the real impact of modern on-package memory on HPC scientific kernels A Li, W Liu, MRB Kristensen, B Vinter, H Wang, K Hou, A Marquez, ... Proceedings of the International Conference for High Performance Computing …, 2017	58	2017
Deepspeed ulysses: System optimizations for enabling training of extreme long sequence transformer models SA Jacobs, M Tanaka, C Zhang, M Zhang, SL Song, S Rajbhandari, Y He arXiv preprint arXiv:2309.14509, 2023	56	2023
New-sum: A novel online abft scheme for general iterative methods D Tao, SL Song, S Krishnamoorthy, P Wu, X Liang, EZ Zhang, ... Proceedings of the 25th ACM International Symposium on High-Performance …, 2016	56	2016
Deepspeed-chat: Easy, fast and affordable rlhf training of chatgpt-like models at all scales Z Yao, RY Aminabadi, O Ruwase, S Rajbhandari, X Wu, AA Awan, ... arXiv preprint arXiv:2308.01320, 2023	55	2023
Cudaadvisor: Llvm-based runtime profiling for modern gpus D Shen, SL Song, A Li, X Liu Proceedings of the 2018 International Symposium on Code Generation and …, 2018	55	2018
Investigating the interplay between energy efficiency and resilience in high performance computing L Tan, SL Song, P Wu, Z Chen, R Ge, DJ Kerbyson 2015 IEEE International Parallel and Distributed Processing Symposium, 786-796, 2015	55	2015

Le système ne peut pas réaliser cette opération maintenant. Veuillez réessayer plus tard.

Articles 1–20

Nombre de citations par an

Citations en double

Citations fusionnées

Ajouter les coauteursCoauteurs

Suivre

Citée par

Coauteurs