An introduction to the compute express link (cxl) interconnect

D Das Sharma, R Blankenship, D Berger - ACM Computing Surveys, 2024 - dl.acm.org
The Compute Express Link (CXL) is an open industry-standard interconnect between
processors and devices such as accelerators, memory buffers, smart network interfaces …

Managing Memory Tiers with {CXL} in Virtualized Environments

Y Zhong, DS Berger, C Waldspurger, R Wee… - … USENIX Symposium on …, 2024 - usenix.org
Cloud providers seek to deploy CXL-based memory to increase aggregate memory
capacity, reduce costs, and lower carbon emissions. However, CXL accesses incur higher …

Sustainable LLM Serving: Environmental Implications, Challenges, and Opportunities

Y Ding, T Shi - 2024 IEEE 15th International Green and …, 2024 - ieeexplore.ieee.org
Large language models (LLMs) have been widely used for their ability to handle complex
natural language tasks with high accuracy. The lifecycle of LLMs development and …

GreenLLM: Disaggregating Large Language Model Serving on Heterogeneous GPUs for Lower Carbon Emissions

T Shi, Y Wu, S Liu, Y Ding - arxiv preprint arxiv:2412.20322, 2024 - arxiv.org
LLMs have been widely adopted across many real-world applications. However, their
widespread use comes with significant environmental costs due to their high computational …

The Unpaid Toll: Quantifying the Public Health Impact of AI

Y Han, Z Wu, P Li, A Wierman, S Ren - arxiv preprint arxiv:2412.06288, 2024 - arxiv.org
The surging demand for AI has led to a rapid expansion of energy-intensive data centers,
impacting the environment through escalating carbon emissions and water consumption …

Dense Server Design for Immersion Cooling

M Kodnongbua, Z Englhardt, R Bianchini… - ACM Transactions on …, 2024 - dl.acm.org
The growing demands for computational power in cloud computing have led to a significant
increase in the deployment of high-performance servers. The growing power consumption of …

Self-maintaining [networked] systems: The rise of datacenter robotics!

F Hong, I Sarantopoulos, E Hogg… - Proceedings of the 23rd …, 2024 - dl.acm.org
The vision of self-maintaining systems is to make cloud hardware automatically servicing
and repairing using robotics. We define a self-maintaining system as one where software …

The Sunk Carbon Fallacy: Rethinking Carbon Footprint Metrics for Effective Carbon-Aware Scheduling

N Bashir, V Gohil, AB Subramanya, M Shahrad… - Proceedings of the …, 2024 - dl.acm.org
The rapid increase in computing demand and corresponding energy consumption have
focused attention on computing's impact on the climate and sustainability. Prior work …

[PDF][PDF] A call for research on storage emissions

S McAllister, F Kazhamiaka… - Proceedings of the …, 2024 - saramcallister.github.io
Major cloud providers have committed to lowering carbon emissions by 2030 across their
datacenters, and research has contributed many ideas on how this may be achieved …

Reducing smart phone environmental footprints with in-memory processing

Z Yang, W Zhang, S Ji, P Zhou… - … on Hardware/Software …, 2024 - ieeexplore.ieee.org
Smart phones have revolutionized the availability of computing to the consumer. Recently,
smart phones have been aggressively integrating artificial intelligence (AI) capabilities into …