Large language models for inorganic synthesis predictions
We evaluate the effectiveness of pretrained and fine-tuned large language models (LLMs)
for predicting the synthesizability of inorganic compounds and the selection of precursors …
for predicting the synthesizability of inorganic compounds and the selection of precursors …
A primer on the inner workings of transformer-based language models
The rapid progress of research aimed at interpreting the inner workings of advanced
language models has highlighted a need for contextualizing the insights gained from years …
language models has highlighted a need for contextualizing the insights gained from years …
On the Foundations of Earth and Climate Foundation Models
Foundation models have enormous potential in advancing Earth and climate sciences,
however, current approaches may not be optimal as they focus on a few basic features of a …
however, current approaches may not be optimal as they focus on a few basic features of a …
MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI
Rapid adoption of machine learning (ML) technologies has led to a surge in power
consumption across diverse systems, from tiny IoT devices to massive datacenter clusters …
consumption across diverse systems, from tiny IoT devices to massive datacenter clusters …
Retrieval augmented generation-driven information retrieval and question answering in construction management
Construction management is a communication-intensive field, requiring prompt responses to
queries from various stakeholders to ensure project continuity. However, retrieving accurate …
queries from various stakeholders to ensure project continuity. However, retrieving accurate …
Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models
This paper explores ideas and provides a potential roadmap for the development and
evaluation of physics-specific large-scale AI models, which we call Large Physics Models …
evaluation of physics-specific large-scale AI models, which we call Large Physics Models …
Scaling down for efficiency: Medium-sized protein language models perform well at transfer learning on realistic datasets
Protein language models (pLMs) can offer deep insights into evolutionary and structural
properties of proteins. While larger models, such as the 15 billion parameter model ESM-2 …
properties of proteins. While larger models, such as the 15 billion parameter model ESM-2 …