Tinyml meets iot: A comprehensive survey

L Dutta, S Bharali - Internet of Things, 2021 - Elsevier
The rapid growth in miniaturization of low-power embedded devices and advancement in
the optimization of machine learning (ML) algorithms have opened up a new prospect of the …

Deep semantic segmentation of natural and medical images: a review

S Asgari Taghanaki, K Abhishek, JP Cohen… - Artificial Intelligence …, 2021 - Springer
The semantic image segmentation task consists of classifying each pixel of an image into an
instance, where each instance corresponds to a class. This task is a part of the concept of …

Improved knowledge distillation via teacher assistant

SI Mirzadeh, M Farajtabar, A Li, N Levine… - Proceedings of the AAAI …, 2020 - aaai.org
Despite the fact that deep neural networks are powerful models and achieve appealing
results on many tasks, they are too large to be deployed on edge devices like smartphones …

Born again neural networks

T Furlanello, Z Lipton, M Tschannen… - International …, 2018 - proceedings.mlr.press
Abstract Knowledge Distillation (KD) consists of transferring “knowledge” from one machine
learning model (the teacher) to another (the student). Commonly, the teacher is a high …

A review on data-driven constitutive laws for solids

JN Fuhg, G Anantha Padmanabha, N Bouklas… - … Methods in Engineering, 2024 - Springer
This review article highlights state-of-the-art data-driven techniques to discover, encode,
surrogate, or emulate constitutive laws that describe the path-independent and path …

Sobolev training of thermodynamic-informed neural networks for interpretable elasto-plasticity models with level set hardening

NN Vlassis, WC Sun - Computer Methods in Applied Mechanics and …, 2021 - Elsevier
We introduce a deep learning framework designed to train smoothed elastoplasticity models
with interpretable components, such as the stored elastic energy function, yield surface, and …

Multi-objective loss balancing for physics-informed deep learning

R Bischof, M Kraus - arxiv preprint arxiv:2110.09813, 2021 - arxiv.org
Physics-Informed Neural Networks (PINN) are algorithms from deep learning leveraging
physical laws by including partial differential equations together with a respective set of …

Perspectives on the integration between first-principles and data-driven modeling

W Bradley, J Kim, Z Kilwein, L Blakely… - Computers & Chemical …, 2022 - Elsevier
Efficiently embedding and/or integrating mechanistic information with data-driven models is
essential if it is desired to simultaneously take advantage of both engineering principles and …

Geometric deep learning for computational mechanics part i: Anisotropic hyperelasticity

NN Vlassis, R Ma, WC Sun - Computer Methods in Applied Mechanics and …, 2020 - Elsevier
We present a machine learning approach that integrates geometric deep learning and
Sobolev training to generate a family of finite strain anisotropic hyperelastic models that …

Distilling system 2 into system 1

P Yu, J Xu, J Weston, I Kulikov - arxiv preprint arxiv:2407.06023, 2024 - arxiv.org
Large language models (LLMs) can spend extra compute during inference to generate
intermediate thoughts, which helps to produce better final responses. Since Chain-of …