Predicting parameters in deep learning

M Denil, B Shakibi, L Dinh… - Advances in neural …, 2013 - proceedings.neurips.cc
We demonstrate that there is significant redundancy in the parameterization of several deep
learning models. Given only a few weight values for each feature it is possible to accurately …

Distributed learning of deep neural network over multiple agents

O Gupta, R Raskar - Journal of Network and Computer Applications, 2018 - Elsevier
In domains such as health care and finance, shortage of labeled data and computational
resources is a critical issue while develo** machine learning algorithms. To address the …

Animal biometrics: quantifying and detecting phenotypic appearance

HS Kühl, T Burghardt - Trends in ecology & evolution, 2013 - cell.com
Animal biometrics is an emerging field that develops quantified approaches for representing
and detecting the phenotypic appearance of species, individuals, behaviors, and …

Deep learning with COTS HPC systems

A Coates, B Huval, T Wang, D Wu… - International …, 2013 - proceedings.mlr.press
Scaling up deep learning algorithms has been shown to lead to increased performance in
benchmark tasks and to enable discovery of complex high-level features. Recent efforts to …

Deep learning of representations: Looking forward

Y Bengio - International conference on statistical language and …, 2013 - Springer
Deep learning research aims at discovering learning algorithms that discover multiple levels
of distributed representations, with higher levels representing more abstract concepts …

On the importance of single directions for generalization

AS Morcos, DGT Barrett, NC Rabinowitz… - arxiv preprint arxiv …, 2018 - arxiv.org
Despite their ability to memorize large datasets, deep neural networks often achieve good
generalization performance. However, the differences between the learned solutions of …

Visual animal biometrics: survey

S Kumar, SK Singh - Iet Biometrics, 2017 - Wiley Online Library
Visual animal biometrics is an emerging research discipline in computer vision, pattern
recognition and cognitive science. It is a promising research field that encourages new …

Video tracking using learned hierarchical features

L Wang, T Liu, G Wang, KL Chan… - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
In this paper, we propose an approach to learn hierarchical features for visual object
tracking. First, we offline learn features robust to diverse motion patterns from auxiliary video …

Finding skill neurons in pre-trained transformer-based language models

X Wang, K Wen, Z Zhang, L Hou, Z Liu, J Li - arxiv preprint arxiv …, 2022 - arxiv.org
Transformer-based pre-trained language models have demonstrated superior performance
on various natural language processing tasks. However, it remains unclear how the skills …

[BOOK][B] Learning semantic image representations at a large scale

Y Jia - 2014 - search.proquest.com
I present my work towards learning a better computer vision system that learns and
generalizes object categories better, and behaves in ways closer to what human behave …