Hierarchical low-rank tensors for multilingual transfer parsing

Y Zhang, R Barzilay - 2015 - dspace.mit.edu
Accurate multilingual transfer parsing typically relies on careful feature engineering. In this
paper, we propose a hierarchical tensor-based approach for this task. This approach …

Learning weighted automata

B Balle, M Mohri - International Conference on Algebraic Informatics, 2015 - Springer
Weighted finite automata (WFA) are finite automata whose transitions and states are
augmented with some weights, elements of a semiring. A WFA induces a function over …

FastMotif: spectral sequence motif discovery

N Colombo, N Vlassis - Bioinformatics, 2015 - academic.oup.com
Motivation: Sequence discovery tools play a central role in several fields of computational
biology. In the framework of Transcription Factor binding studies, most of the existing motif …

Spectral Regularization: an Inductive Bias for Sequence Modeling

K Hou, G Rabusseau - arxiv preprint arxiv:2211.02255, 2022 - arxiv.org
Various forms of regularization in learning tasks strive for different notions of simplicity. This
paper presents a spectral regularization technique, which attaches a unique inductive bias …

Approximate minimization of weighted tree automata

B Balle, G Rabusseau - Information and Computation, 2022 - Elsevier
This paper studies the following approximate minimization problem: given a minimal
weighted tree automaton A with n states recognizing a weighted tree language f, can we …

Prepositional phrase attachment over word embedding products

PS Madhyastha, X Carreras… - Proceedings of the 15th …, 2017 - aclanthology.org
We present a low-rank multi-linear model for the task of solving prepositional phrase
attachment ambiguity (PP task). Our model exploits tensor products of word embeddings …

Semi-supervised learning of sequence models with the method of moments

ZM Marinho, AFT Martin, S Cohen… - 2016 Conference on …, 2016 - research.ed.ac.uk
We propose a fast and scalable method for semi-supervised learning of sequence models,
based on anchor words and moment matching. Our method can handle hidden Markov …

A comparison between CNNs and WFAs for sequence classification

A Quattoni, X Carreras - … of SustaiNLP: Workshop on Simple and …, 2020 - aclanthology.org
We compare a classical CNN architecture for sequence classification involving several
convolutional and max-pooling layers against a simple model based on weighted finite state …

Interpolated spectral NGram language models

A Quattoni, X Carreras - Proceedings of the 57th Annual Meeting …, 2019 - aclanthology.org
Spectral models for learning weighted non-deterministic automata have nice theoretical and
algorithmic properties. Despite this, it has been challenging to obtain competitive results in …

Hierarchical methods of moments

M Ruffini, G Rabusseau, B Balle - Advances in Neural …, 2017 - proceedings.neurips.cc
Spectral methods of moments provide a powerful tool for learning the parameters of latent
variable models. Despite their theoretical appeal, the applicability of these methods to real …