Survey of optimization algorithms in modern neural networks

R Abdulkadirov, P Lyakhov, N Nagornov - Mathematics, 2023 - mdpi.com
The main goal of machine learning is the creation of self-learning algorithms in many areas
of human activity. It allows a replacement of a person with artificial intelligence in seeking to …

Error exponent and strong converse for quantum soft covering

HC Cheng, L Gao - IEEE Transactions on Information Theory, 2023 - ieeexplore.ieee.org
How well can we approximate a quantum channel output state using a random codebook
with a certain size? In this work, we study the quantum soft covering problem, which uses a …

Duality between source coding with quantum side information and classical-quantum channel coding

HC Cheng, EP Hanson, N Datta… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
In this paper, we establish an interesting duality between two different quantum information-
processing tasks, namely, classical source coding with quantum side information, and …

Exploiting structure in quantum relative entropy programs

K He, J Saunderson, H Fawzi - arxiv preprint arxiv:2407.00241, 2024 - arxiv.org
Quantum relative entropy programs are convex optimization problems which minimize a
linear functional over an affine section of the epigraph of the quantum relative entropy …

Quantum broadcast channel simulation via multipartite convex splitting

HC Cheng, L Gao, M Berta - arxiv preprint arxiv:2304.12056, 2023 - arxiv.org
We show that the communication cost of quantum broadcast channel simulation under free
entanglement assistance between the sender and the receivers is asymptotically …

Optimal self-concordant barriers for quantum relative entropies

H Fawzi, J Saunderson - SIAM Journal on Optimization, 2023 - SIAM
Quantum relative entropies are jointly convex functions of two positive definite matrices that
generalize the Kullback–Leibler divergence and arise naturally in quantum information …

A Bregman–Kaczmarz method for nonlinear systems of equations

R Gower, DA Lorenz, M Winkler - Computational Optimization and …, 2024 - Springer
We propose a new randomized method for solving systems of nonlinear equations, which
can find sparse solutions or solutions under certain simple constraints. The scheme only …

A Bregman proximal perspective on classical and quantum Blahut-Arimoto algorithms

K He, J Saunderson, H Fawzi - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The Blahut-Arimoto algorithm is a well-known method to compute classical channel
capacities and rate-distortion functions. Recent works have extended this algorithm to …

Strong converse for privacy amplification against quantum side information

YC Shen, L Gao, HC Cheng - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
We establish a one-shot strong converse bound for privacy amplification against quantum
side information with trace distance as a security criterion. Firstly, our result shows that the …

Properties of noncommutative rényi and Augustin information

HC Cheng, L Gao, MH Hsieh - Communications in Mathematical Physics, 2022 - Springer
Rényi and Augustin information are generalizations of mutual information defined via the
Rényi divergence, playing a significant role in evaluating the performance of information …