Database meets deep learning: Challenges and opportunities

W Wang, M Zhang, G Chen, HV Jagadish, BC Ooi… - ACM Sigmod …, 2016 - dl.acm.org
Deep learning has recently become very popular on account of its incredible success in
many complex datadriven applications, including image classification and speech …

Learning scheduling algorithms for data processing clusters

H Mao, M Schwarzkopf, SB Venkatakrishnan… - Proceedings of the …, 2019 - dl.acm.org
Efficiently scheduling data processing jobs on distributed compute clusters requires complex
algorithms. Current systems use simple, generalized heuristics and ignore workload …

Neo: A learned query optimizer

R Marcus, P Negi, H Mao, C Zhang, M Alizadeh… - arxiv preprint arxiv …, 2019 - arxiv.org
Query optimization is one of the most challenging problems in database systems. Despite
the progress made over the past decades, query optimizers remain extremely complex …

Bao: Making learned query optimization practical

R Marcus, P Negi, H Mao, N Tatbul… - Proceedings of the …, 2021 - dl.acm.org
Recent efforts applying machine learning techniques to query optimization have shown few
practical gains due to substantive training overhead, inability to adapt to changes, and poor …

Learned cardinalities: Estimating correlated joins with deep learning

A Kipf, T Kipf, B Radke, V Leis, P Boncz… - arxiv preprint arxiv …, 2018 - arxiv.org
We describe a new deep learning approach to cardinality estimation. MSCN is a multi-set
convolutional network, tailored to representing relational query plans, that employs set …

Deep reinforcement learning

SE Li - Reinforcement learning for sequential decision and …, 2023 - Springer
Similar to humans, RL agents use interactive learning to successfully obtain satisfactory
decision strategies. However, in many cases, it is desirable to learn directly from …

A survey on deep reinforcement learning for data processing and analytics

Q Cai, C Cui, Y **ong, W Wang, Z **e… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Data processing and analytics are fundamental and pervasive. Algorithms play a vital role in
data processing and analytics where many algorithm designs have incorporated heuristics …

NeuroCard: one cardinality estimator for all tables

Z Yang, A Kamsetty, S Luan, E Liang, Y Duan… - arxiv preprint arxiv …, 2020 - arxiv.org
Query optimizers rely on accurate cardinality estimates to produce good execution plans.
Despite decades of research, existing cardinality estimators are inaccurate for complex …

Deep unsupervised cardinality estimation

Z Yang, E Liang, A Kamsetty, C Wu, Y Duan… - arxiv preprint arxiv …, 2019 - arxiv.org
Cardinality estimation has long been grounded in statistical tools for density estimation. To
capture the rich multivariate distributions of relational tables, we propose the use of a new …

Database meets artificial intelligence: A survey

X Zhou, C Chai, G Li, J Sun - IEEE Transactions on Knowledge …, 2020 - ieeexplore.ieee.org
Database and Artificial Intelligence (AI) can benefit from each other. On one hand, AI can
make database more intelligent (AI4DB). For example, traditional empirical database …