This paper studies how to keep a vision backbone effective while removing token mixers in
its basic building blocks. Token mixers, as self-attention for vision transformers (ViTs), are …

Abstract Knowledge distillation (KD) has shown great success in improving student's
performance by mimicking the intermediate output of the high-capacity teacher in fine …

With the rapid development of technologies such as smart home, smart medical and
autonomous driving, lightweight networks play an important role in promoting the application …

Abstract Knowledge distillation (KD) has become a standard method to boost the
performance of lightweight object detectors. Most previous works are feature-based, where …

The groundbreaking performance of transformers in Natural Language Processing (NLP)
tasks has led to their replacement of traditional Convolutional Neural Networks (CNNs) …

This paper studies how to keep a vision backbone effective while removing token mixers in
its basic building blocks. Token mixers, as self-attention for vision transformers (ViTs), are …

The field of Continual Learning (CL) has inspired numerous researchers over the years,
leading to increasingly advanced countermeasures to the issue of catastrophic forgetting …

Lane detection is one of the most important tasks in self-driving. The critical purpose of lane
detection is the prediction of lane shapes. Meanwhile, it is challenging and difficult to …