With the urgent demand for generalized deep models, many pre-trained big models are
proposed, such as bidirectional encoder representations (BERT), vision transformer (ViT) …

Pre-trained Language Models (PLMs) which are trained on large text corpus via self-
supervised learning method, have yielded promising performance on various tasks in …

To advance Chinese financial natural language processing (NLP), we introduce BBT-FinT5,
a new Chinese financial pre-training language model based on the T5 model. To support …

Deep Learning has been successfully applied to many application domains, yet its
advantages have been slow to emerge for time series forecasting. For example, in the well …

With the increasing of model capacity brought by pre-trained language models, there
emerges boosting needs for more knowledgeable natural language processing (NLP) …

In recent years, transformer-based models have emerged as powerful tools for natural
language processing tasks, demonstrating remarkable performance in several domains …

Abstract Knowledge plays a critical role in artificial intelligence. Recently, the extensive
success of pre-trained language models (PLMs) has raised significant attention about how …

Knowledge in NLP has been a rising trend especially after the advent of large-scale pre-
trained models. Knowledge is critical to equip statistics-based models with common sense …

Natural language processing for finance has gained significant attention from both
academia and the industry as the continuously increasing amount of financial texts has …

Online platforms have become the primary means for travellers to search, compare, and
book accommodations for their trips. Consequently, online platforms and revenue managers …