Advancing ecotoxicity assessment: Leveraging pre-trained model for bee toxicity and compound degradability prediction

X Li, F Zhang, L Zheng, J Guo - Journal of Hazardous Materials, 2024 - Elsevier
The prediction of ecological toxicity plays an increasingly important role in modern society.
However, the existing models often suffer from poor performance and limited predictive …

[PDF][PDF] A surprisal oracle for active curriculum language modeling

X Hong, S Loáiciga, A Sayeed - … of the BabyLM Challenge at the …, 2023 - aclanthology.org
We investigate the viability of surprisal in an active curriculum learning framework to train
transformer-based language models in the context of the BabyLM Challenge. In our …