Recently, language models (LMs), especially large language models (LLMs), have
revolutionized the field of deep learning. Both encoder-decoder models and prompt-based …

Large language models (LLMs) such as ChatGPT have significantly advanced the field of
Natural Language Processing (NLP). This trend led to the development of code-based large …

Code is increasingly becoming a core data modality of modern machine learning research
impacting not only the way we write code with conversational agents like OpenAI's ChatGPT …

The imperative need to scale computation across numerous nodes highlights the
significance of efficient parallel computing, particularly in the realm of Message Passing …

Manual parallelization of code remains a significant challenge due to the complexities of
modern software systems and the widespread adoption of multi-core architectures. This …

Performance inefficiencies challenge software development, degrading application
performance and wasting computational resources. Application developers invest …