Natural Language Processing

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their …
BIG-bench contributors including, Andrea Santilli, Antonio Norelli, Emanuele Rodolà, Giambattista Parascandolo, Giorgio Mariani, Luca Moschella, Simone Melzi
PDF Cite arXiv
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
PromptSource is a system for creating, sharing, and using natural language prompts. Prompts are functions that map an example from a …
Stephen Bach, Victor Sanh, Zheng Xin Yong, Albert Webson, Colin Raffel, BIG-Science contributors including, Andrea Santilli
PDF Cite DOI ACL 2022 Demo
PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts
Multitask Prompted Training Enables Zero-Shot Task Generalization
Large language models have recently been shown to attain reasonable zero-shot generalization on a diverse set of tasks (Brown et al., …
Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, BIG-Science contributors including, Andrea Santilli
PDF Cite ICLR 2022 (Oral)
Multitask Prompted Training Enables Zero-Shot Task Generalization
KERMIT: Complementing Transformer Architectures with Encoders of Explicit Syntactic Interpretations
Syntactic parsers have dominated natural language understanding for decades. Yet, their syntactic interpretations are losing centrality …
Fabio Massimo Zanzotto, Andrea Santilli, Leonardo Ranaldi, Dario Onorati, Pierfrancesco Tommasino, Francesca Fallucchi
PDF Cite DOI EMNLP 2020
KERMIT: Complementing Transformer Architectures with Encoders of Explicit Syntactic Interpretations