Talk, Black in AI Workshop Neurips 2020, Online
Poster The talk introduced the fine-tuning of the linear scaling Transformer model Bigbird on legal corpora, then the resulting model as an off-the-shelf encoder for retrival task on legal court cases.
Talk, Black in AI Workshop Neurips 2020, Addis Ababa, Ethiopia
Link to the Talk The project initiated the merging of the standard language modelling task and the algorith REINFORCE for the generation of text satisfying a given metric (semantic- and syntactic-based metrics)
Talk, AI for Science NeurIPS Workshop 2021, ELLIS Machine Learning for Molecule Discovery Workshop, Online
ELLIS Reference, NeurIPS Reference The talk introduced an unsupervised approach to identify enzymatic active sites of protein in bio-catalyzed reactions using attention-based language modelling