Legal-BigBird: An Adapted Long-Range Transformer for Legal Documents
Date:
Poster The talk introduced the fine-tuning of the linear scaling Transformer model Bigbird on legal corpora, then the resulting model as an off-the-shelf encoder for retrival task on legal court cases.