Legal-BigBird: An Adapted Long-Range Transformer for Legal Documents
Published in Black in AI Workshop NeurIPS 2021, 2021
This paper is about the fine-tuning of the linear scaling Transformer model Bigbird on legal corpora, then the resulting model as an off-the-shelf encoder for retrival task on legal court cases.
Recommended citation: Loic Kwae Dassi. Legal-BigBird: An Adapted Long-Range Transformer for Legal Documents. NeurIPS 2021 Workshop: Black in AI, 2021. https://www.researchgate.net/profile/Loic-Kwate-Dassi/publication/356930560_Legal-BigBird_An_Adapted_Long-Range_Transformer_for_Legal_Documents/links/61b5fdee63bbd9324289b54e/Legal-BigBird-An-Adapted-Long-Range-Transformer-for-Legal-Documents.pdf