RoBERTa An optimised version of BERT with improved training techniques and performance, particularly on NLP benchmark tasks.