Medium-sized protein language models perform well at transfer learning on realistic datasets

Abstract Protein language models (pLMs) can offer deep insights into evolutionary and structural properties of proteins. While larger models, such as the 15 billion parameter model ESM-2, promise to capture more complex patterns in sequence space, they also present practical challenges due to their...

Full description

Bibliographic Details

Published in:	Scientific Reports
Main Authors:	Luiz C. Vieira, Morgan L. Handojo, Claus O. Wilke
Format:	Article
Language:	English
Published:	Nature Portfolio 2025-07-01
Subjects:	ESM Transfer learning pLM embeddings Embeddings compression
Online Access:	https://doi.org/10.1038/s41598-025-05674-x