View markdown source on GitHub

Fine-tuning Protein Language Model

Contributors

Questions

Objectives

Requirements

last_modification Published: Mar 21, 2025
last_modification Last Updated: Mar 21, 2025

Language Models (LM)


Bidirectional Encoder Representations from Transformers (BERT)

BERT


Language Models (LMs)

Rise of language models and their sizes


Protein Language Model (pLM)


Architecture: Protein Language Model (pLM)

Architecture of protein language model


T-SNE embedding projections

TSNE embeddings of proteins and amino acids


Challenges for downstream tasks


Low-ranking adaption (LoRA)

TSNE embeddings of proteins and amino acids


Use-case: Dephosphorylation (Post-translational modification (PTM)) site prediction


References


For additional references, please see tutorial’s References section


Screenshot of the gtn stats page with 21 topics, 170 tutorials, 159 contributors, 16 scientific topics, and a growing community

Speaker Notes


Getting Help

Speaker Notes


Join an event

Event schedule

Speaker Notes


Key Points

Thank you!

This material is the result of a collaborative work. Thanks to the Galaxy Training Network and all the contributors! Galaxy Training Network Tutorial Content is licensed under Creative Commons Attribution 4.0 International License.