Hugging Face Course - Data Processing and Fine-tuning Techniques - Chapter 7

Learn advanced data processing techniques and evaluation metrics for various NLP tasks in this comprehensive tutorial covering custom loss functions, domain adaptation, and specialized data processing methods for token classification, language modeling, translation, summarization, and question answering, while exploring key metrics like perplexity, BLEU, and ROUGE scores, and mastering data collators for efficient model training.

Syllabus

Using a custom loss function
What is domain adaptation?
Data processing for Token Classification
Data processing for Causal Language Modeling
Data processing for Masked Language Modeling
What is perplexity?
Data processing for Translation
What is the BLEU metric?
Data processing for Summarization
What is the ROUGE metric?
Data processing for Question Answering
The Post processing step in Question Answering (PyTorch)
The Post processing step in Question Answering (TensorFlow)
Data Collators: A Tour