Introduction to Large Language Models (LLMs) Training Course

Introduction

• What are Large Language Models (LLMs)?
• LLMs versus traditional NLP models
• Overview of LLM features and architecture
• Challenges and limitations of LLMs

Understanding LLMs

• The lifecycle of an LLM
• How LLMs work
• The main components of an LLM: encoder, decoder, attention, embeddings, and more.

Getting Started

• Setting up the development environment
• Installing an LLM as a development tool, e.g. Google Colab, Hugging Face

Working with LLMs

• Exploring available LLM options
• Creating and using an LLM
• Fine-tuning an LLM on a custom dataset

Text Summarisation

• Understanding the task of text summarisation and its applications
• Using an LLM for extractive and abstractive text summarisation
• Evaluating the quality of generated summaries using metrics such as ROUGE, BLEU, and more.

Question Answering

• Understanding the task of question answering and its applications
• Using an LLM for open-domain and closed-domain question answering
• Evaluating the accuracy of generated answers using metrics such as F1, EM, and more.

Text Generation

• Understanding the task of text generation and its applications
• Using an LLM for conditional and unconditional text generation
• Controlling the style, tone, and content of generated texts using parameters such as temperature, top-k, top-p, and more.

Integrating LLMs with Other Frameworks and Platforms

• Using LLMs with PyTorch or TensorFlow
• Using LLMs with Flask or Streamlit
• Using LLMs with Google Cloud or AWS

Troubleshooting

• Understanding common errors and bugs in LLMs
• Using TensorBoard to monitor and visualise the training process
• Using PyTorch Lightning to simplify training code and improve performance
• Using Hugging Face Datasets to load and preprocess data

Summary and Next Steps