Get in Touch

Course Outline

Introduction

  • What are Large Language Models (LLMs)?
  • LLMs versus traditional NLP models
  • Overview of LLM features and architecture
  • Challenges and limitations of LLMs

Understanding LLMs

  • The lifecycle of an LLM
  • How LLMs work
  • The main components of an LLM: encoder, decoder, attention, embeddings, and more.

Getting Started

  • Setting up the development environment
  • Installing an LLM as a development tool, e.g. Google Colab, Hugging Face

Working with LLMs

  • Exploring available LLM options
  • Creating and using an LLM
  • Fine-tuning an LLM on a custom dataset

Text Summarisation

  • Understanding the task of text summarisation and its applications
  • Using an LLM for extractive and abstractive text summarisation
  • Evaluating the quality of generated summaries using metrics such as ROUGE, BLEU, and more.

Question Answering

  • Understanding the task of question answering and its applications
  • Using an LLM for open-domain and closed-domain question answering
  • Evaluating the accuracy of generated answers using metrics such as F1, EM, and more.

Text Generation

  • Understanding the task of text generation and its applications
  • Using an LLM for conditional and unconditional text generation
  • Controlling the style, tone, and content of generated texts using parameters such as temperature, top-k, top-p, and more.

Integrating LLMs with Other Frameworks and Platforms

  • Using LLMs with PyTorch or TensorFlow
  • Using LLMs with Flask or Streamlit
  • Using LLMs with Google Cloud or AWS

Troubleshooting

  • Understanding common errors and bugs in LLMs
  • Using TensorBoard to monitor and visualise the training process
  • Using PyTorch Lightning to simplify training code and improve performance
  • Using Hugging Face Datasets to load and preprocess data

Summary and Next Steps

Requirements

  • A solid understanding of natural language processing and deep learning
  • Experience with Python and PyTorch or TensorFlow
  • Basic programming experience

Audience

  • Developers
  • NLP enthusiasts
  • Data scientists
 14 Hours

Number of participants


Price per participant

Provisional Upcoming Courses (Require 5+ participants)

Related Categories