All the Trainingz, No Codez

This talk demonstrates how to train, finetune, and preference tune large language models on a home computer using advanced methods like LoRA, DPO, ORPO, and RLHF without coding.

Overview

What if it was possible to train, finetune, and preference tune LLMs on your own computer using advanced methods including LoRA, DPO, ORPO, RLHF, etc without writing any code?

Today we will demo advanced training of Large Language Models using a home computer using Transformer Lab.

Video

Links

https://transformerlab.ai/
Open-source platform for reproducible LLM/Diffusion training using MLX, CUDA, ROCm.

Tech stack