• Invited Talks
• March 8, 2024

Joel Kowalewski, PhD Finetuning LLMs for Specific Tasks Introduction to Embeddings and Tokenization At the core of modern language models (LLMs) like GPT-3,4 and BERT are the concepts of embeddings and tokenization. Tokenization initially was simply a method to group text data into smaller packets that are easier to process, resulting in better predictive models. As LLMs steadily developed alongside …

• Invited Talks
• May 20, 2023

Table of Contents Introduction This post is a walkthrough for a series of two public talks given in April and May 2023 for the COM SCI series at UCLA. It was on transformers, diffusion models, and discussed specific examples such as Open AI’s ChatGPT and DALL-E 2 for a general audience, while being sufficiently technical to be of interest to …