Oxen Courses

Inside OpenCoder - Data Processing and Training Pipeline for Code LLMs

Delve into the technical details of OpenCoder's development, from data preprocessing and deduplication to training methodology and evaluation metrics for building effective code LLMs.

• YouTube
• 55 minutes
• On-Demand
• Free Video

RAGAS - A Framework for Evaluating Retrieval Augmented Generation Systems

Explore RAGAS framework's key evaluation criteria for Retrieval Augmented Generation (RAG) systems, covering faithfulness, answer relevance, and context relevance metrics for improved AI performance.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Understanding DeepSeek R1 and GRPO - A Technical Deep Dive

Dive into the technical architecture and development process of DeepSeek's R1 model, exploring GRPO implementation, reasoning capabilities, and model optimization techniques through detailed examples.

• YouTube
• 45 minutes
• On-Demand
• Free Video

The Prompt Report: Understanding Prompting Techniques and Taxonomy - Part 1

Explore systematic prompting techniques through an in-depth analysis of template structures, zero-shot methods, emotion prompting, and thought generation approaches for enhanced AI interactions.

• YouTube
• 57 minutes
• On-Demand
• Free Video

Inside the Rectified Flow Transformer Model - Understanding Advanced Image Generation

Dive into the technical architecture and methodology behind Flux, exploring rectified flow transformers, latent diffusion models, and the innovative approaches that led to superior image generation results.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Understanding How Llama 3.1 Works - A Technical Deep Dive

Dive into Meta's groundbreaking Llama 3 architecture, exploring pre-training techniques, model capabilities, synthetic data quality, and implementation strategies for advanced AI development.

• YouTube
• 52 minutes
• On-Demand
• Free Video

Samba: Simple Hybrid State Space Models for Language Modeling

Dive into the mechanics of Samba, a hybrid state space model built on Mamba that enables efficient unlimited context language modeling for advanced AI applications.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Efficient Text-to-Image Generation with PixART-α DiT Fine-Tuning

Dive into efficient text-to-image generation using PixART-α, exploring fine-tuning techniques, design principles, and practical implementation steps for diffusion transformers.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Training LLMs with Diffusion Techniques - From Theory to Implementation

Dive into implementing text generation using discrete diffusion modeling, covering implementation details from basic concepts to training scripts for creating GPT-2 competitive models.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Understanding Text Generation Through Diffusion Models - From Theory to Implementation

Dive into discrete diffusion modeling for text generation, exploring probability distributions, score-based modeling, and practical applications in generative AI that rival GPT-2's capabilities.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Understanding 1-Bit Large Language Models - From Theory to Implementation

Dive into the revolutionary concept of 1-bit Large Language Models, exploring how weights can be represented with simple integers (0, 1, -1) instead of complex floating-point numbers.

• YouTube
• 47 minutes
• On-Demand
• Free Video

Understanding I-JEPA: A Non-Generative Approach to Self-Supervised Learning from Images

Dive into Meta AI's I-JEPA framework for self-supervised image learning, exploring its architecture, methodology, and advantages over traditional approaches in computer vision and neural networks.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Fine-Tuning Self-Rewarding Language Models with Mistral 7B

Dive into implementing Meta's Self-Rewarding Language Model with Mistral 7B, covering fine-tuning techniques, data preparation, prompt generation, and practical demonstrations.

• YouTube
• 43 minutes
• On-Demand
• Free Video

Understanding Diffusion Transformers and the Technology Behind Sora

Dive into the technical foundations behind OpenAI's Sora, exploring diffusion transformers, U-Nets, and latent diffusion models that power this groundbreaking video generation technology.

• YouTube
• 39 minutes
• On-Demand
• Free Video

Understanding Medusa: A Framework for LLM Inference Acceleration with Multiple Decoding Heads

Dive into the mechanics of Medusa, a framework that accelerates LLM inference through parallel token prediction and tree-based attention, enhancing AI model performance and efficiency.

• YouTube
• 52 minutes
• On-Demand
• Free Video