Media Summary: GEPA is a SUPER exciting advancement for DSPy and a new generation of optimization algorithms re-imagined with LLMs! To participate in discussion forums, enroll in our Large Language Models course on edX for free here: ... A description of how quasi Newton algorithms in general, and in special the BFGS algorithm work. Animations are made with the ...

Pockengine Sparse And Efficient Fine - Detailed Analysis & Overview

GEPA is a SUPER exciting advancement for DSPy and a new generation of optimization algorithms re-imagined with LLMs! To participate in discussion forums, enroll in our Large Language Models course on edX for free here: ... A description of how quasi Newton algorithms in general, and in special the BFGS algorithm work. Animations are made with the ... zml/attnd replaces dense attention with a [SIGGRAPH 2024 Best Paper Honorable Mention] - NYU & Meta Kenneth Chen, Thomas Wan, Nathan Matsuda, Ajit Ninan, ... Stop letting your embeddings leave your data platform! In this video, we explore how to run a high-performance vector index ...

Ready to move beyond memory limits and scale your LLM In this video you will learn about three very common methods for data dimensionality reduction: PCA, t-SNE and UMAP. These are ... Xiang Meng, PhD student at the Massachusetts Institute of Technology, presents an overview of his NeurIPS 2024 paper "ALPS: ... Prompt caching is how agents avoid recomputing the same prompt prefix on every turn. I explain what it is, how to keep your ...

Photo Gallery

PockEngine: Sparse and Efficient Fine-tuning in a Pocket, [MICRO 2023]
MiniMax Sparse Attention: Efficient Blockwise Sparsity for Ultra-Long Contexts
GEPA Explained!
Fine-tuning LLMs with PEFT and LoRA
LLM2 Module 2 - Efficient Fine-Tuning | 2.3 PEFT and Soft Prompt
Understanding scipy.minimize part 1: The BFGS algorithm
Towards unlimited contexts: faster-than-GPU sparse logarithmic attention on CPU - AI Engineer Paris
PEA-PODs: Perceptual Evaluation Of Algorithms for Power Optimization In XR Displays -- SIGGRAPH 2024
TurboVec in Snowflake SPCS: 63x Faster Vector Search for RAG
Webinar: Scaling LLM Fine-Tuning with FSDP, DeepSpeed, and Ray
Latent Space Visualisation: PCA, t-SNE, UMAP | Deep Learning Animated
ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for LLMs
View Detailed Profile
PockEngine: Sparse and Efficient Fine-tuning in a Pocket, [MICRO 2023]

PockEngine: Sparse and Efficient Fine-tuning in a Pocket, [MICRO 2023]

Talk video for MICRO 2023 paper: "

MiniMax Sparse Attention: Efficient Blockwise Sparsity for Ultra-Long Contexts

MiniMax Sparse Attention: Efficient Blockwise Sparsity for Ultra-Long Contexts

Introducing the MiniMax

GEPA Explained!

GEPA Explained!

GEPA is a SUPER exciting advancement for DSPy and a new generation of optimization algorithms re-imagined with LLMs!

Fine-tuning LLMs with PEFT and LoRA

Fine-tuning LLMs with PEFT and LoRA

LoRA Colab : https://colab.research.google.com/drive/14xo6sj4dARk8lXZbOifHEn1f_70qNAwy?usp=sharing Blog Post: ...

LLM2 Module 2 - Efficient Fine-Tuning | 2.3 PEFT and Soft Prompt

LLM2 Module 2 - Efficient Fine-Tuning | 2.3 PEFT and Soft Prompt

To participate in discussion forums, enroll in our Large Language Models course on edX for free here: ...

Understanding scipy.minimize part 1: The BFGS algorithm

Understanding scipy.minimize part 1: The BFGS algorithm

A description of how quasi Newton algorithms in general, and in special the BFGS algorithm work. Animations are made with the ...

Towards unlimited contexts: faster-than-GPU sparse logarithmic attention on CPU - AI Engineer Paris

Towards unlimited contexts: faster-than-GPU sparse logarithmic attention on CPU - AI Engineer Paris

zml/attnd replaces dense attention with a

PEA-PODs: Perceptual Evaluation Of Algorithms for Power Optimization In XR Displays -- SIGGRAPH 2024

PEA-PODs: Perceptual Evaluation Of Algorithms for Power Optimization In XR Displays -- SIGGRAPH 2024

[SIGGRAPH 2024 Best Paper Honorable Mention] - NYU & Meta Kenneth Chen, Thomas Wan, Nathan Matsuda, Ajit Ninan, ...

TurboVec in Snowflake SPCS: 63x Faster Vector Search for RAG

TurboVec in Snowflake SPCS: 63x Faster Vector Search for RAG

Stop letting your embeddings leave your data platform! In this video, we explore how to run a high-performance vector index ...

Webinar: Scaling LLM Fine-Tuning with FSDP, DeepSpeed, and Ray

Webinar: Scaling LLM Fine-Tuning with FSDP, DeepSpeed, and Ray

Ready to move beyond memory limits and scale your LLM

Latent Space Visualisation: PCA, t-SNE, UMAP | Deep Learning Animated

Latent Space Visualisation: PCA, t-SNE, UMAP | Deep Learning Animated

In this video you will learn about three very common methods for data dimensionality reduction: PCA, t-SNE and UMAP. These are ...

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for LLMs

ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for LLMs

Xiang Meng, PhD student at the Massachusetts Institute of Technology, presents an overview of his NeurIPS 2024 paper "ALPS: ...

Why agents recompute the same prompt, and how servers exploit it

Why agents recompute the same prompt, and how servers exploit it

Prompt caching is how agents avoid recomputing the same prompt prefix on every turn. I explain what it is, how to keep your ...