Media Summary: Watch Meta AI's Wanchao Liang present his team's poster " PyTorch 2.0 Q&A: 🗓️ March 1 ⏰ 11am PT ✓ Register: ... Here's a talk I gave to to Machine Learning @ Berkeley Club! We discuss various

2 D Parallelism Using Distributedtensor - Detailed Analysis & Overview

Watch Meta AI's Wanchao Liang present his team's poster " PyTorch 2.0 Q&A: 🗓️ March 1 ⏰ 11am PT ✓ Register: ... Here's a talk I gave to to Machine Learning @ Berkeley Club! We discuss various ISCA'25: The 52nd International Symposium on Computer Architecture Session 5B: HPC for ML/AI Session Chair: Gagandeep ... Training a 7B, 7-B, or even 500B parameter model on a single GPU? Impossible. In this step-by-step guide you'll learn how to ... ai.bythebay.io Nov 2025, Oakland, full-stack AI conference

Discover how DDP harnesses multiple GPUs across machines to handle larger models and datasets, accelerating the training ... Paper by Boxiang Wang, Qifan Xu, Zhengda Bian and Yang You, presented at ICPP'22. We introduce DISTAL, a compiler for dense The first webinar presented by Edgar Solomonik (UC Berkeley) within the framework of

Photo Gallery

Two Dimensional Parallelism Using Distributed Tensors at PyTorch Conference 2022
2-D Parallelism using DistributedTensor and PyTorch DistributedTensor
Distributed ML Talk @ UC Berkeley
LLM Inference Optimization #2: Tensor, Data & Expert Parallelism (TP, DP, EP, MoE)
ISCA'25 - Session 5B - MeshSlice: Efficient 2D Tensor Parallelism for Distributed DNN Training
Scale ANY Model: PyTorch DDP, ZeRO, Pipeline & Tensor Parallelism Made Simple (2025 Guide)
Bay.Area.AI: Tensor and 2D Parallelism -- Junjie Wang, Xilun Wu,Iris Zhang
Lightning Talk: Tensor and 2D Parallelism - Rodrigo Kumpera & Junjie Wang, Meta
How DDP works || Distributed Data Parallel || Quick explained
Tesseract: Parallelize the Tensor Parallelism Efficiently
Rohan Yadav: DISTAL, The Distributed Tensor Algebra Compiler
A parallel tensor framework for Coupled Cluster
View Detailed Profile
Two Dimensional Parallelism Using Distributed Tensors at PyTorch Conference 2022

Two Dimensional Parallelism Using Distributed Tensors at PyTorch Conference 2022

Watch Meta AI's Wanchao Liang present his team's poster "

2-D Parallelism using DistributedTensor and PyTorch DistributedTensor

2-D Parallelism using DistributedTensor and PyTorch DistributedTensor

PyTorch 2.0 Q&A: 🗓️ March 1 ⏰ 11am PT ✓ Register: ...

Distributed ML Talk @ UC Berkeley

Distributed ML Talk @ UC Berkeley

Here's a talk I gave to to Machine Learning @ Berkeley Club! We discuss various

LLM Inference Optimization #2: Tensor, Data & Expert Parallelism (TP, DP, EP, MoE)

LLM Inference Optimization #2: Tensor, Data & Expert Parallelism (TP, DP, EP, MoE)

Part

ISCA'25 - Session 5B - MeshSlice: Efficient 2D Tensor Parallelism for Distributed DNN Training

ISCA'25 - Session 5B - MeshSlice: Efficient 2D Tensor Parallelism for Distributed DNN Training

ISCA'25: The 52nd International Symposium on Computer Architecture Session 5B: HPC for ML/AI Session Chair: Gagandeep ...

Scale ANY Model: PyTorch DDP, ZeRO, Pipeline & Tensor Parallelism Made Simple (2025 Guide)

Scale ANY Model: PyTorch DDP, ZeRO, Pipeline & Tensor Parallelism Made Simple (2025 Guide)

Training a 7B, 7-B, or even 500B parameter model on a single GPU? Impossible. In this step-by-step guide you'll learn how to ...

Bay.Area.AI: Tensor and 2D Parallelism -- Junjie Wang, Xilun Wu,Iris Zhang

Bay.Area.AI: Tensor and 2D Parallelism -- Junjie Wang, Xilun Wu,Iris Zhang

ai.bythebay.io Nov 2025, Oakland, full-stack AI conference

Lightning Talk: Tensor and 2D Parallelism - Rodrigo Kumpera & Junjie Wang, Meta

Lightning Talk: Tensor and 2D Parallelism - Rodrigo Kumpera & Junjie Wang, Meta

Lightning Talk:

How DDP works || Distributed Data Parallel || Quick explained

How DDP works || Distributed Data Parallel || Quick explained

Discover how DDP harnesses multiple GPUs across machines to handle larger models and datasets, accelerating the training ...

Tesseract: Parallelize the Tensor Parallelism Efficiently

Tesseract: Parallelize the Tensor Parallelism Efficiently

Paper by Boxiang Wang, Qifan Xu, Zhengda Bian and Yang You, presented at ICPP'22.

Rohan Yadav: DISTAL, The Distributed Tensor Algebra Compiler

Rohan Yadav: DISTAL, The Distributed Tensor Algebra Compiler

We introduce DISTAL, a compiler for dense

A parallel tensor framework for Coupled Cluster

A parallel tensor framework for Coupled Cluster

The first webinar presented by Edgar Solomonik (UC Berkeley) within the framework of

DISTAL: The Distributed Tensor Algebra Compiler

DISTAL: The Distributed Tensor Algebra Compiler

https://pldi22.sigplan.org/details/pldi-2022-pldi/12/DISTAL-The-