Media Summary: This lightning talk dives into real-world Curious how to apply resource-intensive generative AI models across massive datasets without breaking the bank? This session ... This talk explores essential strategies such as quantization, batching, caching, and hardware-aware optimizations that bridge the ...

Scaling Genai Inference From Prototype - Detailed Analysis & Overview

This lightning talk dives into real-world Curious how to apply resource-intensive generative AI models across massive datasets without breaking the bank? This session ... This talk explores essential strategies such as quantization, batching, caching, and hardware-aware optimizations that bridge the ... Download the AI model guide to learn more → Learn more about the technology → Generative AI is transforming industries, but Learn more about SuperAI: superai.com Follow us on X: x.com/superai_conf Keynote:

AI factories are the new industrial engines — and their profitability hinges on how efficiently they generate intelligence. The rise of ... Gartner predicts at least 30% of generative AI projects will be abandoned after proof of concept by the end of 2025. This session ... See the detailed reference architecture → Learn how to use JAX, Google Kubernetes Engine (GKE) and ... We sat down with Valentin Bercovici to discuss the critical shift from hardware-heavy model training to the high-stakes world of AI ... In our first episode of No Math AI, Akash and Isha are joined by guest research engineers Shivchander Sudalairaj, GX Xu, and Kai ...

Photo Gallery

Scaling GenAI Inference From Prototype to Production: Real-World Lessons in Speed & Cost
Scaling Generative AI: Batch Inference Strategies for Foundation Models
Scaling Inference for Generative AI by Byung-Gon Chun
AI Inference: The Secret to AI's Superpowers
Scaling GenAI inference: Techniques, optimizations, and real-world lessons
Gyeong-In Yu - Scaling Generative AI Inference at Trillion-Token Scale - SuperAI Singapore 2025
Inference at Scale: The New Frontier for AI Infrastructure and ROI
SFF 2024 | Operationalising GenAI at Scale: From Prototype to Production - Powered by Zühlke
The secret to cost-efficient AI inference
Scaling Beyond the Memory Wall: How WEKA is Revolutionizing AI Inference
Inference-time scaling: How small models beat the big ones | No Math AI
Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou
View Detailed Profile
Scaling GenAI Inference From Prototype to Production: Real-World Lessons in Speed & Cost

Scaling GenAI Inference From Prototype to Production: Real-World Lessons in Speed & Cost

This lightning talk dives into real-world

Scaling Generative AI: Batch Inference Strategies for Foundation Models

Scaling Generative AI: Batch Inference Strategies for Foundation Models

Curious how to apply resource-intensive generative AI models across massive datasets without breaking the bank? This session ...

Scaling Inference for Generative AI by Byung-Gon Chun

Scaling Inference for Generative AI by Byung-Gon Chun

This talk explores essential strategies such as quantization, batching, caching, and hardware-aware optimizations that bridge the ...

AI Inference: The Secret to AI's Superpowers

AI Inference: The Secret to AI's Superpowers

Download the AI model guide to learn more → https://ibm.biz/BdaJTb Learn more about the technology → https://ibm.biz/BdaJTp ...

Scaling GenAI inference: Techniques, optimizations, and real-world lessons

Scaling GenAI inference: Techniques, optimizations, and real-world lessons

Generative AI is transforming industries, but

Gyeong-In Yu - Scaling Generative AI Inference at Trillion-Token Scale - SuperAI Singapore 2025

Gyeong-In Yu - Scaling Generative AI Inference at Trillion-Token Scale - SuperAI Singapore 2025

Learn more about SuperAI: superai.com Follow us on X: x.com/superai_conf Keynote:

Inference at Scale: The New Frontier for AI Infrastructure and ROI

Inference at Scale: The New Frontier for AI Infrastructure and ROI

AI factories are the new industrial engines — and their profitability hinges on how efficiently they generate intelligence. The rise of ...

SFF 2024 | Operationalising GenAI at Scale: From Prototype to Production - Powered by Zühlke

SFF 2024 | Operationalising GenAI at Scale: From Prototype to Production - Powered by Zühlke

Gartner predicts at least 30% of generative AI projects will be abandoned after proof of concept by the end of 2025. This session ...

The secret to cost-efficient AI inference

The secret to cost-efficient AI inference

See the detailed reference architecture → https://goo.gle/4bKh5aR Learn how to use JAX, Google Kubernetes Engine (GKE) and ...

Scaling Beyond the Memory Wall: How WEKA is Revolutionizing AI Inference

Scaling Beyond the Memory Wall: How WEKA is Revolutionizing AI Inference

We sat down with Valentin Bercovici to discuss the critical shift from hardware-heavy model training to the high-stakes world of AI ...

Inference-time scaling: How small models beat the big ones | No Math AI

Inference-time scaling: How small models beat the big ones | No Math AI

In our first episode of No Math AI, Akash and Isha are joined by guest research engineers Shivchander Sudalairaj, GX Xu, and Kai ...

Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou

Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou

LLM

Workshop: Foundry: How to 10x AI Agent Price Performance with Inference Time Scaling

Workshop: Foundry: How to 10x AI Agent Price Performance with Inference Time Scaling

The initial