How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Dec…
Aug 1, 2024
qualcomm.com
DFlash Boosts Speculative Decoding with Lightweight Block Diffusion | Kalyan KS posted on the topic | LinkedIn
DFlash Boosts Speculative Decoding with Lightweight Block …
2 views1 month ago
linkedin.com
Speculative Decoding — Think Fast⚡, Then Think Right✅
Speculative Decoding — Think Fast⚡, Then Think Right✅
10 months ago
substack.com
Faster LLMs: Accelerate Inference with Speculative Decoding
Faster LLMs: Accelerate Inference with Speculative Decoding
8 months ago
ibm.com
T-pro 2.0: Efficient Russian Reasoning LLM
3:49
T-pro 2.0: Efficient Russian Reasoning LLM
2 months ago
YouTubeAI Research Roundup
Generate 10 Tokens At Once - Faster LLM INFERENCE - AdaSPEC - Speculative Decoding Improvement
11:34
Generate 10 Tokens At Once - Faster LLM INFERENCE - AdaSPE…
448 views3 months ago
YouTubeVuk Rosić
AI Frontiers: cs.CL Papers Nov 27-28, 2025
9:22
AI Frontiers: cs.CL Papers Nov 27-28, 2025
10 views2 months ago
YouTubeAI Frontiers
3:14
AutoDeco: End-to-End Learned Decoding for LLMs
1 views3 months ago
YouTubeAI Research Roundup
1:36
TiDAR: The Future of AI Speed & Quality (One Step, 5x Faster) #Sho…
1 month ago
YouTubeCollapsedLatents
0:59
Speculative Decoding explained in Hindi #aiengineering #datascienc…
24 views3 weeks ago
YouTubeLearn AI with RC
0:46
Speculative Decoding Turbocharge Your LLM Inference! #ai, #llm, #inf…
25 views2 weeks ago
YouTubeThe Code Architect
1:02:23
EP5: Speculative Decoding with Nadav Timor
4 months ago
YouTubeThe Information Bottleneck
0:36
How AI Replies So Fast! ⚡ Speculative Decoding
130 views1 month ago
YouTubeMr. Doubty – Short. Smart. Techy
Everyone talks about our hardware at Cerebras. Few notice the softwa…
1 views1 month ago
linkedin.com
ESE 471: Block Encoding and Decoding with Example
1.8K viewsApr 7, 2020
YouTubeNeal Patwari
What is Speculative Sampling? | Boosting LLM inference speed
3.3K viewsNov 20, 2024
YouTubeAssemblyAI
Efficient Streaming Language Models with Attention Sinks (Pape…
37.5K viewsOct 14, 2023
YouTubeYannic Kilcher
6:47
Transformer models: Encoder-Decoders
103K viewsJun 14, 2021
YouTubeHuggingFace
3:57
Advanced Data Structures: Huffman Decoding
31.5K viewsMay 8, 2020
YouTubeNiema Moshiri
2:04
LLM Jargons Explained
1.9K viewsMar 3, 2024
YouTubeSachin Kalsi
13:47
LLM Jargons Explained: Part 4 - KV Cache
10.5K viewsMar 24, 2024
YouTubeSachin Kalsi
35:45
How to Build an LLM from Scratch | An Overview
454.6K viewsOct 5, 2023
YouTubeShaw Talebi
12:10
Optimize Your AI - Quantization Explained
369.3K viewsDec 28, 2024
YouTubeMatt Williams
5:18
LLM Evaluation Basics: Datasets & Metrics
16.4K viewsJun 12, 2023
YouTubeGenerative AI at MIT
36:12
Deep Dive: Optimizing LLM inference
44.6K viewsMar 11, 2024
YouTubeJulien Simon
4:17
LLM Explained | What is LLM
394.8K viewsAug 22, 2023
YouTubecodebasics
17:20
Structured Output from LLMs: Grammars, Regex, and State Mach…
7.7K viewsDec 6, 2024
YouTubeEfficient NLP
7:54
Encoder-decoder architecture: Overview
72.7K viewsJun 5, 2023
YouTubeGoogle Cloud Tech
54:05
LLMs | Efficient LLM Decoding-I | Lec15.1
2.3K viewsOct 4, 2024
YouTubeLCS2
13:53
Generate LLM Embeddings On Your Local Machine
27K viewsJan 13, 2024
YouTubeNeuralNine
See more videos
Static thumbnail place holder