выпускать: 2026/11/22 12:00 читать: 0
Оригинальный автор:Pidoku
Первоисточник:https://www.youtube.com/embed/5fMTpe_M694
What actually happens between typing a question and an AI answering it? This video opens up the Transformer, the architecture behind GPT, Claude, Gemini and most modern language models, and follows one simple sentence, "The cat drinks milk.", through every step. You will see how text becomes tokens and token IDs, how embeddings and positional encoding turn them into vectors, how self-attention uses queries, keys and values, why multi-head attention exists, what the feed-forward network, residual connections and layer normalization do, how causal masking lets a model predict the next token, how training and inference work, and why the KV cache matters for running large language models on GPUs. No black boxes and no unnecessary jargon: one sentence, a series of diagrams, and the maths behind the scenes. Token IDs, vectors and percentages shown are illustrative. Timestamps 0:00 Intro: what happens when you ask an AI a question 1:01 Before Transformers: RNNs and the 2017 paper 2:14 Tokenization: text into token IDs 3:27 Embeddings: words as vectors 4:43 Positional encoding and RoPE 5:54 Self-attention: Query, Key and Value 8:52 Scaled dot-product attention, step by step 9:35 Multi-head attention 11:11 The feed-forward network 12:16 Residual connections and layer normalization 13:20 The complete Transformer block 14:08 Encoder, decoder, and BERT, GPT and T5 15:22 Causal masking 16:27 How a Transformer is trained 17:46 Inference: how text is generated 18:53 The KV cache 20:15 The complete journey 21:07 Why Transformers changed AI
CRYPTO_BEN
2026-11-22 22:30
子敬.轮回珠宝
2026-11-22 22:30
kumis patiler
2026-11-22 22:30
Ha Ms
2026-11-22 22:30
CryptoMetric
2026-11-22 22:30
劇翻天 Drama Go
2026-11-22 16:36
CryptoMason
2026-11-22 16:22
Lý Tử Ly
2026-11-22 14:42
Pidoku
2026-11-22 14:15
Выберите валюту
US Dollar
USD
Chinese Yuan
CNY
Japanese Yen
JPY
South Korean Won
KRW
New Taiwan Dollar
TWD
Canadian Dollar
CAD
Euro
EUR
Pound Sterling
GBP
Danish Krone
DKK
Hong Kong Dollar
HKD
Australian Dollar
AUD
Brazilian Real
BRL
Swiss Franc
CHF
Chilean Peso
CLP
Czech Koruna KČ
CZK
Singapore Dollar
SGD
Indian Rupee
INR
Saudi Riyal
SAR
Vietnamese Dong
VND
Thai Baht
THB
Выберите валюту
US Dollar
USD-$
Chinese Yuan
CNY-¥
Japanese Yen
JPY-¥
South Korean Won
KRW -₩
New Taiwan Dollar
TWD-NT$
Canadian Dollar
CAD-$
Euro
EUR - €
Pound Sterling
GBP-£
Danish Krone
DKK-KR
Hong Kong Dollar
HKD- $
Australian Dollar
AUD-$
Brazilian Real
BRL -R$
Swiss Franc
CHF -FR
Chilean Peso
CLP-$
Czech Koruna KČ
CZK -KČ
Singapore Dollar
SGD-S$
Indian Rupee
INR -₹
Saudi Riyal
SAR -SAR
Vietnamese Dong
VND-₫
Thai Baht
THB -฿