Video notes

Long videos.
Clear notes.

I watch the full video, separate the evidence from the claims, and keep the parts worth coming back to.

2 VIDEOS · SOURCES AND TIMESTAMPS INCLUDED

YouTube thumbnail for AI Just Broke A Bitcoin WalletWatch on YouTube ↗

SECURITY / BITCOIN

AI Just Broke A Bitcoin Wallet

The title sounds bigger than the evidence. This ARK Invest discussion is really about a reported weakness in older Coldcard hardware wallets. AI did not break Bitcoin’s cryptography or protocol; it reportedly helped identify a flaw in one wallet product’s firmware.

Watch the source ↗

Main points

  • Some older Coldcard Mark III wallets reportedly generated private keys with far less randomness than intended—around 32 bits of entropy rather than a 256-bit space. That could make affected keys searchable using ordinary computing hardware.
  • The speakers associate the issue with the movement of roughly 1,000 BTC, but the connection between the suspected vulnerability and every transfer has not been definitively established.
  • An open-weight model called Kimi K3 reportedly produced a detailed vulnerability report, while guarded closed models initially restricted similar analysis.
  • AI can reduce an initial security audit from weeks and large specialist budgets to hours and hundreds of dollars. Its findings still need expert validation and reproducible testing.
  • Domain expertise combined with AI helps defenders reject false positives and understand which findings are genuinely exploitable.
  • Some companies are building continuous, locally hosted “AI immune systems” that review code changes, dependencies, and repositories without sending sensitive findings outside the organization.
  • The incident does not invalidate self-custody. Multi-vendor multisignature setups can reduce single-device risk, although they add operational complexity.
  • There is no universal custody answer: self-custody, professional custody, and Bitcoin ETFs trade independence against convenience, privacy, liquidity, and counterparty risk.
  • AI may weaken the market for undisclosed zero-day vulnerabilities because flaws can be found and exploited faster, forcing maintainers toward continuous security review.
  • The quantum-computing section is speculative. The speakers believe useful cryptographic attacks remain years away but argue that Bitcoin should prepare migration paths.

What I took from it: The title is deliberately dramatic. The useful point is that vulnerability discovery is becoming faster and cheaper for both attackers and defenders. Bitcoin remained intact, but software teams need more continuous security testing.

YouTube thumbnail for Stanford CS336 architecture and hyperparameters lectureWatch on YouTube ↗

STANFORD CS336 / LANGUAGE MODELS

Architectures and hyperparameters

Tatsunori Hashimoto compares successful language models to find the Transformer choices that have become dependable defaults. This is an architecture survey, not a step-by-step coding tutorial.

Main points

  • Modern Transformers remain close to the original design. Most changes refine stability, speed, or inference cost rather than replacing the architecture.
  • Pre-normalization keeps the residual path clean and helps gradients travel through deep networks reliably.
  • RMSNorm largely replaces LayerNorm because it performs similarly with fewer operations and less memory movement.
  • Bias terms are commonly removed because they add little useful capacity but create extra memory operations.
  • Gated feed-forward layers such as SwiGLU and GeGLU generally outperform ReLU or GELU. Their hidden dimension is often about 8/3 of model width rather than 4×.
  • RoPE is the dominant positional method, encoding relative positions by rotating pairs of vector coordinates at different frequencies.
  • Many hyperparameters are forgiving. Hardware efficiency often matters more than a theoretically perfect width, depth, or head ratio.
  • Larger vocabularies support multilingual models: production systems commonly use 100,000–200,000 tokens rather than roughly 30,000.
  • Weight decay can improve optimization even when overfitting is unlikely, possibly through its interaction with the learning-rate schedule.
  • At scale, stability techniques include Z-loss, QK normalization, and sometimes logit soft-capping.
  • Grouped-query attention reduces KV-cache memory while retaining nearly the quality of full multi-head attention.
  • Long-context models increasingly alternate cheaper sliding-window attention with occasional full-attention layers.
A PRACTICAL STARTING POINT

Pre-norm + RMSNorm + no biases + SwiGLU + RoPE + GQA

Add QK normalization and hybrid local/global attention when stability or long context requires them.

What I took from it: Language-model architecture is less about finding one perfect design and more about balancing quality, stability, GPU efficiency, and inference cost.