Skip to content

Module 1 – I See Tensors Everywhere 🕶️

"Behold, fledgling datanauts! The world is naught but tensors awaiting my command — and soon, yours! " — Professor Victor Py Torchenstein

Salutations, my brilliant (and delightfully reckless) apprentices! By opening this manuscript you have volunteered to join my clandestine legion of PyTorch adepts. Consider this your official red-pill moment: from today every pixel, every token, every measly click-through rate shall reveal its true form—a multidimensional array begging to be torch.tensor-ed … and we shall oblige it with maniacal glee! Mwahaha! 🔥🧪

pytorch tensors everywhere

Over the next notebooks we will:

  • Conjure tensors from thin air, coffee grounds, and suspiciously random seeds.
  • Shape-shift them with view, reshape, squeeze, unsqueeze, permute & the occasional dramatic flourish of einops.
  • Crunch mathematics so ferocious it makes matrix multiplications whimper — and powers mighty Transformers.
  • Charm the GPU, dodge gradient explosions 🏃‍♂️💥, and look diabolically clever while doing it.

Rebel Mission Checklist 📝

Tensors: The Building Blocks

  1. Summoning Your First Tensors - Learn to create tensors from scratch and inspect their fundamental properties like shape, type, and device.
  2. Tensor Shape-Shifting & Sorcery - Master the arts of slicing, stacking, and reshaping tensors to bend data to your will.
  3. DTypes & Devices: Choose Your Weapons - Understand how to manage data types and move your tensors to the GPU for accelerated computation.

Tensor Operations: Computation at Scale

  1. Elemental Tensor Alchemy - Perform powerful element-wise and reduction operations to transform your tensors.
  2. Matrix Mayhem: Multiply or Perish - Unleash the raw power of matrix multiplication, the core of modern neural networks.
  3. Broadcasting: When Dimensions Bow to You - Discover the magic of broadcasting, where PyTorch intelligently handles operations on tensors of different shapes.

Einstein Summation: The Power of einsum

  1. Einstein Summation: Harness the Λ-Power - Wield the elegant einsum to perform complex tensor operations with a single, concise command.
  2. Advanced Einsum Incantations - Combine multiple tensors in arcane einsum expressions for operations like batched matrix multiplication.

Autograd: Automatic Differentiation

  1. Autograd: Ghosts in the Machine (Learning) - Uncover the secrets of automatic differentiation and see how PyTorch automatically computes gradients.
  2. Gradient Hoarding for Grand Spells - Learn the technique of gradient accumulation to simulate larger batch sizes and train massive models.

Enough talk! The tensors are humming with anticipation. Your first incantation awaits.

Proceed to the Summoning Ritual!