Spooky Sale: 10% off Premium yearly · $118.80 for the first year · until Nov 6Get it

Deep-ML
Learn
Problems1,200+ hands-on ML problemsLearning PathA guided route through the fundamentalsLabsInteractive labs on real techniquesProjectsBuild a GPT, an RL agent, CUDA kernelsCollectionsCurated problem sets and videosMathPen-and-paper math for MLIntuitionInvent the idea behind the formula yourselfPlaylistsYour own problem lists, shareableStudy AssistantAn AI teacher that knows your progress
Interview Prep
Compete
ContestsFresh problem sets, ranked liveLeaderboardWhere you stand, globallyBuddiesSolve with a friend: streaks, a weekly board, chat
Discuss
Deep-Path
Premium
      Intuition
      62 of 88

      Keep the original

      A network is a stack of blocks. In each one a layer computes a change = layer_weight × the signal, number by number. Write block(signal, layer_weight): what this block passes on to the next. At the start of training every layer weight is near 0, and a deep network stacks 50 of these blocks.

      signal
      2−0.51
      layer_weight
      0.1
      the layer’s change = layer_weight × signal
      0.2−0.050.1
      solution.pyLoading Python
      ← Keep the signal aliveDon’t depend on the neighbours →