Spooky Sale: 10% off Premium yearly · $118.80 for the first year · until Nov 6Get it

Deep-ML
Learn
Problems1,200+ hands-on ML problemsLearning PathA guided route through the fundamentalsLabsInteractive labs on real techniquesProjectsBuild a GPT, an RL agent, CUDA kernelsCollectionsCurated problem sets and videosMathPen-and-paper math for MLIntuitionInvent the idea behind the formula yourselfPlaylistsYour own problem lists, shareableStudy AssistantAn AI teacher that knows your progress
Interview Prep
Compete
ContestsFresh problem sets, ranked liveLeaderboardWhere you stand, globallyBuddiesSolve with a friend: streaks, a weekly board, chat
Discuss
Deep-Path
Premium
      Intuition
      63 of 88

      Don’t depend on the neighbours

      Deep in a network, a layer’s outputs can drift: some examples come out huge, some tiny, and the next layer struggles. Write normalize(batch): batch is a list of examples, each a list of one layer’s outputs. Rescale them so the next layer always sees numbers of a standard size, whatever came in. The starter uses the standard score from “Who did better?” with the whole batch’s average and spread.

      batch: one row per example
      out 1out 2out 3out 4
      example 11236
      example 20.5102.5
      solution.pyLoading Python
      ← Keep the originalRandom no-shows →