Spooky Sale: 10% off Premium yearly · $118.80 for the first year · until Nov 6Get it

Deep-ML
Learn
Problems1,200+ hands-on ML problemsLearning PathA guided route through the fundamentalsLabsInteractive labs on real techniquesProjectsBuild a GPT, an RL agent, CUDA kernelsCollectionsCurated problem sets and videosMathPen-and-paper math for MLIntuitionInvent the idea behind the formula yourselfPlaylistsYour own problem lists, shareableStudy AssistantAn AI teacher that knows your progress
Interview Prep
Compete
ContestsFresh problem sets, ranked liveLeaderboardWhere you stand, globallyBuddiesSolve with a friend: streaks, a weekly board, chat
Discuss
Deep-Path
Premium
      Intuition
      70 of 88

      Listen and collect

      Each word also has a value: what it says. Here, cat says “tired”, mat says “soft”. Write attend(query, keys, values): what “it” collects by listening to every word with the shares from the last puzzle. Keys are one number per word this time (how much of an animal), so the shares are just the chances of keys @ query.

      query
      animal
      1
      keys
      animal
      cat2
      sat0
      mat−1
      values: what each word says
      tiredsoft
      cat10
      sat00
      mat01
      solution.pyLoading Python
      ← Who should “it” listen to?Don’t peek →