Spooky Sale: 10% off Premium yearly · $118.80 for the first year · until Nov 6Get it

Deep-ML
Learn
Problems1,200+ hands-on ML problemsLearning PathA guided route through the fundamentalsLabsInteractive labs on real techniquesProjectsBuild a GPT, an RL agent, CUDA kernelsCollectionsCurated problem sets and videosMathPen-and-paper math for MLIntuitionInvent the idea behind the formula yourselfPlaylistsYour own problem lists, shareableStudy AssistantAn AI teacher that knows your progress
Interview Prep
Compete
ContestsFresh problem sets, ranked liveLeaderboardWhere you stand, globallyBuddiesSolve with a friend: streaks, a weekly board, chat
Discuss
Deep-Path
Premium
      Intuition
      86 of 88

      Is it the math or the memory?

      A chip does compute_speed operations a second and, at the same time, moves memory_speed bytes a second between its memory and its math units. One step of a model needs work operations and bytes_moved bytes. Write step_time(work, bytes_moved, compute_speed, memory_speed): how many seconds the step takes.

      compute_speed
      1,000 trillion operations a second
      memory_speed
      4,000 GB a second
      solution.pyLoading Python
      ← Fade to staticOne outlier ruins it →