Ha ha, it came from Wikipedia so possibly.

As a barely relevant point,

Using google, I can't find references to the quote (or John Carmack) by searching 'Little tiny steps using local information winds up leading to all the best answers'.

Other search engines seems to do a bit better on retrieving the Wiki article.

What gives, is google really becoming worse?

Kagi search shows this HN post, a link to kids encyclopedia page on Carmack, and his Wikipedia page as the first three links.

I started using Kagi last month, and am really enjoying it - it's like Google at it's prime.

> Using google, I can't find references to the quote (or John Carmack) by searching 'Little tiny steps using local information winds up leading to all the best answers'

Mr Carmack references "gradient descent" in interviews[1][2] and his own posts on X[3].

[1] https://dallasinnovates.com/exclusive-qa-john-carmacks-diffe...

[2] https://transcript.lol/read/youtube/@lexfridman/6522e9950331...

[3] https://twitter.com/ID_AA_Carmack/status/1773391295538442445

[3]

The Wikipedia article has a reference to where the quote came from. It’s a podcast, whose audio presumably has not been transcribed and indexed.

https://lexfridman.com/john-carmack/

It's been at its worst for like 6 years.