Yesterday Fan J asked me for a cover design of the statistical journal of graduates of our school, and I just remembered the gradient descent algorithm, as this design should have something to do with statistics.
I always insist that students (as well as many researchers in the field of statistics) have ignored the great importance of statistical computation. For example, every now and then I can see presenters prefer to stop going further when they come to an issue related to computations; logistic regression is just a very typical topic. Rarely have I seen any authors mentioned the process of estimating parameters in logistic regression, what’s more, some authors just tell us to find the roots of a series of partial derivative equations (as if they were quite easy to solve by hand), which is a conventional method in optimization – I just cannot see where “IWLS” or “Fisher Scoring” are mentioned. Thus I designed this picture to emphasize the importance of statistical computation.
The function is z = sin(1/2 * x^2 - 1/4 * y^2 + 3) * cos(2 * x + 1 - exp(y). It is a little complex. The meaning of the above plot lies in:
- The process of optimization can be beyond our expectation. It is similar to our life to some extent: many people can achieve their goals, no matter which road they chose in the past (initial values for the iteration). The points in the bottom-left have expressed this idea. However, there are always some poor guys whose roads are not so smooth: they might fail many times before they succeed eventually – see the black point in the top. While there are even poorer guys who struggled for their whole life but still failed in the end – see the two vertical traces. After such an illustration, I think people will not be superstitious in statistical software any more.
- We should adjust our directions to achieve our goals faster. This is just the idea of “gradient”, and such an implication is quite appropriate as an instruction to leading our life, isn’t it?
My ideas may sound like ridiculous, but I believe there are too much to learn from trifles. That’s why I decided to name this graph as “To see a world in a grain of sand”.
Donate
As a freelancer (currently working as a contractor) and a dad of three kids, I truly appreciate your donation to support my writing and open-source software development! Your contribution helps me cope with financial uncertainty better, so I can spend more time on producing high-quality content and software. You can make a donation through methods below.
-
Venmo:
@yihui_xie, or Zelle:xie@yihui.name -
Paypal
-
If you have a Paypal account, you can follow the link https://paypal.me/YihuiXie or find me on Paypal via my email
xie@yihui.name. Please choose the payment type as “Family and Friends” (instead of “Goods and Services”) to avoid extra fees. -
If you don’t have Paypal, you may donate through this link via your debit or credit card. Paypal will charge a fee on my side.
-
-
Other ways:
WeChat Pay (微信支付：谢益辉) Alipay (支付宝：谢益辉) 
When sending money, please be sure to add a note “gift” or “donation” if possible, so it won’t be treated as my taxable income but a genuine gift. Needless to say, donation is completely voluntary and I appreciate any amount you can give.
Please feel free to email me if you prefer a different way to give. Thank you very much!
I’ll give back a significant portion of the donations to the open-source community and charities. For the record, I received about $30,000 in total (before tax) in 2024-25, and gave back about $15,000 (after tax).