After trying to implement my own tip on this site, I learned something new about WordPress. The robots.txt file is generated by WordPress using hooks. Specifically, the robots_txt hook.
I recently had to execute a statement that I did not want bash to save in its history. This led me to the bash variable HISTCONTROL.
Frankly, since moving to WP, I haven’t put any effort into speed. I didn’t care much, to be honest, about a couple of seconds. So I decided to sign up for BunnyCDN.