“Apparently random crashes that go away when you add some debugging code are the worst kind of crash, but that was the situation we were in”
Oxide’s switch refused to power on after an unrelated firmware change. A new build feature packed tasks into multiple memory protection regions and recovered 30% of RAM. It also moved region boundaries into the middle of tasks, and a kernel check Biffle wrote in 2020 started killing the power sequencer for loaning memory across them. It restarted 115 times. Two correct features made one bug. The bug only showed up when you changed code somewhere else, which is the kind that eats a week.