“Unfortunately, this early lead would be completely squandered within a few short years, with PyTorch/Nvidia GPUs easily overtaking TensorFlow/Google TPUs.”
Brain gave Google TensorFlow, TPUs, JAX and Transformers, and Google let PyTorch and Nvidia eat the first two. Lee wrote this in December, sat on it for optics, then Google laid him off in January and merged Brain into DeepMind. He calls the $400M Anthropic investment a bad look, an admission that Google trusts outside labs more than its own. Google paid for the research and its competitors shipped the products.