“Well, this might be a surprise for many, but so-called cores in GPUs world are more of a marketing term.”
A CUDA core can’t branch, predict or run on its own. It is a float unit chained to 31 siblings doing the same thing. Nvidia counts each one as a core because a big number sells cards. Count the way a CPU vendor would and the number on the box shrinks by a factor of 32.