“In the Needle In A Haystack (NIAH) evaluation, where a small piece of text containing a particular fact or statement is purposely placed within a long block of text, 1.5 Pro found the embedded text 99% of the time, in blocks of data as long as 1 million tokens.”
Google says Gemini 1.5 Pro handles up to 1 million tokens, up from 32,000 in Gemini 1.0. The default is still 128,000, and the million-token window is a private preview for a limited group. The headline benchmark is finding one planted sentence in a haystack. Grep has done that for decades.