If you want to use Gmail then 404 has a post on how to turn off Gemini summaries but of course the easiest way to do this is to not use Gmail. Proton is a good option.