Effect of Batch size vs GPU usage and process time Apr 17, 2024 Ez summary 64 speeed. I (GPU) can drink water as fast as tap is draining (RAM). 16 is like eating popcorn. hands(RAM) cant keep up with my mouth (GPU)\ 256 is like eating Triple big Mac. My jaw ain’t that big… U get the point