[Vulkan] Add the off-graph flat KV cache and update_and_attend op - #22036

[Vulkan] Add the off-graph flat KV cache and update_and_attend op#22036

kiymetakdemir wants to merge 2 commits into

pytorch:mainpytorch/executorch:mainfrom

kiymetakdemir:vulkan-offgraph-kv-cachekiymetakdemir/executorch:vulkan-offgraph-kv-cacheCopy head branch name to clipboard