viable/strict/1787738484: Re-enable expandable segments for CUDA Graph (#194767) (#194767)
- PyTorch: 86 events in the last 90 days
- PyTorch: 86th Release in the last 90 days
- Previous: earlier the same day · trunk/147aaef6de2917b07f797c344bb9ef7b26ec6135: [vllm hash update] update the pinned vllm hash (#194672)
What happened
Summary: Previously we temporarily disabled expandable segments for CUDA Graph due to some issues. Now, since the issues were fixed, we re-enable it Test Plan: baseline: f1125979746 QPS: 28.5k peak memory: 97.08% re-enabled: f1131430315 QPS: 28.7k peak memory: 89.28% Differential Revision: D117308651 Pull Request resolved: #194767 Approved by: https://github.com/Skylion007 , https://github.com/eqy
Summary assembled by rule from the sources below