TORCH_CUDA_ARCH_LIST="8.9;12.0" pip install --no-cache-dir --no-build-isolation flash-attn and FLASH_ATTENTION_BUILD_FROM_SOURCE=1 TORCH_CUDA_ARCH_LIST="8.9;12.0" pip ...
The bundled version of Pytorch does not support modern NVIDIA cards, giving the error: NVIDIA GeForce RTX 5060 Ti with CUDA capability sm_120 is not compatible with the current PyTorch installation.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results
Feedback