Could not load dynamic library 'libcudart.so.11.0'

[MYC000801]

When I try the example script, it reports errors:

My cuda version 12.7. I would like to ask if the cuda version is required to be 11.x. Thanks a lot in advance!

Environment information:
Python: 3.10.9
CUDA: 12.7
I just create the environment following the instruction
git clone [email protected]:sail-sg/oat.git
cd oat
pip install vllm==0.6.2 && pip install -e .

[lkevinzc]

Hi @MYC000801, I think cuda12 should be fine. Here are my packages when I run pip list | grep cuda:

I think your issue may be resolved by setting the LD_LIBRARY_PATH to point to your python package's lib. For me, I put this line in my ~/.zshrc (or ~/.bashrc if you do not use zsh):

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/aiops/liuzc/miniforge3/envs/oat/lib/

Ref: https://stackoverflow.com/a/21173918. Hope this helps!