Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ctests on Perlmutter-GPU with nvidiagpu running much more slowly than on Perlmutter-CPU with nvidia #165

Open
altheaden opened this issue Nov 19, 2024 · 3 comments

Comments

@altheaden
Copy link

@xylar and I noticed that ctests on pm-cpu with nvidia ran at about 90 seconds, but on pm-gpu with nvidiagpu they ran at 1538.76 seconds.

@xylar
Copy link

xylar commented Nov 19, 2024

This seems qualitatively similar to the slow Intel performance we've seen: #119 But this case seems even worse. 25 minutes instead of 1.5 is really quite bad!

@xylar
Copy link

xylar commented Nov 19, 2024

It could be that Polaris or Omega itself isn't setting some environment variables that are needed or something like that.

@xylar
Copy link

xylar commented Nov 19, 2024

I ran the tests myself and they didn't take that long. They're still quite slow but only took 577.79 seconds (about 10 minutes)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants