-
-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HDD performance is poor #257
Labels
good first issue
Good for newcomers
Comments
|
Integral-Tech
added a commit
to Integral-Tech/parallel-disk-usage
that referenced
this issue
Nov 24, 2024
On HDD, multi-threaded du won't provide any performance gain over the single-threaded one. Therefore, when HDD is detected on one of the files, limit the thread number to 1. This PR fixes issue KSXGitHub#257.
Integral-Tech
added a commit
to Integral-Tech/parallel-disk-usage
that referenced
this issue
Nov 24, 2024
On HDD, multi-threaded du won't provide any performance benefit over the single-threaded one. Therefore, when HDD is detected on one of the files, limit the thread number to 1. This PR fixes issue KSXGitHub#257.
Integral-Tech
added a commit
to Integral-Tech/parallel-disk-usage
that referenced
this issue
Nov 24, 2024
On HDD, multi-threaded du won't provide any performance benefit over the single-threaded one. Therefore, when HDD is detected on one of the files, limit the thread number to 1. This PR fixes issue KSXGitHub#257.
Integral-Tech
added a commit
to Integral-Tech/parallel-disk-usage
that referenced
this issue
Nov 24, 2024
On HDD, multi-threaded du won't provide any performance benefit over the single-threaded one. Therefore, when HDD is detected on one of the files, limit the thread number to 1. This PR fixes issue KSXGitHub#257.
Integral-Tech
added a commit
to Integral-Tech/parallel-disk-usage
that referenced
this issue
Nov 24, 2024
On HDD, multi-threaded du won't provide any performance benefit over the single-threaded one. Therefore, when HDD is detected on one of the files, limit the thread number to 1. This PR fixes issue KSXGitHub#257.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
pdu
performs about 2x worse on my HDD than single-threadeddu
. I'm testing on an old home directory of mine on a mechanical hard drive, with about 712 gigabytes of data in around 150,000 files. The size difference reported by the two programs is due to hard links.Compared to du:
I'm not positive on the source of this difference, but I believe it's due to the directory traversal order used by the two programs.
du
uses a depth-first search whereaspdu
seems to use breadth-first search through rayon, although I can't tell for sure. Interestingly,pdu
is comparable todu
when manually limited to a single thread:The text was updated successfully, but these errors were encountered: