-
Notifications
You must be signed in to change notification settings - Fork 68
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mfu: copy much more xattrs #594
base: main
Are you sure you want to change the base?
Conversation
e2c8147
to
860cda3
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for your contribution @KoyamaSohei, I have one concern.
860cda3
to
a0a85dc
Compare
@ofaaland Could you please review again? I fixed to copy only fsx_projid and FS_XFLAG_PROJINHERIT |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@KoyamaSohei Thanks for this improvement.
Please do some testing to and report the performance impact of your code change, preferably on a parallel file system like Lustre which may have high throughput but higher latency than something local like xfs.
Please also modify your commit message to reflect that mfu is copying projectid ; the commit message still makes it sounds like it's copying many xattrs.
We compared the execution time when copying lustre-release 10 times on Lustre using dcp. There was a significant decrease in performance ...
|
When copying files using dcp or dsync, extended attributes such as fsx_projid and FS_XFLAG_PROJINHERIT are also copied. Signed-off-by: Sohei Koyama <[email protected]>
a0a85dc
to
e8b45c4
Compare
I think we should try and fix that before we merge this. For our site, for example, we don't yet use projectid at all, so this would be a big performance hit for no benefit. I wonder if this is because we are sort-of opening each file twice, once for Before you do that refactoring work, though, maybe you can figure out with some careful experiments whether that's where the time is going, or whether we're spending it elsewhere. |
When copying files using dcp or dsync, extended attributes such as project id are also copied.
Resolves #553.