git annex get performance issues with rsync

[Joey Hess]

Adam Spiers wrote:
> OK.  You mean this?
> 
>     http://git-annex.branchable.com/todo/parallel_possibilities/

More like this:

http://git-annex.branchable.com/todo/wishlist:_Prevent_repeated_password_prompts_for_one_command

> > You can enable ssh's connection sharing though. (ControlMaster)
> 
> The figures above were already with ControlMaster enabled.
> It helps, but the rsync invocation per file still hurts a lot.

Are you actually measuring a significant time used in starting rsync?

I think it more likely that time is spent recording location logs to the
git-annex branch. You also mentioned you were using --copies, which
requires looking up the location log for each file, even ones that would
not otherwise be processed.

-- 
see shy jo
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 828 bytes
Desc: Digital signature
URL: <http://lists.madduck.net/pipermail/vcs-home/attachments/20120118/0395b2d3/attachment.pgp>