checksums: use a low-priority task queue for fsck digests
commita4af4caf2ecb896961fa111797cc2fe5be46aeeb
authorEric Wong <normalperson@yhbt.net>
Mon, 12 Mar 2012 10:01:16 +0000 (12 03:01 -0700)
committerdormando <dormando@rydia.net>
Fri, 30 Mar 2012 00:11:35 +0000 (29 17:11 -0700)
treed89d12421b81753eda79edaab13e3d896fd86601
parent35dcf3e768338ebf5ef4420661ce5a1965b0fbda
checksums: use a low-priority task queue for fsck digests

MD5 is I/O-intensive, and having fsck request MD5s concurrently
ends up causing I/O contention on rotational drives with high
seek latency.  So limit fsck MD5 requests to a single job per
device.
lib/MogileFS/DevFID.pm
lib/MogileFS/HTTPFile.pm
lib/MogileFS/Worker/Fsck.pm
lib/Mogstored/SideChannelClient.pm
lib/Mogstored/TaskQueue.pm [new file with mode: 0644]