[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[ale] Parallel data transfers (NFS).
- Subject: [ale] Parallel data transfers (NFS).
- From: jdp at algoloma.com (JD)
- Date: Wed, 05 Nov 2014 17:31:38 -0500
- In-reply-to: <[email protected]>
- References: <[email protected]>
On 11/05/2014 04:26 PM, Raj Wurttemberg wrote:
>> I'd use rsync and be done. Be certain to RTFM about rsync and local copies
>> (they always copy the file). NFS appears to rsync as local storage. I
> routinely
>> see
>> 65+MB/s (520 Mbps) transfers.
>>
>> 10G really isn't much data - just 5-10 min to transfer.
>
> It's 10TB, not GB. Haha!
>
> Yeah, rsync is looking to be a good option. Thanks!
So - for 10TB .... I'd look at getting better connections and a great disk
subsystem. Thought about infiniband and 10G networking for the NAS?
Is the data all new or is it partially changed? Can you get a live, replicated,
feed, from the source?