[Orange-tech] Re: downloading rendered frames from US

[henk]

ok! bottleneck is the peering between amsx and the other part of the
ocean...

 Host                         Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. 10.0.135.3                0.0%     8    0.2   0.3   0.2   0.7   0.2
 2. extreme.waag.org          0.0%     8    0.6   0.7   0.6   1.0   0.1
 3. Gi10-2-29.AR5.Amsterdam1  0.0%     8    1.0   1.1   1.0   1.2   0.1
 4. PO6-0.CR1.Amsterdam1.sur  0.0%     8    1.5   7.6   1.3  49.8  17.0
 5. PO0-0.BR1.Amsterdam1.surf.0.0%     8    1.4  22.5   1.4 156.2  54.1
 6. surfnet.rt1.ams.nl.geant2.0.0%     7    4.2   2.6   1.3   6.8   2.1
 7. 62.40.112.134             0.0%     7   87.5 102.7  84.4 197.0  41.7
 8. 198.32.11.50              0.0%     7   93.0 113.3  88.7 214.1  44.8
 9. washng-nycmng.abilene.ucai0.0%     7  113.0 110.6  95.6 149.5  18.4
10. dcne-abilene-oc48.maxgigap0.0%     7  108.7  98.3  95.9 108.7   4.8
11. usm-isp-clpk-rtr.maxggiapo0.0%     7   96.9  97.2  96.9  97.6   0.2
12. 1.gig0-1.bsu-gw.net.ums.ed0.0%     7   98.1  98.2  98.1  98.7   0.2
13. xseed.bowiestate.edu      0.0%     7   98.2  98.4  97.9  98.8   0.3

Toni Alatalo wrote:
> On Thursday 26 January 2006 16:22, you wrote:
>> It's a scponly account. So do something like:
> 
> thanks!
> 
>> thunderbird-1.5.en-US.linux-i686.tar.gz   100%   10MB  10.1MB/s  00:01
>> and it works!
> 
> am now testing from xseed:
> xseed1:~ orange$ scp -r renderout/ blender at live.waag.org:
> 04_010001.exr                                 100%   23MB 310.3KB/s   01:18
> 
> now it becomes harder to know where the bottleneck is.
> 
> Mark, how fast should the xseed be able to upload to Europe?
> 
>> And when/how would you pick it up here? I'm normally at the waag from
>> 8:30 mon/thu...
> 
> any time during the day with a bike, we are close :)
> 
>> henk
> 
> ~Toni
> 
>> Toni Alatalo wrote:
>>> On Thursday 26 January 2006 11:25, you wrote:
>>>> how would you like to transfer the frames? Is it possible to use scp or
>>>> rsync over ssh? When using scp locally we have speeds like 30MB/s over
>>> rsync over ssh is exactly what i use now to get them here to MV, reaching
>>> 200k/s. a similar scp from xseed to www.blender.org at xs4all was
>>> 300-400k/s .. so i think/hope it should reach at least that to your
>>> network too.
>>>
>>>> the network. Portable disk (usb2 i guess) will drop that to 3MB/s at
>>>> least. Our connection to the internet from that server is proper 1 gig,
>>>> so depending on cpu/mem/load also about 30MB/s. So i guess the transfer
>>>> speed is not the bottlenet, but de disk i/o on booth sides.
>>> err, well usb2 is still a lot of faster than the 200k/s we get currently,
>>> so i guess that is ok.
>>>
>>> so can we do a test? e.g. if you can give an ip (& account) i can test
>>> pushing data from xseed. or what should we do?
>>>
>>>> henk
>>> ~Toni
>>>
>>>> Toni Alatalo wrote:
>>>>> greetings,
>>>>>
>>>>> i got a message from paul at waag.org telling to contact you. our need is
>>>>> this: we render frames on a renderfarm in the united states, and need
>>>>> to download them back to the studio here in Amsterdam. the current
>>>>> bottleneck in our entire pipeline is the transfer speed.
>>>>>
>>>>> if the transfer from the xseed we use to waag.org is faster, we would
>>>>> like to use it for downloads, e.g. by taking a portable hard drive over
>>>>> and visiting Waag like once a day with it. we talk about tens of GBs a
>>>>> day, transferring during the night is a possibility (i can come and get
>>>>> the data on my way to work in the morning then)
>>>>>
>>>>> to be able to test the speed, we must first either have a public (i
>>>>> mean an internet one) upload address and an account to your network, so
>>>>> that can push data from the xseed, or else access to a system in your
>>>>> network, and give the Internet address of that node for the xseed
>>>>> admins so that they can add it the access list there.
>>>>>
>>>>> i understood that other issues were agreed on by Paul and Ton, or am
>>>>> sure that can be.
>>>>>
>>>>> sincirely,
>>>>> ~Toni

-- 
Henk Buursen
System Engineer
Waag Society / for old and new media
Nieuwmarkt 4
1012 CR Amsterdam / The Netherlands

Tel. +31 20 557 98 98
Fax. +31 20 557 98 80
Mail. henk at waag.org
URL. http://www.waag.org