[Orange-tech] Re: downloading rendered frames from US

[Prof. Mark Alan Matties]

Toni Alatalo wrote:

>On Thursday 26 January 2006 16:22, you wrote:
>  
>
>>It's a scponly account. So do something like:
>>    
>>
>
>thanks!
>
>  
>
>>thunderbird-1.5.en-US.linux-i686.tar.gz   100%   10MB  10.1MB/s  00:01
>>and it works!
>>    
>>
>
>am now testing from xseed:
>xseed1:~ orange$ scp -r renderout/ blender at live.waag.org:
>04_010001.exr                                 100%   23MB 310.3KB/s   01:18
>
>now it becomes harder to know where the bottleneck is.
>
>Mark, how fast should the xseed be able to upload to Europe?
>
>  
>
Should be reasonably fast - multiple 10s of Mbps. The link from 
Frankfurt to Amsterdam might be a bit congested.

[root at xseed1 ~]# traceroute live.waag.org
traceroute to live.waag.org (195.169.149.39), 30 hops max, 40 byte packets
 1  172.16.0.1 (172.16.0.1)  0.739 ms  0.257 ms  0.269 ms
 2  131.118.189.1 (131.118.189.1)  0.551 ms  0.492 ms  0.441 ms
 3  ge-2-0-0.umcp-gw.net.ums.edu (131.118.253.129)  1.496 ms  1.708 ms  
1.728 ms
 4  so-0-3-2.umab-gw.net.ums.edu (131.118.255.41)  3.578 ms  2.548 ms  
2.618 ms
 5  balt-usm.maxgigapop.net (206.196.177.17)  2.867 ms  2.92 ms  2.756 ms
 6  clpk-so2-1-0.maxgigapop.net (206.196.178.1)  2.978 ms  2.75 ms  2.726 ms
 7  abilene-rtr.maxgigapop.net (206.196.177.2)  3.881 ms  3.167 ms  3.289 ms
 8  abilene.rt1.fra.de.geant2.net (62.40.125.5)  97.159 ms  97.893 ms  
97.109 ms
 9  so-5-0-0.rt1.ams.nl.geant2.net (62.40.112.58)  97.514 ms  195.309 
ms  97.26 ms
10  62.40.124.158 (62.40.124.158)  97.774 ms  97.95 ms  97.965 ms
11  po11-0.cr1.amsterdam1.surf.net (145.145.166.33)  97.794 ms  97.761 
ms  108.589 ms
12  po1-0.ar5.amsterdam1.surf.net (145.145.162.2)  97.844 ms  97.845 ms  
97.813 ms
13  vp-amsterdam-router.customer.surf.net (145.145.18.146)  98.235 ms  
99.697 ms  98.328 ms
14  wg39.waag.org (195.169.149.39)  98.015 ms  98.035 ms  98.291 ms


>>And when/how would you pick it up here? I'm normally at the waag from
>>8:30 mon/thu...
>>    
>>
>
>any time during the day with a bike, we are close :)
>
>  
>
>>henk
>>    
>>
>
>~Toni
>
>  
>
>>Toni Alatalo wrote:
>>    
>>
>>>On Thursday 26 January 2006 11:25, you wrote:
>>>      
>>>
>>>>how would you like to transfer the frames? Is it possible to use scp or
>>>>rsync over ssh? When using scp locally we have speeds like 30MB/s over
>>>>        
>>>>
>>>rsync over ssh is exactly what i use now to get them here to MV, reaching
>>>200k/s. a similar scp from xseed to www.blender.org at xs4all was
>>>300-400k/s .. so i think/hope it should reach at least that to your
>>>network too.
>>>
>>>      
>>>
>>>>the network. Portable disk (usb2 i guess) will drop that to 3MB/s at
>>>>least. Our connection to the internet from that server is proper 1 gig,
>>>>so depending on cpu/mem/load also about 30MB/s. So i guess the transfer
>>>>speed is not the bottlenet, but de disk i/o on booth sides.
>>>>        
>>>>
>>>err, well usb2 is still a lot of faster than the 200k/s we get currently,
>>>so i guess that is ok.
>>>
>>>so can we do a test? e.g. if you can give an ip (& account) i can test
>>>pushing data from xseed. or what should we do?
>>>
>>>      
>>>
>>>>henk
>>>>        
>>>>
>>>~Toni
>>>
>>>      
>>>
>>>>Toni Alatalo wrote:
>>>>        
>>>>
>>>>>greetings,
>>>>>
>>>>>i got a message from paul at waag.org telling to contact you. our need is
>>>>>this: we render frames on a renderfarm in the united states, and need
>>>>>to download them back to the studio here in Amsterdam. the current
>>>>>bottleneck in our entire pipeline is the transfer speed.
>>>>>
>>>>>if the transfer from the xseed we use to waag.org is faster, we would
>>>>>like to use it for downloads, e.g. by taking a portable hard drive over
>>>>>and visiting Waag like once a day with it. we talk about tens of GBs a
>>>>>day, transferring during the night is a possibility (i can come and get
>>>>>the data on my way to work in the morning then)
>>>>>
>>>>>to be able to test the speed, we must first either have a public (i
>>>>>mean an internet one) upload address and an account to your network, so
>>>>>that can push data from the xseed, or else access to a system in your
>>>>>network, and give the Internet address of that node for the xseed
>>>>>admins so that they can add it the access list there.
>>>>>
>>>>>i understood that other issues were agreed on by Paul and Ton, or am
>>>>>sure that can be.
>>>>>
>>>>>sincirely,
>>>>>~Toni
>>>>>          
>>>>>
>_______________________________________________
>Orange-tech mailing list
>Orange-tech at blender.org
>http://projects.blender.org/mailman/listinfo/orange-tech
>
>
>  
>


-- 


Mark Alan Matties, Ph.D.
Assistant Professor of Computer Science
Director - BSU Xseed Supercomputer
Program Coordinator - B.S. in Computer Technology

mmatties at cs.bowiestate.edu
(301) 860 3974 (vox)
(301) 860 3979 (fax)

Snail Mail:
Bowie State University
Dept. of Computer Science
14000 Jericho Park Rd.
Bowie, MD    20715 

Fall 2005 Office Hours:
T  2:00PM - 4:00PM
R  3:00PM - 5:00PM