[Orange-tech] Re: downloading rendered frames from US

[Toni Alatalo]

On Thursday 26 January 2006 16:22, you wrote:
> It's a scponly account. So do something like:

thanks!

> thunderbird-1.5.en-US.linux-i686.tar.gz   100%   10MB  10.1MB/s  00:01
> and it works!

am now testing from xseed:
xseed1:~ orange$ scp -r renderout/ blender at live.waag.org:
04_010001.exr                                 100%   23MB 310.3KB/s   01:18

now it becomes harder to know where the bottleneck is.

Mark, how fast should the xseed be able to upload to Europe?

> And when/how would you pick it up here? I'm normally at the waag from
> 8:30 mon/thu...

any time during the day with a bike, we are close :)

> henk

~Toni

>
> Toni Alatalo wrote:
> > On Thursday 26 January 2006 11:25, you wrote:
> >> how would you like to transfer the frames? Is it possible to use scp or
> >> rsync over ssh? When using scp locally we have speeds like 30MB/s over
> >
> > rsync over ssh is exactly what i use now to get them here to MV, reaching
> > 200k/s. a similar scp from xseed to www.blender.org at xs4all was
> > 300-400k/s .. so i think/hope it should reach at least that to your
> > network too.
> >
> >> the network. Portable disk (usb2 i guess) will drop that to 3MB/s at
> >> least. Our connection to the internet from that server is proper 1 gig,
> >> so depending on cpu/mem/load also about 30MB/s. So i guess the transfer
> >> speed is not the bottlenet, but de disk i/o on booth sides.
> >
> > err, well usb2 is still a lot of faster than the 200k/s we get currently,
> > so i guess that is ok.
> >
> > so can we do a test? e.g. if you can give an ip (& account) i can test
> > pushing data from xseed. or what should we do?
> >
> >> henk
> >
> > ~Toni
> >
> >> Toni Alatalo wrote:
> >>> greetings,
> >>>
> >>> i got a message from paul at waag.org telling to contact you. our need is
> >>> this: we render frames on a renderfarm in the united states, and need
> >>> to download them back to the studio here in Amsterdam. the current
> >>> bottleneck in our entire pipeline is the transfer speed.
> >>>
> >>> if the transfer from the xseed we use to waag.org is faster, we would
> >>> like to use it for downloads, e.g. by taking a portable hard drive over
> >>> and visiting Waag like once a day with it. we talk about tens of GBs a
> >>> day, transferring during the night is a possibility (i can come and get
> >>> the data on my way to work in the morning then)
> >>>
> >>> to be able to test the speed, we must first either have a public (i
> >>> mean an internet one) upload address and an account to your network, so
> >>> that can push data from the xseed, or else access to a system in your
> >>> network, and give the Internet address of that node for the xseed
> >>> admins so that they can add it the access list there.
> >>>
> >>> i understood that other issues were agreed on by Paul and Ton, or am
> >>> sure that can be.
> >>>
> >>> sincirely,
> >>> ~Toni