[Bf-committers] move prebuilt libs from svn to git?

[Jacob Merrill]

What about p2p?

Can we have users seed lib downloads?

On Fri, Jun 17, 2022, 9:11 AM Dan McGrath via Bf-committers <
bf-committers at blender.org> wrote:

> Hi,
>
> Really, I would need to see a capture from both sides to dig into it. I
> need to see what is being sent, and what is received on each side. There
> could be some weird firewall stuff happening that is causing fragmentation
> or blocking TCP options, or window scaling issues, etc.
>
> As for the default settings for tortoisesvn, the connection stuff I was
> referring to was about TCP/IP behaviour, rather than an application
> setting. Either way, I need to see what is actually happening. The fact
> that I can pull 5-8MB/sec (~40mbit) from Canada and not have a single
> interruption is telling. Granted, the host only has around 100 or 200mbit
> allocated, iirc. Multiply that by a few dozen people and you have a
> problem.
>
> For a simpler test, maybe try a large svn check, perhaps some old FreeBSD
> ports svn repo if you can find one, something also in .NL, and see how it
> goes, just to help eliminate your PC/firewall. Worst case scenario, you can
> also poke me in chat and we can try some server side and client side
> captures.
>
> TBH though, 1gig uplink just isn't a whole lot to serve our user base ;)
>
> On Fri, Jun 17, 2022 at 11:45 AM Tom M <letterrip at gmail.com> wrote:
>
> > On Fri, Jun 17, 2022 at 5:20 AM Dan McGrath <danmcgrath.ca at gmail.com>
> > wrote:
> > >
> > > Hi Tom,
> > >
> > > Long time no see :)
> > >
> > > I did some tests from home and found that, aside from slow speeds, I
> was
> > able to checkout at least 5 or 6 gig of the bf-blender repo without error
> > or having to retransmit.
> >
> > Yeah, looks like I was mistaking really slow download of the larger
> > (.7 GB) libraries as freezing.  I was averaging about .3 MB/s.  I used
> > a different SVN client and saw that it was indeed downloading (the
> > sliksvn doesn't provide any feedback on files in progress, only once a
> > file completes) - It was taking about 40 minutes for each of the
> > larger files.  It did complete eventually after about 5 hours.
> >
> > > I took the liberty of packet capturing the stream from my PC's POV, and
> > placed them in the ftp download area[1], if you care to take a look.
> > >
> > > The gist is that I was able to get around 5MB/sec for at least 5G of
> the
> > checkout, before I cancelled it.
> > >
> > Interesting, I usually get up to 3 MB/s download here normally from
> > other sources, but was typically getting .3 MB/s, with occasional
> > bursts of higher speed to a max of .8 MB/s when it wasn't downloading
> > the large files.
> >
> > > Now, my IP is a bit of a special case, so I am wondering if you are
> just
> > hitting the server so hard with http requests in separate sockets, or
> > something extreme, that is causing the system to block you for a period
> of
> > time. For comparison, my PC only had about 4 sockets open to the server
> for
> > the transfer. I would be curious to know if you are doing pipelining, or
> > sending each request in a separate connection.
> > >
> > Whatever the sliksvn and tortoisesvn defaults are, I'd assume they are
> > setup for typical usage.
> >
> > > If you can, the next time it happens, see if you are unable to visit
> > Phabricator or resume the svn checkout process. It may not be a firewall
> > issue, but without seeing some packet captures, I wouldn't be able to
> > really guess. Ideally, try to capture a few packets, until failure. At
> the
> > very least, you will need to snap 20b+20b=40b for IP+TCP headers, but I
> > would suggest a tad higher, maybe 64b.
> > >
> > > Cheers,
> > >
> > > Dan
> > >
> > > [1] - https://download.blender.org/ftp/dan/svn-checkout/
> > >
> > >
> > >
> > > On Thu, Jun 16, 2022 at 2:43 PM Tom M via Bf-committers <
> > bf-committers at blender.org> wrote:
> > >>
> > >> When checking out the libraries from SVN following the directions on
> > >>
> > >> https://wiki.blender.org/wiki/Building_Blender/Windows
> > >>
> > >> The svn checkout of the libraries fails with significant frequency,
> > >>
> > >> if you google you might stumble across using make svnfix
> > >>
> > >>
> https://www.mail-archive.com/bf-blender-cvs@blender.org/msg151996.html
> > >>
> > >> Even after using it, I'm still having to do Ctrl C, and then make
> > >> svnfix repeatedly (it downloads some files, than randomly freezes,
> > >> sometimes after 20-50 files, sometimes after 100's of files).
> > >>
> > >> Git doesn't seem to have any problems, though.
> > >>
> > >> So might we consider migrating the libs to git, rather than using SVN?
> > >>
> > >> LetterRip
> > >> _______________________________________________
> > >> Bf-committers mailing list
> > >> Bf-committers at blender.org
> > >> List details, subscription details or unsubscribe:
> > >> https://lists.blender.org/mailman/listinfo/bf-committers
> > >
> > >
> > >
> > > --
> > > Cheers,
> > > Danny
> > >
> > > ----------------------------------------------------------
> > > Danny McGrath - danmcgrath.ca at gmail.com
> > > GPG key: EDF6 AFF5 2086 F93A 1F59 36A5 44B6 26F3 6968 71CA
> >
>
>
> --
> Cheers,
> Danny
>
> ----------------------------------------------------------
> Danny McGrath - danmcgrath.ca at gmail.com
> GPG key: EDF6 AFF5 2086 F93A 1F59 36A5 44B6 26F3 6968 71CA
> _______________________________________________
> Bf-committers mailing list
> Bf-committers at blender.org
> List details, subscription details or unsubscribe:
> https://lists.blender.org/mailman/listinfo/bf-committers
>