[Bf-committers] move prebuilt libs from svn to git?

[Tom M]

On Fri, Jun 17, 2022 at 5:20 AM Dan McGrath <danmcgrath.ca at gmail.com> wrote:
>
> Hi Tom,
>
> Long time no see :)
>
> I did some tests from home and found that, aside from slow speeds, I was able to checkout at least 5 or 6 gig of the bf-blender repo without error or having to retransmit.

Yeah, looks like I was mistaking really slow download of the larger
(.7 GB) libraries as freezing.  I was averaging about .3 MB/s.  I used
a different SVN client and saw that it was indeed downloading (the
sliksvn doesn't provide any feedback on files in progress, only once a
file completes) - It was taking about 40 minutes for each of the
larger files.  It did complete eventually after about 5 hours.

> I took the liberty of packet capturing the stream from my PC's POV, and placed them in the ftp download area[1], if you care to take a look.
>
> The gist is that I was able to get around 5MB/sec for at least 5G of the checkout, before I cancelled it.
>
Interesting, I usually get up to 3 MB/s download here normally from
other sources, but was typically getting .3 MB/s, with occasional
bursts of higher speed to a max of .8 MB/s when it wasn't downloading
the large files.

> Now, my IP is a bit of a special case, so I am wondering if you are just hitting the server so hard with http requests in separate sockets, or something extreme, that is causing the system to block you for a period of time. For comparison, my PC only had about 4 sockets open to the server for the transfer. I would be curious to know if you are doing pipelining, or sending each request in a separate connection.
>
Whatever the sliksvn and tortoisesvn defaults are, I'd assume they are
setup for typical usage.

> If you can, the next time it happens, see if you are unable to visit Phabricator or resume the svn checkout process. It may not be a firewall issue, but without seeing some packet captures, I wouldn't be able to really guess. Ideally, try to capture a few packets, until failure. At the very least, you will need to snap 20b+20b=40b for IP+TCP headers, but I would suggest a tad higher, maybe 64b.
>
> Cheers,
>
> Dan
>
> [1] - https://download.blender.org/ftp/dan/svn-checkout/
>
>
>
> On Thu, Jun 16, 2022 at 2:43 PM Tom M via Bf-committers <bf-committers at blender.org> wrote:
>>
>> When checking out the libraries from SVN following the directions on
>>
>> https://wiki.blender.org/wiki/Building_Blender/Windows
>>
>> The svn checkout of the libraries fails with significant frequency,
>>
>> if you google you might stumble across using make svnfix
>>
>> https://www.mail-archive.com/bf-blender-cvs@blender.org/msg151996.html
>>
>> Even after using it, I'm still having to do Ctrl C, and then make
>> svnfix repeatedly (it downloads some files, than randomly freezes,
>> sometimes after 20-50 files, sometimes after 100's of files).
>>
>> Git doesn't seem to have any problems, though.
>>
>> So might we consider migrating the libs to git, rather than using SVN?
>>
>> LetterRip
>> _______________________________________________
>> Bf-committers mailing list
>> Bf-committers at blender.org
>> List details, subscription details or unsubscribe:
>> https://lists.blender.org/mailman/listinfo/bf-committers
>
>
>
> --
> Cheers,
> Danny
>
> ----------------------------------------------------------
> Danny McGrath - danmcgrath.ca at gmail.com
> GPG key: EDF6 AFF5 2086 F93A 1F59 36A5 44B6 26F3 6968 71CA