[Bf-committers] Buildbot outage for VM migration

Danny McGrath dan at blender.org
Tue Nov 30 10:03:51 CET 2021


Hi,

The maintenance page was restored a short while ago, and Sergey went in and
poked the workers. It would seem that everything is going again.


On Mon, Nov 29, 2021 at 1:09 PM Danny McGrath <dan at blender.org> wrote:

> Hi,
>
> It appears that we will have to extend the outage several hours longer
> than anticipated. A brief explanation follows.
>
> The initial backup ETA was derived from previous backup logs. However,
> after starting today's migration and backup, it was realized that the
> secondary VM HDD was NOT included in this estimate due to it intentionally
> not being part of the backup. Being an old gigabit based Ceph backed
> Proxmox cluster, it was clear that the extra storage would not be able to
> complete the migration in the given timeframe.
>
> After some internal discussion we decided to let it run and aim to have
> buildbot back online for tomorrow. In the meantime, there is an alternate
> like that might be useful that can be found at:
>
> https://builder-uatest.blender.org/download/daily/
>
>
> Again, sorry for the delay!
>
> On Mon, Nov 29, 2021 at 8:17 AM Danny McGrath <dan at blender.org> wrote:
>
>> Hi,
>>
>> Starting very shortly after this mail, we will be taking the buildbot
>> offline in order to migrate the VM to another server.
>>
>> The process of backing up and restoring the VM will take anywhere from 2
>> to 4 hours, which will make the builder.blender.org site unavailable.
>>
>> Sorry for any inconvenience, and keep an eye out here for any
>> status updates.
>>
>>
>> --
>> Cheers,
>> Danny
>>
>> -------------------------------------------------
>> Danny McGrath - dan at blender.org - www.blender.org
>> System Administrator at Blender
>> GPG key: 0x696871CA
>>
>
>
> --
> Cheers,
> Danny
>
> -------------------------------------------------
> Danny McGrath - dan at blender.org - www.blender.org
> System Administrator at Blender
> GPG key: 0x696871CA
>


-- 
Cheers,
Danny

-------------------------------------------------
Danny McGrath - dan at blender.org - www.blender.org
System Administrator at Blender
GPG key: 0x696871CA


More information about the Bf-committers mailing list