[Bf-committers] Markerless facial motion tracking proposal. GSOC 2014

[Sameera Nilupul]

Hi,

Thank you for replying. My first draft of the proposal is not that
detailed. I'm currently editing it. I will send the new one soon.

Anyway, my idea is to develop an Addon which capture users face in real
time and track points shown in the following image.
http://i.msdn.microsoft.com/dynimg/IC584330.png

There is also a commercial product available having all the features. And
this costs around $1500 per year. Please take a look at the following video.
https://www.youtube.com/watch?v=24qUFDdZAG8


This Addon works as described in the way below.


   1. As the first step set of bones will be created inside blender. Then
   user has to place those bones in the model and do a basic rig.
   2. Then using the tracked points addon will move bones in real time. So
   user can see animated character in real time.
   3. Then user can select and save each animation part. ( As example,
   opening mouth, closing eyes, etc... ).
   4. If the user wants, he or she can save the raw data as a bvh. ( this
   is only a small part ).

Anyway I will prepare a detailed report soon and send it. Thank you very
much for replying.

~ best regards.




On 17 March 2014 02:30, Sergey Sharybin <sergey.vfx at gmail.com> wrote:

> Hey,
>
> Think facial tracking might be interesting topic, but there's a huge issue
> with your current proposal.
>
> Namely it's not really clear how and what for Blender users will use the
> addon you're gonna to implement. From your proposal i understand that you
> see Blender as some system which is only used to acquire the data and save
> it some format. It'll be much better would if you develop an addon which
> would make Blender users happy with new tools available for their usage and
> so on.
>
>
> On Sun, Mar 16, 2014 at 11:31 AM, Sameera Nilupul
> <nilupul.10 at cse.mrt.ac.lk>wrote:
>
> > Hi everyone,
> >
> > I'm Sameera Nilupul and currently a 3rd year undergraduate at University
> of
> > Moratuwa, Sri Lanka. I'm interested in taking part in Blender for GSOC
> > 2014. I'm hoping to work on a "Markerless facial motion tracking Addon".
> I
> > have written a brief proposal regarding my idea for GSOC this year. You
> can
> > find the proposal from the following link.
> >
> > https://www.dropbox.com/s/lc58waw6pj8g98d/GSOC2014Proposal.pdf
> >
> > I haven't submitted this proposal to google-melange yet. Please let me
> know
> > if you have any comments or improvements regarding this idea so I can
> > improve this proposal.
> >
> > ~Thank you.
> > Sameera Nilupul.
> > _______________________________________________
> > Bf-committers mailing list
> > Bf-committers at blender.org
> > http://lists.blender.org/mailman/listinfo/bf-committers
> >
>
>
>
> --
> With best regards, Sergey Sharybin
> _______________________________________________
> Bf-committers mailing list
> Bf-committers at blender.org
> http://lists.blender.org/mailman/listinfo/bf-committers
>