<div dir="ltr">I've made some progress with the EWA (elliptical weighted average) filter, which is one of the main grievances with tracking+compositor according to Sebastian.<div><br></div><div><a href="http://www.pasteall.org/pic/show.php?id=62224">http://www.pasteall.org/pic/show.php?id=62224</a><br>
</div><div><a href="http://www.pasteall.org/pic/show.php?id=62225">http://www.pasteall.org/pic/show.php?id=62225</a><br></div><div><br></div><div>The Plane Track Warp operation now calculates actual partial derivatives from the plane corners (via extended UV resolve function) instead of trying to estimate them from insufficient data. This allows the EWA filtering to use accurate elliptical regions in the image space for filtering. Such derivatives can be calculated in different ways as pointed out in the previous mail, the important thing is that they are actually available.</div>
<div><br></div><div>The code is not quite ready yet, i'll put it up for review soon. There are still some details i need to look into, like optimal filter sizes, some optimizations and safeguards that can be implemented and just a bunch of debug code i need to clean up.</div>
<div>@Jeroen: please poke me when you are on IRC, i'd like to discuss this whole sampling issue a bit to get a broader picture.</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Sun, Nov 3, 2013 at 6:31 PM, Lukas Tönne <span dir="ltr"><<a href="mailto:lukas.toenne@gmail.com" target="_blank">lukas.toenne@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>@Jeroen: I've been looking into the EWA sampling. Here are some thoughts, please tell me if this would make any sense, just to see if i understand you correctly:</div>
<div><br></div><div>1) Give each operation an explicit coordinate transform function which, given x/y coordinates, calculates both the transformed coordinates u/v of the source image(s) as well as the partial derivatives du/dx, du/dy, dv/dx, dv/dy (jacobian matrix)</div>
<div><br></div><div>2) For most nodes this transformation is linear, i.e. the derivatives are straightforward. A "LinearTransformOperation" base class or so could simplify it then by keeping a transform matrix. Only a few nodes such as UVMap (?) node currently do non-linear transforms afaik. PlaneTrack could perhaps use a full 3D transform.</div>
<div><br></div><div>3) Remove integrated pixel transform calculations from executePixel functions and let the SocketReader handle this by passing x/y through the transform functions and giving source-space coordinates to the input node. Nodes such as Translate or PlaneTrack would not do any actual color manipulation but only coordinate transforms.</div>
<div><br></div><div>4) For canvas compositing (later): Add a transform matrix to bNode types that support it, with all the necessary UI bells and whistles for manipulating these in the editor. Then use these matrices to set up the associated operations.</div>
</div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><br><div class="gmail_quote">On Sun, Nov 3, 2013 at 1:09 PM, Francesco Paglia <span dir="ltr"><<a href="mailto:f.paglia.80@gmail.com" target="_blank">f.paglia.80@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Jeroen,<div>as I can see every node that involves pixel transformation gives a much more blurred image.</div>
<div>the example in the link clearly shows what I'm talking about.</div><div><br></div><div>
<a href="http://www.pasteall.org/pic/show.php?id=61835" target="_blank">http://www.pasteall.org/pic/show.php?id=61835</a></div><div><br></div><div> there's an image input rotated twice in both direction to get back to the original position then I compared the resulting image with the original one using a difference operand.</div>
<div>The image "should" result in a completely black image but as you can see there are difference bigger than a pixel using the bicubic filter.</div><div><br></div><div> This result shows up 2 consideration:</div>
<div>1. a sub-pixel transformation should be taken into account for all the distortion nodes (maybe matrices should be the right choice?)</div><div>2. there's no optimization for two nodes whom do the same operation the so called "concatenation" in other software.</div>
<div><br></div><div>To further explain concatenation is an evaluation of all the node that are of the same kind and that are linked one to each other prior to apply the final transformation to the image.</div><div>here a reference link:</div>
<div><a href="http://www.nukepedia.com/written-tutorials/concatenation-of-transforms-in-nuke/" target="_blank">http://www.nukepedia.com/written-tutorials/concatenation-of-transforms-in-nuke/</a></div><div><br></div><div>
</div><div><br>
</div></div><div class="gmail_extra"><div><div><br><br><div class="gmail_quote">2013/11/3 Sebastian König <span dir="ltr"><<a href="mailto:koenig.sebastian@gmx.net" target="_blank">koenig.sebastian@gmx.net</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word"><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">Hi all!</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">I have created a new wiki page: <a href="http://wiki.blender.org/index.php/Dev:Ref/Proposals/Compositor" target="_blank">http://wiki.blender.org/index.php/Dev:Ref/Proposals/Compositor</a></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">I will collect the proposals and requests there, and also try to merge it with requests and proposals from here:</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><a href="http://wiki.blender.org/index.php/Dev:Ref/Requests/Compositing2.6" target="_blank">http://wiki.blender.org/index.php/Dev:Ref/Requests/Compositing2.6</a></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
I will also start threads in this list mailing list, as Francesco suggested, so that we can discuss things more clearly and structured. </div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
What I would like to see at some point is some kind of priority list. Everyone has his main issues and problems with the compositor and also probably a pretty clear vision what should be changed and how. Would be cool if we can get agreement on the most important issues.</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
Cheers!</div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
Seb</div><div><div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto"><br></div><div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div> <br><p style="color:#a0a0a8">On 3. November 2013 at 09:21:30, Jeroen Bakker (<a href="mailto://j.bakker@atmind.nl" target="_blank">j.bakker@atmind.nl</a>) wrote:</p> </div></div><blockquote type="cite"><span><div text="#000000" bgcolor="#FFFFFF">
<div><div><div>
<div>Hi!<br>
<br>
Just to clarify the issue, the quick solution and an draft-idea of
the possible solution:<br>
<br>
Issue: the compositor can not handle sub-sampling with good quality
by default. Nodes that want to use it should currently implement a
style like UV mapping (EWA sampling). To use EWA sampling the pixel
size needs to be evaluated (DX, DY).<br>
<br>
Quick solution: let the plane tracker node calculate the pixel-size
and EWA filtering methods. This solution will work for most cases,
but is not the ideal solution. It would be better that the pixel
size is known by all nodes.<br>
<br>
Possible solution (draft idea): In stead of evaluating pixels with
just an X, Y coordinate or even X, Y, DX, DY. We should investigate
on using 3x3 matrices. This solution should also help to implement
canvas compositor, but it could lead to strange results as matrices
are limited by the optimization structure (Complex vs Simple nodes)
of the compositor.<br>
<br>
Jeroen<br>
<br>
On 11/02/2013 04:48 PM, Sebastian König wrote:<br></div>
<blockquote type="cite">
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
Hi!</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
Here’s a file that illustrates the problem with sampling of plane
track: <a href="http://www.pasteall.org/blend/24971" target="_blank">http://www.pasteall.org/blend/24971</a></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
It’s a UV grid that is being blurred quite badly, even though the
plane track has only straight lines.</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
I was talking to Jeroen and Sergey about that, and they said
there are issues with the entire sampling code in compositor, so it
seems not to be a local issue. </div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
But I don’t know about the technical issues. It just looks
crappy. :)</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
Cheers!</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
Seb</div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div>
<div style="font-family:Helvetica,Arial;font-size:13px;color:rgba(0,0,0,1.0);margin:0px;line-height:auto">
<br></div>
<div>--<br>
Sebastian König<br>
Schenkendorfstrasse 45
<div>04275 Leipzig</div>
<div>Germany</div>
<div><a href="tel:%2B49%20176%2020319318" value="+4917620319318" target="_blank">+49 176 20319318</a></div>
<div><a href="http://www.3dzentrale.com" target="_blank">www.3dzentrale.com</a></div>
<div><a href="mailto:koenig.sebastian@gmx.net" target="_blank">koenig.sebastian@gmx.net</a></div>
<div><br></div>
</div>
<br>
<p style="color:#a0a0a8">On 2. November 2013 at 13:20:56, Lukas
Tönne (<a href="mailto://lukas.toenne@gmail.com" target="_blank">lukas.toenne@gmail.com</a>)
wrote:</p>
<blockquote type="cite">
<div>
<div>
<div dir="ltr"><span>Sebastian: Could you create a few test files
to demonstrate the sampling issues?<br></span></div>
<div class="gmail_extra"></div>
</div>
</div>
</blockquote>
</blockquote>
<br></div></div>
_______________________________________________
<br>Bf-compositor mailing list
<br><a href="mailto:Bf-compositor@blender.org" target="_blank">Bf-compositor@blender.org</a>
<br><a href="http://lists.blender.org/mailman/listinfo/bf-compositor" target="_blank">http://lists.blender.org/mailman/listinfo/bf-compositor</a>
<br></div></div></span></blockquote></div><br>_______________________________________________<br>
Bf-compositor mailing list<br>
<a href="mailto:Bf-compositor@blender.org" target="_blank">Bf-compositor@blender.org</a><br>
<a href="http://lists.blender.org/mailman/listinfo/bf-compositor" target="_blank">http://lists.blender.org/mailman/listinfo/bf-compositor</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div></div></div><span><font color="#888888">-- <br>Francesco Paglia<div>Vfx and Production Supervisor</div><div><br></div><div>mobile <a href="tel:%2B39%20347.82.12.473" value="+393478212473" target="_blank">+39 347.82.12.473</a></div>
<div><div>e-mail <a href="mailto:f.paglia.80@gmail.com" target="_blank">f.paglia.80@gmail.com</a></div>
</div><div><br></div>
</font></span></div>
<br>_______________________________________________<br>
Bf-compositor mailing list<br>
<a href="mailto:Bf-compositor@blender.org" target="_blank">Bf-compositor@blender.org</a><br>
<a href="http://lists.blender.org/mailman/listinfo/bf-compositor" target="_blank">http://lists.blender.org/mailman/listinfo/bf-compositor</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div>