[Bf-taskforce25] render tests

[Brecht Van Lommel]

Hi all,

For fun I cleaned up some render testing code I have here and used it to
compare 2.48 and 2.5 results using the 2.48 test files. The cases that
give different results seem to be mostly in the animation system which
was to be expected, since other 2.5 refactoring should not influence
rendering much:

-- [18/89] group-duplicate.blend [failed]
-- [25/89] lostride.blend [failed]
-- [36/89] sequence.blend [failed] 
-- [70/89] mancandy_actiondeform.blend [failed]
-- [77/89] motionblender.blend [failed]
-- [81/89] cubesphere.blend [failed]
-- [89/89] mancandy_matching.blend [failed]

To run the tests you need to download test_render.zip and change
test_config.py to point to two compiled binaries, and a directory with
the extracted test files. No idea if it works on Windows, I was lazy
with directory separators..
http://download.blender.org/demo/test/test248.zip

It would be interesting to get a unit testing framework for 2.5 but I
don't want to spend much time on it now, so just throwing this out
there.

Brecht.

-------------- next part --------------
A non-text attachment was scrubbed...
Name: test_render.zip
Type: application/zip
Size: 43044 bytes
Desc: not available
Url : http://lists.blender.org/pipermail/bf-taskforce25/attachments/20090329/d0ab8a81/attachment-0001.zip 
-------------- next part --------------
-- [1/89] sequence_audio.blend [success] [47 stderr lines] 
-- [2/89] deformtest.blend [success] [53 stderr lines] 
-- [3/89] outlinertest.blend [success] [87 stderr lines] 
-- [4/89] tapercurve.blend [success] [41 stderr lines] 
-- [5/89] radioroom.blend [success] [127 stderr lines] 
-- [6/89] fluidsim.blend [success] [59 stderr lines] 
-- [7/89] text-regression.blend [success] [49 stderr lines] 
-- [8/89] crystal_cube.blend [success] [39 stderr lines] 
-- [9/89] faceselectmode.blend [success] [48 stderr lines] 
-- [10/89] mandel-py.blend [success] [45 stderr lines] 
-- [11/89] mball.blend [success] [37 stderr lines] 
-- [12/89] sculpt.blend [success] [66 stderr lines] 
-- [13/89] icetest.blend [success] [49 stderr lines] 
-- [14/89] flippedmatrixes.blend [success] [47 stderr lines] 
-- [15/89] allselect.blend [success] [46 stderr lines] 
-- [16/89] nodelib.blend [success] [56 stderr lines] 
-- [17/89] weight-paint_test.blend [success] [51 stderr lines] 
-- [18/89] group-duplicate.blend [failed] [77 stderr lines] 
-- [19/89] hairball.blend [success] [37 stderr lines] 
-- [20/89] timeline.blend [success] [58 stderr lines] 
-- [21/89] vectorblur.blend [success] [43 stderr lines] 
-- [22/89] monkey_cornelius_bake.blend [success] [37 stderr lines] 
-- [23/89] teapot_envmap.blend [success] [36 stderr lines] 
-- [24/89] monkey_cornelius_light-passes.blend [success] [41 stderr lines] 
-- [25/89] lostride.blend [failed] [468 stderr lines] 
-- [26/89] halostep.blend [success] [37 stderr lines] 
-- [27/89] windows_tra_shadow.blend [success] [49 stderr lines] 
-- [28/89] monkey_cornelius_shadbuf.blend [success] [37 stderr lines] 
-- [29/89] motor9.blend [success] [38 stderr lines] 
-- [30/89] monkey_cornelius.blend [success] [37 stderr lines] 
-- [31/89] teapot_soft.blend [success] [36 stderr lines] 
-- [32/89] only_shadow_lamp.blend [success] [52 stderr lines] 
-- [33/89] mirror_texture.blend [success] [49 stderr lines] 
-- [34/89] compo_map_uv.blend [success] [66 stderr lines] 
-- [35/89] renderdisplay.blend [success] [61 stderr lines] 
-- [36/89] sequence.blend [failed] 
-- [37/89] flaretest.blend [success] [57 stderr lines] 
-- [38/89] refract_monkey.blend [success] [48 stderr lines] 
-- [39/89] composite_layers.blend [success] [60 stderr lines] 
-- [40/89] arealight.blend [success] [39 stderr lines] 
-- [41/89] monkey_cornelius_passes.blend [success] [38 stderr lines] 
-- [42/89] Raptor_radio_ray_env.blend [success] [119 stderr lines] 
-- [43/89] compo_idmask_cubes.blend [success] [62 stderr lines] 
-- [44/89] composite_image.blend [success] [57 stderr lines] 
-- [45/89] compo_map_uv_cubes.blend [success] [67 stderr lines] 
-- [46/89] displace.blend [success] [49 stderr lines] 
-- [47/89] only_shadow_material.blend [success] [52 stderr lines] 
-- [48/89] monkey_cornelius_compo.blend [success] [37 stderr lines] 
-- [49/89] glass.blend [success] [38 stderr lines] 
-- [50/89] sss.blend [success] [62 stderr lines] 
-- [51/89] compo_map_zcombine_cubes.blend [success] [63 stderr lines] 
-- [52/89] robo_ao.blend [success] [36 stderr lines] 
-- [53/89] ram_glsl.blend [success] [60 stderr lines] 
-- [54/89] Sky-Atmosphere.blend [success] [37 stderr lines] 
-- [55/89] add_softbody.blend [success] [54 stderr lines] 
-- [56/89] gimpact.blend [success] [52 stderr lines] 
-- [57/89] softbody_constraints.blend [success] [54 stderr lines] 
-- [58/89] AnisoTest2.blend [success] [59 stderr lines] 
-- [59/89] suzanne_cloth.blend [success] [57 stderr lines] 
-- [60/89] do_fh_bullet.blend [success] [58 stderr lines] 
-- [61/89] torus_complex.blend [success] [52 stderr lines] 
-- [62/89] gamesoftbody.blend [success] [58 stderr lines] 
-- [63/89] webskategirl_bullet.blend [success] [33 stderr lines] 
-- [64/89] zmask_compo.blend [success] [55 stderr lines] 
-- [65/89] clothtest.blend [success] [55 stderr lines] 
-- [66/89] grass_wind.blend [success] [49 stderr lines] 
-- [67/89] softbodytest.blend [success] [57 stderr lines] 
-- [68/89] softhairtest.blend [success] [57 stderr lines] 
-- [69/89] luxo.blend [success] [58 stderr lines] 
-- [70/89] mancandy_actiondeform.blend [failed] [61 stderr lines] 
-- [71/89] pathJumper.blend [success] [43 stderr lines] 
-- [72/89] driven_hand.blend [success] [42 stderr lines] 
-- [73/89] softbody_curve_lattice.blend [success] [52 stderr lines] 
-- [74/89] bowl.blend [success] [35 stderr lines] 
-- [75/89] array3.blend [success] [58 stderr lines] 
-- [76/89] dolphin.blend [success] [53 stderr lines] 
-- [77/89] motionblender.blend [failed] [44 stderr lines] 
-- [78/89] stride_bone.blend [success] [35 stderr lines] 
-- [79/89] relative.blend [success] [76 stderr lines] 
-- [80/89] CtrlObject.blend [success] [35 stderr lines] 
-- [81/89] cubesphere.blend [failed] [37 stderr lines] 
-- [82/89] softbody_basics.blend [success] [48 stderr lines] 
-- [83/89] driver-object-eyes.blend [success] [67 stderr lines] 
-- [84/89] hairguide.blend [success] [57 stderr lines] 
-- [85/89] knight.blend [success] [46 stderr lines] 
-- [86/89] controller2.blend [success] [115 stderr lines] 
-- [87/89] camera.blend [success] [35 stderr lines] 
-- [88/89] dupliverts.blend [success] [44 stderr lines] 
-- [89/89] mancandy_matching.blend [failed] [32 stderr lines]