2. Advanced Lighting Techniques Dan Baker Software Design Engineer Microsoft Corporation

6. The Reflection Equation

7. The Reflection Equation

10. A Modern Real Time Graphics System Vertex Buffer Input Assembler Vertex Shader Setup Rasterizer Output Merger Pixel Shader Index Buffer Texture Render Target Depth Stencil Texture Memory memory programmable fixed Sampler Sampler Constant Constant

11. Tomorrows Graphic’s System Vertex Buffer Input Assembler Vertex Shader Setup Rasterizer Output Merger Pixel Shader Geometry Shader Index Buffer Texture Texture Render Target Depth Stencil Texture Stream Buffer Stream out Memory memory programmable fixed Sampler Sampler Sampler Constant Constant Constant Memory

22. BRDF Costs, Minimal Surface Variation 10 + 5 *n 0 Lafortune Direct 35 0 Cook-Torrance 10 4 Ashikhmin/Shirley factored 40 0 Ashikhmin/Shirley 5 1 Banks Factored 12 0 Banks Direct 2 1 Blinn-Phong factored 7 0 Blinn-Phong Direct ALU costs Texture costs Model

23. BRDF Costs With Surface Variation 30 + 5*Lobes 2 Lafortune Direct 40 1 Cook-Torrance 30 6 Ashikhmin/Shirley factored 50 (60)* 2 Ashikhmin/Shirley 18 2 Banks Factored 25 1 Banks Direct 10 2 Blinn-Phong factored 15 1 Blinn-Phong Direct ALU costs Texture costs Model

24. Accuracy of Blinn-Phong chart courtesy of Addy Ngan, Fr é do Durand, and Wojciech Matusik

25. Accuracy of Ashikhmin Shirley chart courtesy of Addy Ngan, Fr é do Durand, and Wojciech Matusik

27. Bump Mapping

28. Pixel Level Evaluation

29. Pixel Level Evaluation, Shift

32. What Does a Sample Point Mean? What happens when this pixel is evaluated? Given a set of parameters interpolated from the triangles 3 vertices, how do we go about generating a color?

33. Texture Filtering Review A (1-A) B (1-B) Sample Color = A*B * + A*(1-B) * + (1-A)*B * + (1-A)*(1-B)* +

34. Texture swimming

35. What about lower resolutions?

36. A common hack: Level of Detail MIP Level By lowering the amplitude Of the displacement, effectively decreasing to a less complex model as the model moves further away. This will prevent aliasing, but isn’t accurate

39. MIP Mapping r t

41. Non Linear Lighting models Blinn-Phong isn’t Linear!

43. Texture Space Lighting Rasterize triangles using texture coordinates as positions, the left image is the normal sampled at each point, and the right image is the computed lighting

44. Texture Space lighting We paste the texture onto the object

46. A roadway, snapshots We can see Moiré patterns on any filtered non linear functions. Additionally, temporal aliasing becomes problematic.

47. Using TSL The artifacts are largely mitigated if we render the non linear function and MIP reduce. We can also see more high frequency detail.

49. The Shader void lightPositional( …) { // norm, light and half are in tangent space // power, Kd, Ks and norm come from textures … //normalized blinn phong float fS = pow ( saturate ( dot (norm, half)), power)) * power; float fD = saturate ( dot (norm, light)) * diffuseIntensity; vColorOut.xyz = fS * Ks + fD * Kd; vColorOut.a = 1; //put us in gamma space for the direct rendering only if (bTextureView) vColorOut = sqrt (vColorOut); }

50. Pasting the texture on the Scene void light_from_texture( float2 vTexCoord: TEXCOORD0, out float4 vColorOut: COLOR0 ) { // this is done with full anisotropy turned on // with SRGBTexture set to true vColorOut = tex2D (LightMapSampler, vTexCoord); //for atlased objects, we do not want to blend in // unrendered pixels if ( vColorOut.a > 1e-5 ) vColorOut.xyz /= vColorOut.a; //put us in gamma space vColorOut = sqrt (vColorOut); }

51. Drawing polygons on the backside [ emittype [ triangle MyVType ]] [ maxvertexcount [3]] void ClipGeometryShader( triangle MyVType TextureTri[3]) { float2 coord1 = project(TextureTri[0]); float2 coord2 = project(TextureTri[1]); float2 coord3 = project(TextureTri[2]); float3 Vec1 = float3 (coord3 – coord1, 0); float3 Vec2 = float3 (coord3 – coord2, 0); float Sign = cross (Vec1, Vec2).z; if (Sign > -EPSILON) { emit (TextureTri[0]); emit (TextureTri[1]); emit (TextureTri[2]); cut ; } }

53. MIP-Mapping Reflectance Models

59. A simple non linear function The Blinn-Phong lighting model is one of the most common half angle based lighting functions. The above is a normalized version , that is the total emitted energy is close to constant for any power. This model is parameterized by N, Kd, Ks, and p. Changing these values changes the properties of the underlying surface

60. A common approach The image on the left is lit with MIP maps fading to flat, while the image on the right is what the image would look like if rendered at a higher resolution and scaled down. The objects do not physically look the same.

61. A more correct MIP map The images in the middle were rendered directly to the screen using a BRDF approximating MIP map. The more we zoom out, the larger the difference between the correct and incorrect approaches

62. Examining a mip level – simple 32 32 32 32 32 Next MIP Level – same thing

63. Examining a mip level 8 45 16 25 25 Next MIP Level, Average Power?

64. Examining a MIP level 32 32 32 32 32 Next MIP Level, Average power, normal?

65. What about a larger patch and a lower mip? 5

68. Reflectance at a single texel Ks = .02, P = 30 Ks = .02, P = 30 Ks = .02, P = 24 Ks = .01, P =30 Ks = ???, P = ??? (?,?,?) For a given light and view direction, how do we pick a Ks, a Power and Normal so that we get the same final color? MIP Level 0 MIP Level 1

69. Solving for a single patch of texels For a given patch of texels w wide and h tall: Where,

70. We care about all pairs of L and V Creating an error function for a single pair of L and V: Need to find the minimum error across all possible V and L

74. Non linear with Blinn Phong With the Blinn-Phong BRDF, the error plot shows that the function is mostly smooth. As long as we take a guess in the dark region, we should be fine. Graph is log(1 + error) power Ks

76. Speeding it up But, we must use Half Angle Distribution

89. © 2005 Microsoft Corporation. All rights reserved. Microsoft, is a registered trademark of Microsoft Corporation in the United States and/or other countries. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.

90. © 2005 Microsoft Corporation. All rights reserved. Microsoft, is a registered trademark of Microsoft Corporation in the United States and/or other countries. The names of actual companies and products mentioned herein may be the trademarks of their respective owners.