WT-4071, GPU accelerated 3D graphics for Java, by Kevin Rushforth, Chien Yang, John Yoon and Nicolas Lorain

AMD Developer Summit
Session: WT-4071
GPU Accelerated 3D Graphics for Java
Kevin Rushforth & Chien Yang
Oracle Corporation

1

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Insert Information Protection Policy Classification from Slide 13

Program Agenda
!  JavaFX Graphics Overview
!  Transforms
!  Camera and Coordinate System
!  Z-buffer (depth test)
!  Movable Camera

2

Program Agenda
!  3D Geometry
!  3D Attributes
!  3D Picking
!  MSAA
!  SubScene
!  Wrap-up / Q&A

3

JavaFX Graphics Overview
" 

Scene graph model
" 

Hierarchy of group and leaf (graphic primitive) nodes

" 

Leaf nodes have individual graphical attributes

" 

Group nodes can have collective attributes

" 

Parent/child directed graph similar to component trees

4

" 

Capabilities
" 

Transformation (translate, rotate, scale and shear)

" 

Animation (timeline and transitions)

" 

Effects (blurs, drop shadows, color filters, etc.)

" 

Rendering attributes

5

" 

Primary graphical node types
" 

Shape (rectangle, circle, path, etc.)

" 

Text (a specialized form of Shape)

" 

ImageView

" 

MediaView

6

JavaFX SW Block Diagram
Application

JavaFX UI Controls
JavaFX Scene Graph API
Prism Renderer
SW

OpenGL

D3D
7

A Simple JavaFX Scene Graph
Stage

Scene

fill : SILVER

Root

Image
View
8

effect : DropShadow
translateX : 100
translateY : 75

Simple Scenegraph Demo

9

JavaFX 3D Features in JDK 7 (FX 2)
" 

3D Transforms

" 

Depth Buffer (Z-Buffer)

" 

Perspective Camera

10

How To Query 3D Support
" 

3D is an optional feature
" 

" 

" 

Runs on AMD/ATI, Intel and NVIDIA with Pixel Shader 3 support
Certain cards and drivers “blacklisted”

Use ConditionalFeature.SCENE3D to check
" 

" 

Indicates that 3D is available on the platform
Perspective camera, 3D transforms, depth test ignored on platform
without 3D support

11

JavaFX on Windows
" 

Windows Vista / 7 / 8 (32-bit or 64-bit)

" 

HW acceleration via DirectX 9.0c
" 

GPUs include: AMD, Intel HD, NVIDIA

" 

May need newer driver (especially for Intel HD)

" 

Run with -Dprism.verbose=true to check

12

JavaFX on Mac OS X
" 

Mac OS X 10.7 (Lion) and 10.8 (Mountain Lion)

" 

HW acceleration via OpenGL 2.0
" 

GPUs include: AMD, Intel HD, NVIDIA

" 


13

JavaFX on Linux
" 

Ubuntu 12.04 LTS or later, OEL 6 or later

" 

HW acceleration via OpenGL 2.0
" 

" 

Requires vendor-supplied driver

" 

" 

GPUs include: AMD, NVIDIA


Support for Intel HD, open source drivers in a later release
" 

You can try it now: -Dprism.forceGPU=true

14

JavaFX on Embedded
" 

HW acceleration via OpenGL ES 2

" 

3D is not supported for FX 8, but will be in future
" 

" 

Requires chipset that supports non-power-of-two textures
You can try it now on Raspberry Pi:
-Dcom.sun.javafx.experimental.embedded.3d=true

15

3D Transforms: Node
" 

Transform Properties
" 

layoutX, layoutY – X and Y translation used for layout

" 

translateX, translateY, translateZ – X, Y and Z translation

" 

rotate – angle of rotation in degrees (about Node center)

" 

rotationAxis – axis about which rotation is done (default Z-axis)

" 

scaleX, scaleY, scaleZ – X, Y and Z scale (about Node center)

" 

transforms – A list of Transform objects (applied in order)

16

Transforms
" 

Transform objects
" 

Translate(x, y, z, pivotX, pivotY, pivotZ)

" 

Scale(x, y, z, pivotX, pivotY, pivotZ)

" 

Rotate(angle, pivotX, pivotY, pivotZ, axis)

" 

Affine(mxx, mxy, mxz, tx, myx, myy, myz, ty, mzx, mzy, mzz, tz)

17

Order of Transform Operations
Translate(layoutX+translateX, layoutY+translateY, translateZ)
Translate(pivotX, pivotY, pivotZ) // computed center of node
Rotate(rotate, rotationAxis)
Scale(scaleX, scaleY, scaleZ)
Translate(-pivotX, -pivotY, -pivotZ) // computed center of node
transform[0]
transform[1]
...
18

Depth Buffer (Z-buffer)
" 

Objects rendered in scene graph order
" 

" 

" 

Render order defines z order for 2D scene
Render order != z value of objects in 3D scene
(unless you reorder the scene graph)

Depth buffer will sort objects based on their z value
" 

Sort is done per pixel by GPU

19

Group
A

Group
B
C

2D Rendering Order: A, B, C, D
“D” is on top

20

D

" 

" 

" 

" 


" 


21

Group
A

Group

Z=0

B
Z=3

C
Z=1

D
Z=2

Rendering Order: A, B, C, D
Actual Z Order: B, D, C, A
“A” should be on top, but “D” will be

22

" 

" 

" 

" 


" 


23

" 

Construct scene with depth buffer attribute

" 

Node has depthTest property
" 

DISABLE, ENABLE and INHERIT

" 

depthTest is only used on Scene with a depth buffer

" 

Its default value is INHERIT

" 

If depthTest = INHERIT, depth testing is enabled if it is enabled for
its parent node (or its parent node is null)

24

Depth Test Demo

25

VideoCube Demo

26

Cameras and Coordinate System
" 

ParallelCamera Class
" 

A viewing volume for a parallel (ortho) projection; a rectangular box

" 

Located at center of the scene; looks along the positive Z-axis

" 

Origin in the upper left corner of the scene with the Y-axis pointing
down and the Z-axis pointing away from the viewer (into the screen)

" 

The units are in pixel coordinates

" 

This is the default if no camera is specified

27

Cameras and Coordinate System
" 

PerspectiveCamera Class
" 

A viewing volume for a perspective projection; a truncated right
pyramid
- 

" 

" 

" 

Field of view property (default = 30 degrees)

It is always located at center of the scene and looks along the
positive Z-axis
Origin in the upper left corner of the scene with the Y-axis pointing
down and the Z-axis pointing away from the viewer (into the screen)
The units are in pixel coordinates at the projection plane (Z=0)

28

JavaFX Coordinate System
" 

Differences from typical 3D coordinate systems
" 

Origin: top-left vs. center

" 

Direction: Y down vs. Y up

" 

Unit: pixel vs. normalized [-1, 1]

29

Coordinate System
Coordinate System
Converter Group

Axis Group

Translate
Rotate
Scale

3D Group

X Axis
Z Axis
Y Axis
30

Box

Coordinate System Demo

31

New JavaFX 3D Features in JDK 8
" 

Movable cameras

" 

3D primitives (e.g., meshes, predefined solids)

" 

3D attributes (e.g., lights, materials)

" 

3D picking

" 

Scene Antialiasing

" 

SubScene

32

Camera Class Hierarchy
" 

javafx.scene.Node
" 

javafx.scene.Camera
- 

javafx.scene.ParallelCamera

- 

javafx.scene.PerspectiveCamera

33

Movable Camera
" 

Camera is now a Node
" 

Add to scene graph to move the camera
Position and aim camera using transforms
-  New “fixed eye” mode for 3D scenes
Non-moving camera need not be added to
scene graph
- 

" 

" 

New properties for near & far clipping plane

34

Specifying a Fixed Camera

// Create a camera and set it on the Scene
Camera camera = new PerspectiveCamera();
scene.setCamera(camera);

35

Specifying a Movable Camera
// Create a movable camera and set it on the Scene
Camera camera = new PerspectiveCamera(true);
scene.setCamera(camera);
// Add camera to scene graph (so it can move)
Group cameraGroup = new Group();
cameraGroup.getChildren().add(camera);
root.getChildren().add(cameraGroup);
// Rotate the camera
camera.rotate(45);
// Move the cameraGroup (camera moves with it)
cameraGroup.setTranslateZ(-75);
36

Movable Camera Demo

37

3D Shapes
" 

FX 2 only has 2D shapes (with 3D transforms)

" 

FX 8 adds 3D shapes
" 

User-defined shapes

" 

Predefined shapes

38

Shape3D Class Hierarchy
" 

javafx.scene.Node
" 

javafx.scene.shape.Shape3D
- 

javafx.scene.shape.MeshView

- 

javafx.scene.shape.Box

- 

javafx.scene.shape.Cylinder

- 

javafx.scene.shape.Sphere

39

Shape3D Class Hierarchy, continued
" 

java.lang.Object
" 

javafx.scene.shape.Mesh
- 

javafx.scene.shape.TriangleMesh

40

TriangleMesh
" 

Geometry
" 

" 

A set of texture coordinates

" 

" 

A set of positions
A set of faces (triangles) that describe the topology

Smoothing group
" 

" 

" 

Used to group triangles that are part of same curved surface
Hard edges between triangles in different smoothing groups

Sharable among multiple MeshView nodes

41

Defining a MeshView
// Create the arrays of positions, texCoords
float[] positions = createPositions();
float[] texCoords = createUVs();
// Create faces (indices into the positions, texCoord arrays)
int[] faces = createFaces();
// Create a mesh
TriangleMesh mesh = new TriangleMesh();
mesh.getPositions.setAll(positions);
mesh.getTexCoords.setAll(texCoords);
mesh.getFaces.setAll(faces);
// Create meshView
MeshView mv = new MeshView(mesh);
42

MeshView Demo

43

Using Predefined Shapes
// Create a sphere with the given radius
Sphere sphere = new Sphere(0.3);
// Create a sphere with the given radius, number of divisions
Sphere sphere = new Sphere(0.3, 40);
// Create a cylinder with the given radius, and height
Sphere sphere = new Cylinder(0.2, 0.8);
// Create a box with the given width, height, and depth
Box box = new Box(0.5, 0.5, 0.5);
// NOTE: All 3D shapes are centered at (0,0,0)

44

Predefined Shapes Demo

45

3D Attributes
" 

Lights

" 

Materials
" 

Used to specify the appearance of a 3D shape

" 

Face culling

" 

Drawing mode (fill versus wireframe)

46

Light Class Hierarchy
" 

javafx.scene.Node
" 

javafx.scene.LightBase
- 

javafx.scene.AmbientLight

- 

javafx.scene.PointLight

47

3D Attributes: Lights
" 

Defined as nodes in the scene graph

" 

Scene contains a set of active lights
" 

" 

Default light provided when the set is empty

Each light contains a set of affected nodes (scope)
" 
" 

" 

If a Parent is in the set, all children are affected
Default is root node of Scene

Each Shape3D affected by up to 3 lights (in FX 8)

48

Defining Lights
// Create point light and add it to the Scene
PointLight light = new PointLight();
light.setColor(Color.RED);
scene.getLights().add(light);
// Add light to scene graph (so it can move)
Group lightGroup = new Group();
lightGroup.getChildren().add(light);
root.getChildren().add(lightGroup);
// Rotate the light
light.rotate(45);
// Move the lightGroup (light moves with it)
lightGroup.setTranslateZ(-75);
49

Lighting Demo

50

Material Class Hierarchy
" 

java.lang.Object
" 

javafx.scene.paint.Material
- 

javafx.scene.paint.PhongMaterial

51

3D Attributes: PhongMaterial
" 

Contains the following properties:
" 
" 

Specular color, specular map

" 

Specular power

" 

Bump map

" 
" 

Diffuse color, diffuse map

Self-illumination map

Sharable among multiple Shape3D nodes

52

Defining Materials
// Create material
Material mat = new PhongMaterial();
Image diffuseMap = new Image("diffuseMap.png");
Image bumpMap = new Image("normalMap.png");
// Set material properties
mat.setDiffuseMap(diffuseMap);
mat.setBumpMap(normalMap);
mat.setSpecularColor(Color.WHITE);
// Use the material for a shape
shape3d.setMaterial(mat);

53

Materials Demo

54

Scene Antialiasing
" 

In 2D, we use pixel shaders for alpha-blended AA

" 

This doesn’t work for 3D
" 

" 

Alpha blending doesn’t play nice with depth test

Solution: Scene antialiasing (e.g., MSAA)
" 

Render multiple samples per pixel

" 

Filter the result when drawing to the screen

" 

Requires hardware support

55

Scene AA Demo

56

SubScene Hierarchy
" 

javafx.scene.Node
" 

javafx.scene.SubScene

57

SubScene
" 

Use SubScene node to render part of scene with
different camera or attributes (depth test, AA)
" 

" 

Used to separate 2D and 3D content
Overlay or “heads-up” display for UI controls in a
scene with a moving camera

58

SubScene Demo

59

3D Picking
" 

3D ray picking already used for 2D primitive with
PerspectiveCamera

" 

This is extended to support picking 3D geometry

" 

Additional API provides intersected point

60

3D Picking Demo

61

Loading Models
" 

Many 3D file formats exist, such as:
" 

Obj, Maya, 3D Studio Max, Collada

" 

We will make sample code available for some of these

" 

Members of the community can also write loaders

62

Loader Demo

63

Futures
" 

" 

More vertex data formats (e.g., normals)
More geometry (e.g, cone, 3D text, triangle strips,
subdivision surfaces)

" 

Advanced lighting and shading

" 

Picking API

" 

Mixing native (OpenGL, D3D?) rendering with JavaFX

64

Futures
" 

Accelerated mesh animation

" 

Loaders

" 

Geometry utilities (e.g., vecmath, camera controller)

65

3D Demo

66

Q&A

67

WT-4071, GPU accelerated 3D graphics for Java, by Kevin Rushforth, Chien Yang, John Yoon and Nicolas Lorain

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à WT-4071, GPU accelerated 3D graphics for Java, by Kevin Rushforth, Chien Yang, John Yoon and Nicolas Lorain

Similaire à WT-4071, GPU accelerated 3D graphics for Java, by Kevin Rushforth, Chien Yang, John Yoon and Nicolas Lorain (20)

Plus de AMD Developer Central

Plus de AMD Developer Central (20)

Dernier

Dernier (20)

WT-4071, GPU accelerated 3D graphics for Java, by Kevin Rushforth, Chien Yang, John Yoon and Nicolas Lorain