24. Research Example
March on the spot
Just lift your leg gently
Increase your confidence through exercise
Even if you're not moving
Notes de l'éditeur
Hello everyone Today I will introduce a framework system for studying mixed reality
As I mentioned in my last presentation, Xr is a concept not a technologic
But it will guide us about how to improve existing technologies.
So How Can I Do It Better?
As Current科润特 vr and ar devices The interaction and display are visible only to the user.
Others are unable to engage and perceive泼系唔 the interaction.*****
But mixed reality allows more people to perceive the digital virtual environment
If we want to get mixed reality,****The easy way is to add vr and ar together.
We can (in tui tive ly ) adjust the effect of vr and ar. Easy for us to observe and research
So there is a demo video to show How can we see the VR environment
Now we can easily convert VR games into mr videos. Observe the performance of users under VR.********
But a lot of in-game data can't be exported and doesn't fit into many research.
But my framework Due to the features of the engine we can customize the content of the game and export the data at the same time
This is the tool required for the overall framework composition
So there is my framework demo video****
Pleases see it
Use minecraft's powerful map editor We can build all kinds of experimental environments that we need
The first is HTC vive, It can provide virtual reality environments
It also provides real-time feedback to our users' action data
in general We want to get a mixed reality effect, we need a green screen environment,
, We can't adapt to every situation
But I used Microsoft's Kinect ***** Thus did not need the green screen
Kinect is a depth sensing camera*****
He can separate the characters from the background in real time
With sdk , We can easily achieve the green screen effect
The problem with the pants is because of the special material
My sweatpants will reflect some light impression capture effects
Virtual reality software uses Minecraft
Minecraft is written in java and is a popular game worldwide.***
There are even educational editions devoted to educational research that can be used by schools.****
It's also a powerful creative engine that can do a lot of things..****
Unfortunately the game itself is closed source software and cannot be directly modified into the engine we need
But we can use a software called forge****** to rebuild the Minecraft.
And we can got a lot of api******
Use those api, We can get a modified Minecraft*****
As our virtual reality engine
Called vivecraft
Vivecraft has a lot of features We are free to modify it
Get the data we want. Support multiple devices and multiplayer at the same time
So that we can modify the variable conditions for research
There is a demo for MR video fusion
The first is normal camera
Use Kinect with sdk we can got the depth camera witch green screen
Use green filter we can got the User picture with transparent (Alpha Channel channel
Use this picture as a layer*****
Combine the background layer and foreground layer form vivecraft
Import all layers into the rendering software called OBS******
Use obs to generate video in real time *****or upload video to cloud broadcast to various screens
Like Live Streaming
So there is a research example with lai kecheng
For example We can deply equipment to someone who March on the spot*****
And get date form senser on she leg
As we know When we doing Elderly Rehabilitation Exercise
Use the Virtual reality environment
You just lift your leg gently it will help you increase your confidence thorough virtual reality exercise
Even if you re not moving