SLProject  4.2.000
A platform independent 3D computer graphics framework for desktop OS, Android, iOS and online in web browsers
Public Member Functions | Private Attributes | List of all members
AppDemoSceneVideoTrackFace Class Reference

Class for facial feature tracking test scene. More...

#include <AppDemoSceneVideoTrackFace.h>

Inheritance diagram for AppDemoSceneVideoTrackFace:
[legend]

Public Member Functions

 AppDemoSceneVideoTrackFace (SLSceneID sid)
 
void registerAssetsToLoad (SLAssetLoader &al) override
 All scene specific assets have to be registered for async loading in here. More...
 
void assemble (SLAssetManager *am, SLSceneView *sv) override
 After parallel loading of the assets the scene gets assembled in here. More...
 
- Public Member Functions inherited from SLScene
 SLScene (const SLstring &name)
 
 ~SLScene () override
 
void initOculus (SLstring shaderDir)
 
void root3D (SLNode *root3D)
 
void root2D (SLNode *root2D)
 
void skybox (SLSkybox *skybox)
 
void stopAnimations (SLbool stop)
 
void info (SLstring i)
 
void loadTimeMS (SLfloat loadTimeMS)
 
SLAnimManager & animManager ()
 
SLAssetManager * assetManager ()
 
SLNode * root3D ()
 
SLNode * root2D ()
 
SLSkybox * skybox ()
 
SLstring & info ()
 
SLfloat elapsedTimeMS () const
 
SLfloat elapsedTimeSec () const
 
SLVEventHandler & eventHandlers ()
 
SLfloat loadTimeMS () const
 
SLVLight & lights ()
 
SLfloat fps () const
 
AvgFloat & frameTimesMS ()
 
AvgFloat & updateTimesMS ()
 
AvgFloat & updateAnimTimesMS ()
 
AvgFloat & updateAABBTimesMS ()
 
AvgFloat & updateDODTimesMS ()
 
SLNode * singleNodeSelected ()
 Returns the node if only one is selected. See also SLMesh::selectNodeMesh. More...
 
SLMesh * singleMeshFullSelected ()
 Returns the node if only one is selected. See also SLMesh::selectNodeMesh. More...
 
SLVNode & selectedNodes ()
 
SLVMesh & selectedMeshes ()
 
SLbool stopAnimations () const
 
SLint numSceneCameras ()
 Returns the number of camera nodes in the scene. More...
 
SLCamera * nextCameraInScene (SLCamera *activeSVCam)
 Returns the next camera in the scene if there is one. More...
 
bool onUpdate (bool renderTypeIsRT, bool voxelsAreShown, bool forceCPUSkinning)
 Updates animations and AABBs. More...
 
void init (SLAssetManager *am)
 
virtual void unInit ()
 
void selectNodeMesh (SLNode *nodeToSelect, SLMesh *meshToSelect)
 Handles the full mesh selection from double-clicks. More...
 
void deselectAllNodesAndMeshes ()
 Deselects all nodes and its meshes. More...
 
SLGLOculus * oculus ()
 
- Public Member Functions inherited from SLObject
 SLObject (const SLstring &Name="", const SLstring &url="")
 
virtual ~SLObject ()
 
void name (const SLstring &Name)
 
void url (const SLstring &url)
 
const SLstring & name () const
 
const SLstring & url () const
 

Private Attributes

SLSceneID _sceneID
 
SLNode * _glasses
 

Additional Inherited Members

- Protected Attributes inherited from SLScene
SLVLight _lights
 Vector of all lights. More...
 
SLVEventHandler _eventHandlers
 Vector of all event handler. More...
 
SLAnimManager _animManager
 Animation manager instance. More...
 
SLAssetManager * _assetManager
 Pointer to the external assetManager. More...
 
SLNode * _root3D
 Root node for 3D scene. More...
 
SLNode * _root2D
 Root node for 2D scene displayed in ortho projection. More...
 
SLSkybox * _skybox
 pointer to skybox More...
 
SLstring _info
 scene info string More...
 
SLVNode _selectedNodes
 Vector of selected nodes. See SLMesh::selectNodeMesh. More...
 
SLVMesh _selectedMeshes
 Vector of selected meshes. See SLMesh::selectNodeMesh. More...
 
SLfloat _loadTimeMS
 time to load scene in ms More...
 
SLfloat _frameTimeMS
 Last frame time in ms. More...
 
SLfloat _lastUpdateTimeMS
 Last time after update in ms. More...
 
SLfloat _fps
 Averaged no. of frames per second. More...
 
AvgFloat _frameTimesMS
 Averaged total time per frame in ms. More...
 
AvgFloat _updateTimesMS
 Averaged time for update in ms. More...
 
AvgFloat _updateAABBTimesMS
 Averaged time for update the nodes AABB in ms. More...
 
AvgFloat _updateAnimTimesMS
 Averaged time for update the animations in ms. More...
 
AvgFloat _updateDODTimesMS
 Averaged time for update the SLEntities graph. More...
 
SLbool _stopAnimations
 Global flag for stopping all animations. More...
 
std::unique_ptr< SLGLOculus > _oculus
 Oculus Rift interface. More...
 
- Protected Attributes inherited from SLObject
SLstring _name
 name of an object More...
 
SLstring _url
 uniform resource locator More...
 

Detailed Description

Class for facial feature tracking test scene.

Definition at line 20 of file AppDemoSceneVideoTrackFace.h.

Constructor & Destructor Documentation

◆ AppDemoSceneVideoTrackFace()

AppDemoSceneVideoTrackFace::AppDemoSceneVideoTrackFace ( SLSceneID  sid)

Definition at line 29 of file AppDemoSceneVideoTrackFace.cpp.

30  : SLScene("Facial Feature Tracking"),
31  _sceneID(sid)
32 {
33  if (_sceneID == SID_VideoTrackFaceMain)
34  name("Track Face (main cam.)");
35  else
36  name("Track Face (scnd. cam.)");
37  info("Face and facial landmark detection.");
38 }
SID_VideoTrackFaceMain
@ SID_VideoTrackFaceMain
Definition: AppDemoSceneID.h:87
SLObject::name
const SLstring & name() const
Definition: SLObject.h:38
SLScene::SLScene
SLScene(const SLstring &name)
Definition: SLScene.cpp:39
SLScene::info
SLstring & info()
Definition: SLScene.h:102

Member Function Documentation

◆ assemble()

void AppDemoSceneVideoTrackFace::assemble ( SLAssetManager *  am,
SLSceneView *  sv 
)
overridevirtual

After parallel loading of the assets the scene gets assembled in here.

Remarks
All scene-specific assets have to be loaded async by overriding SLScene::registerAssetsToLoad and SLScene::assemble. Async loading and assembling means that it happens in a parallel thread and that in there are no OpenGL calls allowed. OpenGL calls are only allowed in the main thread. It is important that all object instantiations within SLScene::assemble do NOT call any OpenGL functions (gl*) because they happen in a parallel thread. All objects that get rendered have to do their initialization when they are used the first time during rendering in the main thread.

Reimplemented from SLScene.

Definition at line 64 of file AppDemoSceneVideoTrackFace.cpp.

65 {
66 #ifndef SL_EMSCRIPTEN
67  /*
68  The tracking of markers is done in AppDemoVideo::onUpdateVideo by calling
69  the specific CVTracked::track method. If a marker was found it overwrites
70  the linked nodes object matrix (SLNode::_om). If the linked node is the
71  active camera the found transform is additionally inversed.
72  This would be the standard augmented reality use case.
73  */
74  if (_sceneID == SID_VideoTrackFaceMain)
75  CVCapture::instance()->videoType(VT_MAIN);
76  else
77  CVCapture::instance()->videoType(VT_SCND);
78 
79  SLCamera* cam1 = new SLCamera("Camera 1");
80  cam1->translation(0, 0, 0.5f);
81  cam1->clipNear(0.1f);
82  cam1->clipFar(1000.0f);
83  cam1->setInitialState();
84  cam1->devRotLoc(&AppCommon::devRot, &AppCommon::devLoc);
85  cam1->background().texture(gVideoTexture);
86 
87  SLLightSpot* light1 = new SLLightSpot(am,
88  this,
89  10,
90  10,
91  10,
92  1);
93  light1->powers(1.0f, 1.0f, 1.0f);
94  light1->attenuation(1, 0, 0);
95 
96  // configure sunglasses
97  _glasses->scale(0.008f);
98  _glasses->translate(0, 1.5f, 0);
99 
100  // Add axis arrows at world center
101  SLNode* axis = new SLNode(new SLCoordAxis(am), "Axis Node");
102  axis->setDrawBitsRec(SL_DB_MESHWIRED, false);
103  axis->scale(0.03f);
104 
105  // Scene structure
106  SLNode* scene = new SLNode("Scene");
107  root3D(scene);
108  scene->addChild(light1);
109  scene->addChild(cam1);
110  scene->addChild(_glasses);
111  scene->addChild(axis);
112 
113  // The tracker moves the camera node
114  gVideoTrackedNode = cam1;
115 
116  sv->doWaitOnIdle(false); // for constant video feed
117  sv->camera(cam1);
118 #endif
119 }
gVideoTrackedNode
SLNode * gVideoTrackedNode
Definition: AppDemoVideo.cpp:42
gVideoTexture
SLGLTexture * gVideoTexture
Definition: AppDemoVideo.cpp:32
VT_SCND
@ VT_SCND
Selfie camera on mobile devices.
Definition: CVCapture.h:43
VT_MAIN
@ VT_MAIN
Main camera on all on all all devices.
Definition: CVCapture.h:42
SL_DB_MESHWIRED
#define SL_DB_MESHWIRED
Draw polygons as wired mesh.
Definition: SLDrawBits.h:22
AppCommon::devRot
static SLDeviceRotation devRot
Mobile device rotation from IMU.
Definition: AppCommon.h:64
AppCommon::devLoc
static SLDeviceLocation devLoc
Mobile device location from GPS.
Definition: AppCommon.h:65
CVCapture::videoType
void videoType(CVVideoType vt)
Setter for video type also sets the active calibration.
Definition: CVCapture.cpp:866
CVCapture::instance
static CVCapture * instance()
Public static instance getter for singleton pattern.
Definition: CVCapture.h:65
SLBackground::texture
void texture(SLGLTexture *backgroundTexture, bool fixAspectRatio=false)
If flag _repeatBlurred is true the texture is not distorted if its size does not fit to screen aspect...
Definition: SLBackground.cpp:114
SLCamera
Active or visible camera node class.
Definition: SLCamera.h:54
SLCamera::clipFar
void clipFar(const SLfloat cFar)
Definition: SLCamera.h:109
SLCamera::clipNear
void clipNear(const SLfloat cNear)
Definition: SLCamera.h:108
SLCamera::devRotLoc
void devRotLoc(SLDeviceRotation *devRot, SLDeviceLocation *devLoc)
Definition: SLCamera.h:120
SLCamera::background
SLBackground & background()
Definition: SLCamera.h:165
SLCoordAxis
Axis aligned coordinate axis mesh.
Definition: SLCoordAxis.h:31
SLLight::attenuation
void attenuation(const SLfloat kConstant, const SLfloat kLinear, const SLfloat kQuadratic)
Definition: SLLight.h:116
SLLight::powers
void powers(SLfloat ambiPow, SLfloat diffPow, SLfloat specPow, const SLCol4f &ambiDiffSpecCol=SLCol4f::WHITE)
Sets the ambient, diffuse and specular powers all with the same color.
Definition: SLLight.h:74
SLLightSpot
SLLightSpot class for a spot light source.
Definition: SLLightSpot.h:36
SLNode
SLNode represents a node in a hierarchical scene graph.
Definition: SLNode.h:147
SLNode::addChild
void addChild(SLNode *child)
Definition: SLNode.cpp:207
SLNode::translation
void translation(const SLVec3f &pos, SLTransformSpace relativeTo=TS_parent)
Definition: SLNode.cpp:828
SLNode::scale
void scale(SLfloat s)
Definition: SLNode.h:640
SLNode::setInitialState
void setInitialState()
Definition: SLNode.cpp:1084
SLNode::setDrawBitsRec
void setDrawBitsRec(SLuint bit, SLbool state)
Definition: SLNode.cpp:804
SLNode::translate
void translate(const SLVec3f &vec, SLTransformSpace relativeTo=TS_object)
Definition: SLNode.cpp:906
SLScene::root3D
SLNode * root3D()
Definition: SLScene.h:99
SLScene::SLNode
friend class SLNode
Definition: SLScene.h:48
SLSceneView
SceneView class represents a dynamic real time 3D view onto the scene.
Definition: SLSceneView.h:69
SLSceneView::camera
void camera(SLCamera *camera)
Definition: SLSceneView.h:145
SLSceneView::doWaitOnIdle
void doWaitOnIdle(SLbool doWI)
Definition: SLSceneView.h:149

◆ registerAssetsToLoad()

void AppDemoSceneVideoTrackFace::registerAssetsToLoad ( SLAssetLoader &  al)
overridevirtual

All scene specific assets have to be registered for async loading in here.

All assets the should be loaded in parallel must be registered in here.

Remarks
All scene sspecific assets have to be loaded async by overriding SLScene::registerAssetsToLoad and SLScene::assemble. Async loading and assembling means that it happens in a parallel thread and that in there are no OpenGL calls allowed. OpenGL calls are only allowed in the main thread.

Reimplemented from SLScene.

Definition at line 41 of file AppDemoSceneVideoTrackFace.cpp.

42 {
43  al.addNodeToLoad(_glasses,
44  AppCommon::modelPath +
45  "FBX/Sunglasses.fbx");
46 
47  // Create video texture on global pointer updated in AppDemoVideo
48  al.addTextureToLoad(gVideoTexture,
49  AppCommon::texturePath +
50  "LiveVideoError.png",
51  GL_LINEAR,
52  GL_LINEAR);
53 
54  // Create a face tracker
55  al.addLoadTask([]()
56  {
57  gVideoTracker = new CVTrackedFaces(AppCommon::calibIniPath + "haarcascade_frontalface_alt2.xml",
58  AppCommon::calibIniPath + "lbfmodel.yaml",
59  3);
60  gVideoTracker->drawDetection(true); });
61 }
gVideoTracker
CVTracked * gVideoTracker
Definition: AppDemoVideo.cpp:37
AppCommon::calibIniPath
static SLstring calibIniPath
That's where data/calibrations folder is located.
Definition: AppCommon.h:108
AppCommon::modelPath
static SLstring modelPath
Path to 3D models.
Definition: AppCommon.h:85
AppCommon::texturePath
static SLstring texturePath
Path to texture images.
Definition: AppCommon.h:86
CVTrackedFaces
OpenCV face & facial landmark tracker class derived from CVTracked.
Definition: CVTrackedFaces.h:35
CVTracked::drawDetection
void drawDetection(bool draw)
Definition: CVTracked.h:60
SLAssetLoader::addLoadTask
void addLoadTask(SLAssetLoadTask task)
Add generic task.
Definition: SLAssetLoader.cpp:304
SLAssetLoader::addTextureToLoad
void addTextureToLoad(SLGLTexture *&texture, const SLstring &path, SLint min_filter=GL_LINEAR_MIPMAP_LINEAR, SLint mag_filter=GL_LINEAR, SLTextureType type=TT_unknown, SLint wrapS=GL_REPEAT, SLint wrapT=GL_REPEAT)
Add 2D textures with internal image allocation.
Definition: SLAssetLoader.cpp:97
SLAssetLoader::addNodeToLoad
void addNodeToLoad(SLNode *&node, const SLstring &modelPath, SLSkybox *skybox=nullptr, SLbool deleteTexImgAfterBuild=false, SLbool loadMeshesOnly=true, SLMaterial *overrideMat=nullptr, float ambientFactor=0.5f, SLbool forceCookTorranceRM=false, SLuint flags=SLProcess_Triangulate|SLProcess_JoinIdenticalVertices|SLProcess_RemoveRedundantMaterials|SLProcess_FindDegenerates|SLProcess_FindInvalidData|SLProcess_SplitLargeMeshes)
Add mesh from file to load via assimp loader.
Definition: SLAssetLoader.cpp:251

Member Data Documentation

◆ _glasses

SLNode* AppDemoSceneVideoTrackFace::_glasses
private

Definition at line 46 of file AppDemoSceneVideoTrackFace.h.

◆ _sceneID

SLSceneID AppDemoSceneVideoTrackFace::_sceneID
private

Definition at line 45 of file AppDemoSceneVideoTrackFace.h.

The documentation for this class was generated from the following files: