Sample to operate omron HVC-P2 on GR-PEACH.

Dependencies:   AsciiFont

Information

Please see here for Japanese version.
日本語版はこちらを参照ください。

What is this ?

This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.

/media/uploads/dkato/hvcp2_demo_img3.jpg

HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.

In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/

Constitution

  1. HVC-P2 x 1
  2. USBA-microUSB conversion cable x 2
  3. USBA-microUSB conversion adapter x 1
  4. GR-PEACH x 1
  5. 4.3inc LCD shield x 1

/media/uploads/dkato/composition_hvcp2_demo.jpg

/media/uploads/dkato/composition_hvcp2_demo_2.jpg

Please close JP3 of GR-PEACH.
/media/uploads/RyoheiHagimoto/usb.jpg

How to use

It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.

  • Function ON : orange or green
  • Function OFF : blue or gray

Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.

Register Data (Face Recognition)

Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.

/media/uploads/dkato/hvcp2_demo_img2.jpg

Change parameters

When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.

/media/uploads/dkato/hvcp2_demo_config_icon.jpg
/media/uploads/dkato/hvcp2_demo_config.jpg

Change transfer image size

By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
/media/uploads/dkato/gr-peach_switch2.jpg

Committer:
dkato
Date:
Tue Sep 05 10:01:51 2017 +0000
Revision:
5:49a61433290a
Add HVC sensing result stabilizing library

Who changed what in which revision?

UserRevisionLine numberNew contents of line
dkato 5:49a61433290a 1 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 2 /* Copyright(C) 2017 OMRON Corporation */
dkato 5:49a61433290a 3 /* */
dkato 5:49a61433290a 4 /* Licensed under the Apache License, Version 2.0 (the "License"); */
dkato 5:49a61433290a 5 /* you may not use this file except in compliance with the License. */
dkato 5:49a61433290a 6 /* You may obtain a copy of the License at */
dkato 5:49a61433290a 7 /* */
dkato 5:49a61433290a 8 /* http://www.apache.org/licenses/LICENSE-2.0 */
dkato 5:49a61433290a 9 /* */
dkato 5:49a61433290a 10 /* Unless required by applicable law or agreed to in writing, software */
dkato 5:49a61433290a 11 /* distributed under the License is distributed on an "AS IS" BASIS, */
dkato 5:49a61433290a 12 /* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. */
dkato 5:49a61433290a 13 /* See the License for the specific language governing permissions and */
dkato 5:49a61433290a 14 /* limitations under the License. */
dkato 5:49a61433290a 15 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 16
dkato 5:49a61433290a 17 #include "STBCommonDef.h"
dkato 5:49a61433290a 18 #include "STBFaceInfo.h"
dkato 5:49a61433290a 19 #include "STB_Debug.h"
dkato 5:49a61433290a 20 #include "STBValidValue.h"
dkato 5:49a61433290a 21
dkato 5:49a61433290a 22
dkato 5:49a61433290a 23
dkato 5:49a61433290a 24
dkato 5:49a61433290a 25 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 26 /*CopyFace : Face information all copy*/
dkato 5:49a61433290a 27 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 28 static VOID CopyFace(FaceObj *faceSrc,FaceObj *faceDst, const STBExecFlg *execFlg )
dkato 5:49a61433290a 29 {
dkato 5:49a61433290a 30
dkato 5:49a61433290a 31 STB_INT32 j;
dkato 5:49a61433290a 32
dkato 5:49a61433290a 33 faceDst->nDetID = faceSrc->nDetID ;
dkato 5:49a61433290a 34 faceDst->nTraID = faceSrc->nTraID ;
dkato 5:49a61433290a 35 if( execFlg->gen == STB_TRUE )
dkato 5:49a61433290a 36 {
dkato 5:49a61433290a 37 faceDst->genConf = faceSrc->genConf ;
dkato 5:49a61433290a 38 faceDst->genStatus = faceSrc->genStatus ;
dkato 5:49a61433290a 39 faceDst->genVal = faceSrc->genVal ;
dkato 5:49a61433290a 40 }
dkato 5:49a61433290a 41 if( execFlg->age == STB_TRUE )
dkato 5:49a61433290a 42 {
dkato 5:49a61433290a 43 faceDst->ageConf = faceSrc->ageConf ;
dkato 5:49a61433290a 44 faceDst->ageStatus = faceSrc->ageStatus ;
dkato 5:49a61433290a 45 faceDst->ageVal = faceSrc->ageVal ;
dkato 5:49a61433290a 46 }
dkato 5:49a61433290a 47 if( execFlg->fr == STB_TRUE )
dkato 5:49a61433290a 48 {
dkato 5:49a61433290a 49 faceDst->frConf = faceSrc->frConf ;
dkato 5:49a61433290a 50 faceDst->frStatus = faceSrc->frStatus ;
dkato 5:49a61433290a 51 faceDst->frVal = faceSrc->frVal ;
dkato 5:49a61433290a 52 }
dkato 5:49a61433290a 53 if( execFlg->exp == STB_TRUE )
dkato 5:49a61433290a 54 {
dkato 5:49a61433290a 55 faceDst->expConf = faceSrc->expConf ;
dkato 5:49a61433290a 56 faceDst->expStatus = faceSrc->expStatus ;
dkato 5:49a61433290a 57 faceDst->expVal = faceSrc->expVal ;
dkato 5:49a61433290a 58 for( j = 0 ; j < STB_EX_MAX ;j++)
dkato 5:49a61433290a 59 {
dkato 5:49a61433290a 60 faceDst->expScore[j] = faceSrc->expScore[j];
dkato 5:49a61433290a 61 }
dkato 5:49a61433290a 62 }
dkato 5:49a61433290a 63 if( execFlg->gaz == STB_TRUE )
dkato 5:49a61433290a 64 {
dkato 5:49a61433290a 65 faceDst->gazConf = faceSrc->gazConf ;
dkato 5:49a61433290a 66 faceDst->gazStatus = faceSrc->gazStatus ;
dkato 5:49a61433290a 67 faceDst->gazLR = faceSrc->gazLR ;
dkato 5:49a61433290a 68 faceDst->gazUD = faceSrc->gazUD ;
dkato 5:49a61433290a 69 }
dkato 5:49a61433290a 70 if( execFlg->dir == STB_TRUE )
dkato 5:49a61433290a 71 {
dkato 5:49a61433290a 72 faceDst->dirConf = faceSrc->dirConf ;
dkato 5:49a61433290a 73 faceDst->dirYaw = faceSrc->dirYaw ;
dkato 5:49a61433290a 74 faceDst->dirRoll = faceSrc->dirRoll ;
dkato 5:49a61433290a 75 faceDst->dirPitch = faceSrc->dirPitch ;
dkato 5:49a61433290a 76 faceDst->dirStatus = faceSrc->dirStatus ;
dkato 5:49a61433290a 77 }
dkato 5:49a61433290a 78 if( execFlg->bli == STB_TRUE )
dkato 5:49a61433290a 79 {
dkato 5:49a61433290a 80 faceDst->bliL = faceSrc->bliL ;
dkato 5:49a61433290a 81 faceDst->bliR = faceSrc->bliR ;
dkato 5:49a61433290a 82 faceDst->bliStatus = faceSrc->bliStatus ;
dkato 5:49a61433290a 83 }
dkato 5:49a61433290a 84
dkato 5:49a61433290a 85
dkato 5:49a61433290a 86
dkato 5:49a61433290a 87 }
dkato 5:49a61433290a 88 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 89 /* ClearFace */
dkato 5:49a61433290a 90 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 91 static VOID ClearFace ( FaceObj *face , int i , const STBExecFlg *execFlg )
dkato 5:49a61433290a 92 {
dkato 5:49a61433290a 93 STB_INT32 j;
dkato 5:49a61433290a 94
dkato 5:49a61433290a 95 face[i].nDetID = -1 ;
dkato 5:49a61433290a 96 face[i].nTraID = -1 ;
dkato 5:49a61433290a 97
dkato 5:49a61433290a 98 if( execFlg->gen == STB_TRUE )
dkato 5:49a61433290a 99 {
dkato 5:49a61433290a 100 face[i].genConf = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 101 face[i].genStatus = STB_STATUS_NO_DATA ;
dkato 5:49a61433290a 102 face[i].genVal = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 103 }
dkato 5:49a61433290a 104 if( execFlg->age == STB_TRUE )
dkato 5:49a61433290a 105 {
dkato 5:49a61433290a 106 face[i].ageConf = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 107 face[i].ageStatus = STB_STATUS_NO_DATA ;
dkato 5:49a61433290a 108 face[i].ageVal = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 109 }
dkato 5:49a61433290a 110 if( execFlg->fr == STB_TRUE )
dkato 5:49a61433290a 111 {
dkato 5:49a61433290a 112 face[i].frConf = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 113 face[i].frStatus = STB_STATUS_NO_DATA ;
dkato 5:49a61433290a 114 face[i].frVal = STB_ERR_FR_CANNOT ;
dkato 5:49a61433290a 115 }
dkato 5:49a61433290a 116 if( execFlg->exp == STB_TRUE )
dkato 5:49a61433290a 117 {
dkato 5:49a61433290a 118 face[i].expConf = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 119 for (j = STB_EX_NEUTRAL; j < STB_EX_MAX;j++)
dkato 5:49a61433290a 120 {
dkato 5:49a61433290a 121 face[i].expScore[j] = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 122 }
dkato 5:49a61433290a 123 face[i].expStatus = STB_STATUS_NO_DATA ;
dkato 5:49a61433290a 124 face[i].expVal = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 125 }
dkato 5:49a61433290a 126 if( execFlg->gaz == STB_TRUE )
dkato 5:49a61433290a 127 {
dkato 5:49a61433290a 128 face[i].gazConf = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 129 face[i].gazStatus = STB_STATUS_NO_DATA ;
dkato 5:49a61433290a 130 face[i].gazLR = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 131 face[i].gazUD = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 132 }
dkato 5:49a61433290a 133 if( execFlg->dir == STB_TRUE )
dkato 5:49a61433290a 134 {
dkato 5:49a61433290a 135 face[i].dirConf = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 136 face[i].dirStatus = STB_STATUS_NO_DATA ;
dkato 5:49a61433290a 137 face[i].dirYaw = STB_ERR_DIR_CANNOT ;
dkato 5:49a61433290a 138 face[i].dirRoll = STB_ERR_DIR_CANNOT ;
dkato 5:49a61433290a 139 face[i].dirPitch = STB_ERR_DIR_CANNOT ;
dkato 5:49a61433290a 140 }
dkato 5:49a61433290a 141 if( execFlg->bli == STB_TRUE )
dkato 5:49a61433290a 142 {
dkato 5:49a61433290a 143 face[i].bliL = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 144 face[i].bliR = STB_ERR_PE_CANNOT ;
dkato 5:49a61433290a 145 face[i].bliStatus = STB_STATUS_NO_DATA ;
dkato 5:49a61433290a 146 }
dkato 5:49a61433290a 147
dkato 5:49a61433290a 148 }
dkato 5:49a61433290a 149 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 150 /* SetFaceObject : Copy the tracking information */
dkato 5:49a61433290a 151 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 152 VOID SetFaceObject( const STB_FRAME_RESULT_FACES* stbINPUTfaces ,FaceObj *faces , const STBExecFlg *execFlg , const STB_INT32 nTraCntMax)
dkato 5:49a61433290a 153 {
dkato 5:49a61433290a 154 STB_INT32 nCount;
dkato 5:49a61433290a 155 STB_INT32 i,nIdx1;
dkato 5:49a61433290a 156
dkato 5:49a61433290a 157
dkato 5:49a61433290a 158 nCount = stbINPUTfaces->nCount;
dkato 5:49a61433290a 159
dkato 5:49a61433290a 160
dkato 5:49a61433290a 161 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 162 {
dkato 5:49a61433290a 163 faces[i].nDetID = i;
dkato 5:49a61433290a 164 faces[i].nTraID = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 165 }
dkato 5:49a61433290a 166
dkato 5:49a61433290a 167 if( execFlg->dir == STB_TRUE ) /*Face direction*/
dkato 5:49a61433290a 168 {
dkato 5:49a61433290a 169 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 170 {
dkato 5:49a61433290a 171 faces[i].dirConf = stbINPUTfaces->face[i].direction.nConfidence;
dkato 5:49a61433290a 172 faces[i].dirYaw = stbINPUTfaces->face[i].direction.nLR;
dkato 5:49a61433290a 173 faces[i].dirRoll = stbINPUTfaces->face[i].direction.nRoll;
dkato 5:49a61433290a 174 faces[i].dirPitch = stbINPUTfaces->face[i].direction.nUD;
dkato 5:49a61433290a 175 }
dkato 5:49a61433290a 176 }
dkato 5:49a61433290a 177 if( execFlg->age == STB_TRUE ) /*Age*/
dkato 5:49a61433290a 178 {
dkato 5:49a61433290a 179 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 180 {
dkato 5:49a61433290a 181 faces[i].ageConf = stbINPUTfaces->face[i].age.nConfidence;
dkato 5:49a61433290a 182 faces[i].ageStatus = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 183 faces[i].ageVal = stbINPUTfaces->face[i].age.nAge;
dkato 5:49a61433290a 184 }
dkato 5:49a61433290a 185 }
dkato 5:49a61433290a 186 if( execFlg->exp == STB_TRUE ) /*Facial expression*/
dkato 5:49a61433290a 187 {
dkato 5:49a61433290a 188 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 189 {
dkato 5:49a61433290a 190 faces[i].expConf = -1;// not degree
dkato 5:49a61433290a 191 for (nIdx1 = STB_EX_NEUTRAL; nIdx1 < STB_EX_MAX;nIdx1++)
dkato 5:49a61433290a 192 {
dkato 5:49a61433290a 193 faces[i].expScore[ nIdx1] = stbINPUTfaces->face[i].expression.anScore[nIdx1];
dkato 5:49a61433290a 194 }
dkato 5:49a61433290a 195 faces[i].expStatus = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 196 faces[i].expVal = STB_EX_UNKNOWN;
dkato 5:49a61433290a 197 }
dkato 5:49a61433290a 198 }
dkato 5:49a61433290a 199 if( execFlg->gen == STB_TRUE ) /*Gender*/
dkato 5:49a61433290a 200 {
dkato 5:49a61433290a 201 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 202 {
dkato 5:49a61433290a 203 faces[i].genConf = stbINPUTfaces->face[i].gender.nConfidence;
dkato 5:49a61433290a 204 faces[i].genStatus = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 205 faces[i].genVal = stbINPUTfaces->face[i].gender.nGender;
dkato 5:49a61433290a 206 }
dkato 5:49a61433290a 207 }
dkato 5:49a61433290a 208 if( execFlg->gaz == STB_TRUE ) /*Gaze*/
dkato 5:49a61433290a 209 {
dkato 5:49a61433290a 210 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 211 {
dkato 5:49a61433290a 212 faces[i].gazConf = stbINPUTfaces->face[i].direction.nConfidence;
dkato 5:49a61433290a 213 faces[i].gazStatus = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 214 faces[i].gazLR = stbINPUTfaces->face[i].gaze.nLR;
dkato 5:49a61433290a 215 faces[i].gazUD = stbINPUTfaces->face[i].gaze.nUD;
dkato 5:49a61433290a 216 }
dkato 5:49a61433290a 217 }
dkato 5:49a61433290a 218 if( execFlg->fr == STB_TRUE ) /*Face recognition*/
dkato 5:49a61433290a 219 {
dkato 5:49a61433290a 220 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 221 {
dkato 5:49a61433290a 222 faces[i].frConf = stbINPUTfaces->face[i].recognition.nScore;
dkato 5:49a61433290a 223 faces[i].frStatus = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 224 faces[i].frVal = stbINPUTfaces->face[i].recognition.nUID;
dkato 5:49a61433290a 225 }
dkato 5:49a61433290a 226 }
dkato 5:49a61433290a 227 if( execFlg->bli == STB_TRUE ) //blink
dkato 5:49a61433290a 228 {
dkato 5:49a61433290a 229 for (i = 0; i < nCount; i++)
dkato 5:49a61433290a 230 {
dkato 5:49a61433290a 231 faces[i].bliL = stbINPUTfaces->face[i].blink.nLeftEye;
dkato 5:49a61433290a 232 faces[i].bliR = stbINPUTfaces->face[i].blink.nRightEye;
dkato 5:49a61433290a 233 }
dkato 5:49a61433290a 234 }
dkato 5:49a61433290a 235
dkato 5:49a61433290a 236 /*The results exceeding the detection number are initialized*/
dkato 5:49a61433290a 237 for ( i = nCount; i < nTraCntMax; i++)
dkato 5:49a61433290a 238 {
dkato 5:49a61433290a 239 ClearFace ( faces , i , execFlg );
dkato 5:49a61433290a 240 }
dkato 5:49a61433290a 241
dkato 5:49a61433290a 242 }
dkato 5:49a61433290a 243
dkato 5:49a61433290a 244
dkato 5:49a61433290a 245 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 246 /* SetTrackingIDToFace : Tracking result ID is linked to face information */
dkato 5:49a61433290a 247 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 248 VOID SetTrackingIDToFace(STB_INT32 TrackingNum,STB_INT32 DetectNum, TraObj *track,FaceObj *faces , const STBExecFlg *execFlg )
dkato 5:49a61433290a 249 {
dkato 5:49a61433290a 250 STB_INT32 i,j;
dkato 5:49a61433290a 251
dkato 5:49a61433290a 252
dkato 5:49a61433290a 253 /*If there is a detection result erased in the tracking result, it is deleted from the face information.*/
dkato 5:49a61433290a 254 for( i = 0 ; i < DetectNum; i++)
dkato 5:49a61433290a 255 {
dkato 5:49a61433290a 256 /*termination if no more detected results*/
dkato 5:49a61433290a 257 if(faces[i].nDetID < 0)
dkato 5:49a61433290a 258 {
dkato 5:49a61433290a 259 break;
dkato 5:49a61433290a 260 }
dkato 5:49a61433290a 261
dkato 5:49a61433290a 262 /*Search for the same ID as the detection result from the tracking result*/
dkato 5:49a61433290a 263 for( j = 0; j < TrackingNum ; j++)
dkato 5:49a61433290a 264 {
dkato 5:49a61433290a 265 if(track[j].nDetID == faces[i].nDetID)
dkato 5:49a61433290a 266 {
dkato 5:49a61433290a 267 faces[i].nTraID = track[j].nTraID;
dkato 5:49a61433290a 268 break;
dkato 5:49a61433290a 269 }
dkato 5:49a61433290a 270 }
dkato 5:49a61433290a 271
dkato 5:49a61433290a 272 if( j >= TrackingNum){
dkato 5:49a61433290a 273 /*If the detection ID is not included in the ID under tracking*/
dkato 5:49a61433290a 274 ClearFace ( faces , i , execFlg);
dkato 5:49a61433290a 275 for(j = j + 1 ; j < DetectNum; j++)
dkato 5:49a61433290a 276 {
dkato 5:49a61433290a 277 if(faces[j].nDetID < 0)
dkato 5:49a61433290a 278 {
dkato 5:49a61433290a 279 /*Repeat until detection result disappears*/
dkato 5:49a61433290a 280 break;
dkato 5:49a61433290a 281 }
dkato 5:49a61433290a 282 /*Stuff up ahead of erasure*/
dkato 5:49a61433290a 283 CopyFace ( (faces+j),(faces+j-1), execFlg );
dkato 5:49a61433290a 284 }
dkato 5:49a61433290a 285 }
dkato 5:49a61433290a 286 }
dkato 5:49a61433290a 287 /*After that, the processing for the face only during tracking (retry status)*/
dkato 5:49a61433290a 288 for( j = 0 ; j < TrackingNum; j++)
dkato 5:49a61433290a 289 {
dkato 5:49a61433290a 290 if( track[j].nDetID < 0)
dkato 5:49a61433290a 291 {
dkato 5:49a61433290a 292 ClearFace ( faces , i , execFlg );/*It should have been cleared but just in case*/
dkato 5:49a61433290a 293 faces[i].nDetID = track[j].nDetID;
dkato 5:49a61433290a 294 faces[i].nTraID = track[j].nTraID;
dkato 5:49a61433290a 295 i++;
dkato 5:49a61433290a 296 }
dkato 5:49a61433290a 297 }
dkato 5:49a61433290a 298
dkato 5:49a61433290a 299 return;
dkato 5:49a61433290a 300 }
dkato 5:49a61433290a 301 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 302 /* SetFaceToPeInfo : Create input data for stabilization of property estimation from face information */
dkato 5:49a61433290a 303 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 304 VOID SetFaceToPeInfo(STB_INT32 TrackingNum,FaceObj *faces,STB_PE_DET *peInfo)
dkato 5:49a61433290a 305 {
dkato 5:49a61433290a 306 STB_INT32 nIdx,nIdx1;
dkato 5:49a61433290a 307
dkato 5:49a61433290a 308 peInfo->num = TrackingNum;
dkato 5:49a61433290a 309 for(nIdx=0 ; nIdx < TrackingNum;nIdx++)
dkato 5:49a61433290a 310 {
dkato 5:49a61433290a 311 /*tracking result*/
dkato 5:49a61433290a 312 peInfo->fcDet[nIdx].nDetID = faces[nIdx].nDetID ;
dkato 5:49a61433290a 313 peInfo->fcDet[nIdx].nTraID = faces[nIdx].nTraID ;
dkato 5:49a61433290a 314 /*Face direction estimation*/
dkato 5:49a61433290a 315 peInfo->fcDet[nIdx].dirDetConf = faces[nIdx].dirConf ;
dkato 5:49a61433290a 316 peInfo->fcDet[nIdx].dirDetYaw = faces[nIdx].dirYaw ;
dkato 5:49a61433290a 317 peInfo->fcDet[nIdx].dirDetPitch = faces[nIdx].dirPitch ;
dkato 5:49a61433290a 318 peInfo->fcDet[nIdx].dirDetRoll = faces[nIdx].dirRoll ;
dkato 5:49a61433290a 319 /*Age estimation*/
dkato 5:49a61433290a 320 peInfo->fcDet[nIdx].ageDetVal = faces[nIdx].ageVal ;
dkato 5:49a61433290a 321 peInfo->fcDet[nIdx].ageDetConf = faces[nIdx].ageConf ;
dkato 5:49a61433290a 322 /*Gaze estimation*/
dkato 5:49a61433290a 323 peInfo->fcDet[nIdx].gazDetLR = faces[nIdx].gazLR ;
dkato 5:49a61433290a 324 peInfo->fcDet[nIdx].gazDetUD = faces[nIdx].gazUD ;
dkato 5:49a61433290a 325 /*Gender estimation*/
dkato 5:49a61433290a 326 peInfo->fcDet[nIdx].genDetVal = faces[nIdx].genVal ;
dkato 5:49a61433290a 327 peInfo->fcDet[nIdx].genDetConf = faces[nIdx].genConf ;
dkato 5:49a61433290a 328 /*estimation of facial expression*/
dkato 5:49a61433290a 329 peInfo->fcDet[nIdx].expDetConf = faces[nIdx].expConf ;
dkato 5:49a61433290a 330 for( nIdx1 = 0; nIdx1 < STB_EX_MAX; nIdx1++)
dkato 5:49a61433290a 331 {
dkato 5:49a61433290a 332 peInfo->fcDet[nIdx].expDetVal[nIdx1] = faces[nIdx].expScore[nIdx1];
dkato 5:49a61433290a 333 }
dkato 5:49a61433290a 334 //blink
dkato 5:49a61433290a 335 peInfo->fcDet[nIdx].bliDetL = faces[nIdx].bliL ;
dkato 5:49a61433290a 336 peInfo->fcDet[nIdx].bliDetR = faces[nIdx].bliR ;
dkato 5:49a61433290a 337
dkato 5:49a61433290a 338
dkato 5:49a61433290a 339 }
dkato 5:49a61433290a 340 return;
dkato 5:49a61433290a 341 }
dkato 5:49a61433290a 342 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 343 /* SetFaceToFrInfo : Create input data for stabilization of face recognition from face information */
dkato 5:49a61433290a 344 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 345 VOID SetFaceToFrInfo(STB_INT32 TrackingNum,FaceObj *faces,STB_FR_DET *frInfo)
dkato 5:49a61433290a 346 {
dkato 5:49a61433290a 347 STB_INT32 nIdx;
dkato 5:49a61433290a 348
dkato 5:49a61433290a 349
dkato 5:49a61433290a 350 frInfo->num = TrackingNum;
dkato 5:49a61433290a 351 for(nIdx=0 ; nIdx < TrackingNum;nIdx++)
dkato 5:49a61433290a 352 {
dkato 5:49a61433290a 353 /*tracking result*/
dkato 5:49a61433290a 354 frInfo->fcDet[nIdx].nDetID = faces[nIdx].nDetID ;
dkato 5:49a61433290a 355 frInfo->fcDet[nIdx].nTraID = faces[nIdx].nTraID ;
dkato 5:49a61433290a 356
dkato 5:49a61433290a 357 /*Face direction estimation*/
dkato 5:49a61433290a 358 frInfo->fcDet[nIdx].dirDetConf = faces[nIdx].dirConf ;
dkato 5:49a61433290a 359 frInfo->fcDet[nIdx].dirDetYaw = faces[nIdx].dirYaw ;
dkato 5:49a61433290a 360 frInfo->fcDet[nIdx].dirDetPitch = faces[nIdx].dirPitch ;
dkato 5:49a61433290a 361 frInfo->fcDet[nIdx].dirDetRoll = faces[nIdx].dirRoll ;
dkato 5:49a61433290a 362
dkato 5:49a61433290a 363 /*recognition result*/
dkato 5:49a61433290a 364 frInfo->fcDet[nIdx].frDetConf = faces[nIdx].frConf ;
dkato 5:49a61433290a 365 frInfo->fcDet[nIdx].frDetID = faces[nIdx].frVal ;
dkato 5:49a61433290a 366
dkato 5:49a61433290a 367 }
dkato 5:49a61433290a 368 return;
dkato 5:49a61433290a 369 }
dkato 5:49a61433290a 370 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 371 /* SetPeInfoToFace : Copy stabilization result of property estimation to face information */
dkato 5:49a61433290a 372 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 373 VOID SetPeInfoToFace(STB_INT32 TrackingNum,STB_PE_RES *peInfo,FaceObj *faces, const STBExecFlg *execFlg )
dkato 5:49a61433290a 374 {
dkato 5:49a61433290a 375 STB_INT32 i,j;
dkato 5:49a61433290a 376
dkato 5:49a61433290a 377 for( i = 0 ; i < TrackingNum; i++)
dkato 5:49a61433290a 378 {
dkato 5:49a61433290a 379 for( j = 0 ; j < TrackingNum; j++)
dkato 5:49a61433290a 380 {
dkato 5:49a61433290a 381 if(peInfo->peFace[j].nTraID == faces[i].nTraID )
dkato 5:49a61433290a 382 {
dkato 5:49a61433290a 383 if( execFlg->gen == STB_TRUE )
dkato 5:49a61433290a 384 {
dkato 5:49a61433290a 385 faces[i].genStatus = peInfo->peFace[j].gen.status ;
dkato 5:49a61433290a 386 faces[i].genVal = peInfo->peFace[j].gen.value ;
dkato 5:49a61433290a 387 faces[i].genConf = peInfo->peFace[j].gen.conf ;
dkato 5:49a61433290a 388 }
dkato 5:49a61433290a 389 if( execFlg->age == STB_TRUE )
dkato 5:49a61433290a 390 {
dkato 5:49a61433290a 391 faces[i].ageStatus = peInfo->peFace[j].age.status ;
dkato 5:49a61433290a 392 faces[i].ageVal = peInfo->peFace[j].age.value ;
dkato 5:49a61433290a 393 faces[i].ageConf = peInfo->peFace[j].age.conf ;
dkato 5:49a61433290a 394 }
dkato 5:49a61433290a 395 if( execFlg->exp == STB_TRUE )
dkato 5:49a61433290a 396 {
dkato 5:49a61433290a 397 faces[i].expStatus = peInfo->peFace[j].exp.status ;
dkato 5:49a61433290a 398 faces[i].expVal = peInfo->peFace[j].exp.value ;
dkato 5:49a61433290a 399 faces[i].expConf = peInfo->peFace[j].exp.conf ;
dkato 5:49a61433290a 400 }
dkato 5:49a61433290a 401 if( execFlg->gaz == STB_TRUE )
dkato 5:49a61433290a 402 {
dkato 5:49a61433290a 403 faces[i].gazStatus = peInfo->peFace[j].gaz.status ;
dkato 5:49a61433290a 404 faces[i].gazConf = peInfo->peFace[j].gaz.conf ;
dkato 5:49a61433290a 405 faces[i].gazLR = peInfo->peFace[j].gaz.LR ;
dkato 5:49a61433290a 406 faces[i].gazUD = peInfo->peFace[j].gaz.UD ;
dkato 5:49a61433290a 407 }
dkato 5:49a61433290a 408 if( execFlg->dir == STB_TRUE )
dkato 5:49a61433290a 409 {
dkato 5:49a61433290a 410 faces[i].dirPitch = peInfo->peFace[j].dir.pitch ;
dkato 5:49a61433290a 411 faces[i].dirRoll = peInfo->peFace[j].dir.roll ;
dkato 5:49a61433290a 412 faces[i].dirYaw = peInfo->peFace[j].dir.yaw ;
dkato 5:49a61433290a 413 faces[i].dirStatus = peInfo->peFace[j].dir.status ;
dkato 5:49a61433290a 414 faces[i].dirConf = peInfo->peFace[j].dir.conf ;
dkato 5:49a61433290a 415 }
dkato 5:49a61433290a 416 if( execFlg->bli == STB_TRUE )
dkato 5:49a61433290a 417 {
dkato 5:49a61433290a 418 faces[i].bliL = peInfo->peFace[j].bli.ratioL ;
dkato 5:49a61433290a 419 faces[i].bliR = peInfo->peFace[j].bli.ratioR ;
dkato 5:49a61433290a 420 faces[i].bliStatus = peInfo->peFace[j].bli.status ;
dkato 5:49a61433290a 421 }
dkato 5:49a61433290a 422 break;
dkato 5:49a61433290a 423 }
dkato 5:49a61433290a 424 }
dkato 5:49a61433290a 425 }
dkato 5:49a61433290a 426
dkato 5:49a61433290a 427 return;
dkato 5:49a61433290a 428 }
dkato 5:49a61433290a 429 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 430 /* SetFrInfoToFace : Copy stabilization result of face recognition to face information */
dkato 5:49a61433290a 431 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 432 VOID SetFrInfoToFace(STB_INT32 TrackingNum,STB_FR_RES *frInfo,FaceObj *faces)
dkato 5:49a61433290a 433 {
dkato 5:49a61433290a 434 STB_INT32 i,j;
dkato 5:49a61433290a 435
dkato 5:49a61433290a 436 for( i = 0 ; i < TrackingNum; i++)
dkato 5:49a61433290a 437 {
dkato 5:49a61433290a 438 for( j = 0 ; j < TrackingNum; j++)
dkato 5:49a61433290a 439 {
dkato 5:49a61433290a 440 if(frInfo->frFace[j].nTraID == faces[i].nTraID)
dkato 5:49a61433290a 441 {
dkato 5:49a61433290a 442 faces[i].frStatus = frInfo->frFace[j].frRecog.status ;
dkato 5:49a61433290a 443 faces[i].frVal = frInfo->frFace[j].frRecog.value ;
dkato 5:49a61433290a 444 faces[i].frConf = frInfo->frFace[j].frRecog.conf ;
dkato 5:49a61433290a 445 break;
dkato 5:49a61433290a 446 }
dkato 5:49a61433290a 447 }
dkato 5:49a61433290a 448 }
dkato 5:49a61433290a 449 return;
dkato 5:49a61433290a 450 }