Sample to operate omron HVC-P2 on GR-PEACH.
Dependencies: AsciiFont
What is this ?
This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.
HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.
- SENSING EGG PROJECT > HVC-P2 (In Japanese)
https://plus-sensing.omron.co.jp/egg-project/product/hvc-p2/ - HVC-P2 (Human Vision Components B5T-007001)
http://www.omron.com/ecb/products/mobile/hvc_p2/ - OKAO Vision
https://plus-sensing.omron.com/technology/index.html
In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/
Constitution
- HVC-P2 x 1
- USBA-microUSB conversion cable x 2
- USBA-microUSB conversion adapter x 1
- GR-PEACH x 1
- 4.3inc LCD shield x 1
Please close JP3 of GR-PEACH.
How to use
It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.
- Function ON : orange or green
- Function OFF : blue or gray
Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.
Register Data (Face Recognition)
Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.
Change parameters
When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.
Change transfer image size
By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
HVC/STBLib/src/STB/STBFaceInfo.c@5:49a61433290a, 2017-09-05 (annotated)
- Committer:
- dkato
- Date:
- Tue Sep 05 10:01:51 2017 +0000
- Revision:
- 5:49a61433290a
Add HVC sensing result stabilizing library
Who changed what in which revision?
| User | Revision | Line number | New contents of line |
|---|---|---|---|
| dkato | 5:49a61433290a | 1 | /*---------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 2 | /* Copyright(C) 2017 OMRON Corporation */ |
| dkato | 5:49a61433290a | 3 | /* */ |
| dkato | 5:49a61433290a | 4 | /* Licensed under the Apache License, Version 2.0 (the "License"); */ |
| dkato | 5:49a61433290a | 5 | /* you may not use this file except in compliance with the License. */ |
| dkato | 5:49a61433290a | 6 | /* You may obtain a copy of the License at */ |
| dkato | 5:49a61433290a | 7 | /* */ |
| dkato | 5:49a61433290a | 8 | /* http://www.apache.org/licenses/LICENSE-2.0 */ |
| dkato | 5:49a61433290a | 9 | /* */ |
| dkato | 5:49a61433290a | 10 | /* Unless required by applicable law or agreed to in writing, software */ |
| dkato | 5:49a61433290a | 11 | /* distributed under the License is distributed on an "AS IS" BASIS, */ |
| dkato | 5:49a61433290a | 12 | /* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. */ |
| dkato | 5:49a61433290a | 13 | /* See the License for the specific language governing permissions and */ |
| dkato | 5:49a61433290a | 14 | /* limitations under the License. */ |
| dkato | 5:49a61433290a | 15 | /*---------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 16 | |
| dkato | 5:49a61433290a | 17 | #include "STBCommonDef.h" |
| dkato | 5:49a61433290a | 18 | #include "STBFaceInfo.h" |
| dkato | 5:49a61433290a | 19 | #include "STB_Debug.h" |
| dkato | 5:49a61433290a | 20 | #include "STBValidValue.h" |
| dkato | 5:49a61433290a | 21 | |
| dkato | 5:49a61433290a | 22 | |
| dkato | 5:49a61433290a | 23 | |
| dkato | 5:49a61433290a | 24 | |
| dkato | 5:49a61433290a | 25 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 26 | /*CopyFace : Face information all copy*/ |
| dkato | 5:49a61433290a | 27 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 28 | static VOID CopyFace(FaceObj *faceSrc,FaceObj *faceDst, const STBExecFlg *execFlg ) |
| dkato | 5:49a61433290a | 29 | { |
| dkato | 5:49a61433290a | 30 | |
| dkato | 5:49a61433290a | 31 | STB_INT32 j; |
| dkato | 5:49a61433290a | 32 | |
| dkato | 5:49a61433290a | 33 | faceDst->nDetID = faceSrc->nDetID ; |
| dkato | 5:49a61433290a | 34 | faceDst->nTraID = faceSrc->nTraID ; |
| dkato | 5:49a61433290a | 35 | if( execFlg->gen == STB_TRUE ) |
| dkato | 5:49a61433290a | 36 | { |
| dkato | 5:49a61433290a | 37 | faceDst->genConf = faceSrc->genConf ; |
| dkato | 5:49a61433290a | 38 | faceDst->genStatus = faceSrc->genStatus ; |
| dkato | 5:49a61433290a | 39 | faceDst->genVal = faceSrc->genVal ; |
| dkato | 5:49a61433290a | 40 | } |
| dkato | 5:49a61433290a | 41 | if( execFlg->age == STB_TRUE ) |
| dkato | 5:49a61433290a | 42 | { |
| dkato | 5:49a61433290a | 43 | faceDst->ageConf = faceSrc->ageConf ; |
| dkato | 5:49a61433290a | 44 | faceDst->ageStatus = faceSrc->ageStatus ; |
| dkato | 5:49a61433290a | 45 | faceDst->ageVal = faceSrc->ageVal ; |
| dkato | 5:49a61433290a | 46 | } |
| dkato | 5:49a61433290a | 47 | if( execFlg->fr == STB_TRUE ) |
| dkato | 5:49a61433290a | 48 | { |
| dkato | 5:49a61433290a | 49 | faceDst->frConf = faceSrc->frConf ; |
| dkato | 5:49a61433290a | 50 | faceDst->frStatus = faceSrc->frStatus ; |
| dkato | 5:49a61433290a | 51 | faceDst->frVal = faceSrc->frVal ; |
| dkato | 5:49a61433290a | 52 | } |
| dkato | 5:49a61433290a | 53 | if( execFlg->exp == STB_TRUE ) |
| dkato | 5:49a61433290a | 54 | { |
| dkato | 5:49a61433290a | 55 | faceDst->expConf = faceSrc->expConf ; |
| dkato | 5:49a61433290a | 56 | faceDst->expStatus = faceSrc->expStatus ; |
| dkato | 5:49a61433290a | 57 | faceDst->expVal = faceSrc->expVal ; |
| dkato | 5:49a61433290a | 58 | for( j = 0 ; j < STB_EX_MAX ;j++) |
| dkato | 5:49a61433290a | 59 | { |
| dkato | 5:49a61433290a | 60 | faceDst->expScore[j] = faceSrc->expScore[j]; |
| dkato | 5:49a61433290a | 61 | } |
| dkato | 5:49a61433290a | 62 | } |
| dkato | 5:49a61433290a | 63 | if( execFlg->gaz == STB_TRUE ) |
| dkato | 5:49a61433290a | 64 | { |
| dkato | 5:49a61433290a | 65 | faceDst->gazConf = faceSrc->gazConf ; |
| dkato | 5:49a61433290a | 66 | faceDst->gazStatus = faceSrc->gazStatus ; |
| dkato | 5:49a61433290a | 67 | faceDst->gazLR = faceSrc->gazLR ; |
| dkato | 5:49a61433290a | 68 | faceDst->gazUD = faceSrc->gazUD ; |
| dkato | 5:49a61433290a | 69 | } |
| dkato | 5:49a61433290a | 70 | if( execFlg->dir == STB_TRUE ) |
| dkato | 5:49a61433290a | 71 | { |
| dkato | 5:49a61433290a | 72 | faceDst->dirConf = faceSrc->dirConf ; |
| dkato | 5:49a61433290a | 73 | faceDst->dirYaw = faceSrc->dirYaw ; |
| dkato | 5:49a61433290a | 74 | faceDst->dirRoll = faceSrc->dirRoll ; |
| dkato | 5:49a61433290a | 75 | faceDst->dirPitch = faceSrc->dirPitch ; |
| dkato | 5:49a61433290a | 76 | faceDst->dirStatus = faceSrc->dirStatus ; |
| dkato | 5:49a61433290a | 77 | } |
| dkato | 5:49a61433290a | 78 | if( execFlg->bli == STB_TRUE ) |
| dkato | 5:49a61433290a | 79 | { |
| dkato | 5:49a61433290a | 80 | faceDst->bliL = faceSrc->bliL ; |
| dkato | 5:49a61433290a | 81 | faceDst->bliR = faceSrc->bliR ; |
| dkato | 5:49a61433290a | 82 | faceDst->bliStatus = faceSrc->bliStatus ; |
| dkato | 5:49a61433290a | 83 | } |
| dkato | 5:49a61433290a | 84 | |
| dkato | 5:49a61433290a | 85 | |
| dkato | 5:49a61433290a | 86 | |
| dkato | 5:49a61433290a | 87 | } |
| dkato | 5:49a61433290a | 88 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 89 | /* ClearFace */ |
| dkato | 5:49a61433290a | 90 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 91 | static VOID ClearFace ( FaceObj *face , int i , const STBExecFlg *execFlg ) |
| dkato | 5:49a61433290a | 92 | { |
| dkato | 5:49a61433290a | 93 | STB_INT32 j; |
| dkato | 5:49a61433290a | 94 | |
| dkato | 5:49a61433290a | 95 | face[i].nDetID = -1 ; |
| dkato | 5:49a61433290a | 96 | face[i].nTraID = -1 ; |
| dkato | 5:49a61433290a | 97 | |
| dkato | 5:49a61433290a | 98 | if( execFlg->gen == STB_TRUE ) |
| dkato | 5:49a61433290a | 99 | { |
| dkato | 5:49a61433290a | 100 | face[i].genConf = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 101 | face[i].genStatus = STB_STATUS_NO_DATA ; |
| dkato | 5:49a61433290a | 102 | face[i].genVal = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 103 | } |
| dkato | 5:49a61433290a | 104 | if( execFlg->age == STB_TRUE ) |
| dkato | 5:49a61433290a | 105 | { |
| dkato | 5:49a61433290a | 106 | face[i].ageConf = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 107 | face[i].ageStatus = STB_STATUS_NO_DATA ; |
| dkato | 5:49a61433290a | 108 | face[i].ageVal = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 109 | } |
| dkato | 5:49a61433290a | 110 | if( execFlg->fr == STB_TRUE ) |
| dkato | 5:49a61433290a | 111 | { |
| dkato | 5:49a61433290a | 112 | face[i].frConf = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 113 | face[i].frStatus = STB_STATUS_NO_DATA ; |
| dkato | 5:49a61433290a | 114 | face[i].frVal = STB_ERR_FR_CANNOT ; |
| dkato | 5:49a61433290a | 115 | } |
| dkato | 5:49a61433290a | 116 | if( execFlg->exp == STB_TRUE ) |
| dkato | 5:49a61433290a | 117 | { |
| dkato | 5:49a61433290a | 118 | face[i].expConf = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 119 | for (j = STB_EX_NEUTRAL; j < STB_EX_MAX;j++) |
| dkato | 5:49a61433290a | 120 | { |
| dkato | 5:49a61433290a | 121 | face[i].expScore[j] = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 122 | } |
| dkato | 5:49a61433290a | 123 | face[i].expStatus = STB_STATUS_NO_DATA ; |
| dkato | 5:49a61433290a | 124 | face[i].expVal = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 125 | } |
| dkato | 5:49a61433290a | 126 | if( execFlg->gaz == STB_TRUE ) |
| dkato | 5:49a61433290a | 127 | { |
| dkato | 5:49a61433290a | 128 | face[i].gazConf = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 129 | face[i].gazStatus = STB_STATUS_NO_DATA ; |
| dkato | 5:49a61433290a | 130 | face[i].gazLR = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 131 | face[i].gazUD = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 132 | } |
| dkato | 5:49a61433290a | 133 | if( execFlg->dir == STB_TRUE ) |
| dkato | 5:49a61433290a | 134 | { |
| dkato | 5:49a61433290a | 135 | face[i].dirConf = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 136 | face[i].dirStatus = STB_STATUS_NO_DATA ; |
| dkato | 5:49a61433290a | 137 | face[i].dirYaw = STB_ERR_DIR_CANNOT ; |
| dkato | 5:49a61433290a | 138 | face[i].dirRoll = STB_ERR_DIR_CANNOT ; |
| dkato | 5:49a61433290a | 139 | face[i].dirPitch = STB_ERR_DIR_CANNOT ; |
| dkato | 5:49a61433290a | 140 | } |
| dkato | 5:49a61433290a | 141 | if( execFlg->bli == STB_TRUE ) |
| dkato | 5:49a61433290a | 142 | { |
| dkato | 5:49a61433290a | 143 | face[i].bliL = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 144 | face[i].bliR = STB_ERR_PE_CANNOT ; |
| dkato | 5:49a61433290a | 145 | face[i].bliStatus = STB_STATUS_NO_DATA ; |
| dkato | 5:49a61433290a | 146 | } |
| dkato | 5:49a61433290a | 147 | |
| dkato | 5:49a61433290a | 148 | } |
| dkato | 5:49a61433290a | 149 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 150 | /* SetFaceObject : Copy the tracking information */ |
| dkato | 5:49a61433290a | 151 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 152 | VOID SetFaceObject( const STB_FRAME_RESULT_FACES* stbINPUTfaces ,FaceObj *faces , const STBExecFlg *execFlg , const STB_INT32 nTraCntMax) |
| dkato | 5:49a61433290a | 153 | { |
| dkato | 5:49a61433290a | 154 | STB_INT32 nCount; |
| dkato | 5:49a61433290a | 155 | STB_INT32 i,nIdx1; |
| dkato | 5:49a61433290a | 156 | |
| dkato | 5:49a61433290a | 157 | |
| dkato | 5:49a61433290a | 158 | nCount = stbINPUTfaces->nCount; |
| dkato | 5:49a61433290a | 159 | |
| dkato | 5:49a61433290a | 160 | |
| dkato | 5:49a61433290a | 161 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 162 | { |
| dkato | 5:49a61433290a | 163 | faces[i].nDetID = i; |
| dkato | 5:49a61433290a | 164 | faces[i].nTraID = STB_STATUS_NO_DATA; |
| dkato | 5:49a61433290a | 165 | } |
| dkato | 5:49a61433290a | 166 | |
| dkato | 5:49a61433290a | 167 | if( execFlg->dir == STB_TRUE ) /*Face direction*/ |
| dkato | 5:49a61433290a | 168 | { |
| dkato | 5:49a61433290a | 169 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 170 | { |
| dkato | 5:49a61433290a | 171 | faces[i].dirConf = stbINPUTfaces->face[i].direction.nConfidence; |
| dkato | 5:49a61433290a | 172 | faces[i].dirYaw = stbINPUTfaces->face[i].direction.nLR; |
| dkato | 5:49a61433290a | 173 | faces[i].dirRoll = stbINPUTfaces->face[i].direction.nRoll; |
| dkato | 5:49a61433290a | 174 | faces[i].dirPitch = stbINPUTfaces->face[i].direction.nUD; |
| dkato | 5:49a61433290a | 175 | } |
| dkato | 5:49a61433290a | 176 | } |
| dkato | 5:49a61433290a | 177 | if( execFlg->age == STB_TRUE ) /*Age*/ |
| dkato | 5:49a61433290a | 178 | { |
| dkato | 5:49a61433290a | 179 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 180 | { |
| dkato | 5:49a61433290a | 181 | faces[i].ageConf = stbINPUTfaces->face[i].age.nConfidence; |
| dkato | 5:49a61433290a | 182 | faces[i].ageStatus = STB_STATUS_NO_DATA; |
| dkato | 5:49a61433290a | 183 | faces[i].ageVal = stbINPUTfaces->face[i].age.nAge; |
| dkato | 5:49a61433290a | 184 | } |
| dkato | 5:49a61433290a | 185 | } |
| dkato | 5:49a61433290a | 186 | if( execFlg->exp == STB_TRUE ) /*Facial expression*/ |
| dkato | 5:49a61433290a | 187 | { |
| dkato | 5:49a61433290a | 188 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 189 | { |
| dkato | 5:49a61433290a | 190 | faces[i].expConf = -1;// not degree |
| dkato | 5:49a61433290a | 191 | for (nIdx1 = STB_EX_NEUTRAL; nIdx1 < STB_EX_MAX;nIdx1++) |
| dkato | 5:49a61433290a | 192 | { |
| dkato | 5:49a61433290a | 193 | faces[i].expScore[ nIdx1] = stbINPUTfaces->face[i].expression.anScore[nIdx1]; |
| dkato | 5:49a61433290a | 194 | } |
| dkato | 5:49a61433290a | 195 | faces[i].expStatus = STB_STATUS_NO_DATA; |
| dkato | 5:49a61433290a | 196 | faces[i].expVal = STB_EX_UNKNOWN; |
| dkato | 5:49a61433290a | 197 | } |
| dkato | 5:49a61433290a | 198 | } |
| dkato | 5:49a61433290a | 199 | if( execFlg->gen == STB_TRUE ) /*Gender*/ |
| dkato | 5:49a61433290a | 200 | { |
| dkato | 5:49a61433290a | 201 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 202 | { |
| dkato | 5:49a61433290a | 203 | faces[i].genConf = stbINPUTfaces->face[i].gender.nConfidence; |
| dkato | 5:49a61433290a | 204 | faces[i].genStatus = STB_STATUS_NO_DATA; |
| dkato | 5:49a61433290a | 205 | faces[i].genVal = stbINPUTfaces->face[i].gender.nGender; |
| dkato | 5:49a61433290a | 206 | } |
| dkato | 5:49a61433290a | 207 | } |
| dkato | 5:49a61433290a | 208 | if( execFlg->gaz == STB_TRUE ) /*Gaze*/ |
| dkato | 5:49a61433290a | 209 | { |
| dkato | 5:49a61433290a | 210 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 211 | { |
| dkato | 5:49a61433290a | 212 | faces[i].gazConf = stbINPUTfaces->face[i].direction.nConfidence; |
| dkato | 5:49a61433290a | 213 | faces[i].gazStatus = STB_STATUS_NO_DATA; |
| dkato | 5:49a61433290a | 214 | faces[i].gazLR = stbINPUTfaces->face[i].gaze.nLR; |
| dkato | 5:49a61433290a | 215 | faces[i].gazUD = stbINPUTfaces->face[i].gaze.nUD; |
| dkato | 5:49a61433290a | 216 | } |
| dkato | 5:49a61433290a | 217 | } |
| dkato | 5:49a61433290a | 218 | if( execFlg->fr == STB_TRUE ) /*Face recognition*/ |
| dkato | 5:49a61433290a | 219 | { |
| dkato | 5:49a61433290a | 220 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 221 | { |
| dkato | 5:49a61433290a | 222 | faces[i].frConf = stbINPUTfaces->face[i].recognition.nScore; |
| dkato | 5:49a61433290a | 223 | faces[i].frStatus = STB_STATUS_NO_DATA; |
| dkato | 5:49a61433290a | 224 | faces[i].frVal = stbINPUTfaces->face[i].recognition.nUID; |
| dkato | 5:49a61433290a | 225 | } |
| dkato | 5:49a61433290a | 226 | } |
| dkato | 5:49a61433290a | 227 | if( execFlg->bli == STB_TRUE ) //blink |
| dkato | 5:49a61433290a | 228 | { |
| dkato | 5:49a61433290a | 229 | for (i = 0; i < nCount; i++) |
| dkato | 5:49a61433290a | 230 | { |
| dkato | 5:49a61433290a | 231 | faces[i].bliL = stbINPUTfaces->face[i].blink.nLeftEye; |
| dkato | 5:49a61433290a | 232 | faces[i].bliR = stbINPUTfaces->face[i].blink.nRightEye; |
| dkato | 5:49a61433290a | 233 | } |
| dkato | 5:49a61433290a | 234 | } |
| dkato | 5:49a61433290a | 235 | |
| dkato | 5:49a61433290a | 236 | /*The results exceeding the detection number are initialized*/ |
| dkato | 5:49a61433290a | 237 | for ( i = nCount; i < nTraCntMax; i++) |
| dkato | 5:49a61433290a | 238 | { |
| dkato | 5:49a61433290a | 239 | ClearFace ( faces , i , execFlg ); |
| dkato | 5:49a61433290a | 240 | } |
| dkato | 5:49a61433290a | 241 | |
| dkato | 5:49a61433290a | 242 | } |
| dkato | 5:49a61433290a | 243 | |
| dkato | 5:49a61433290a | 244 | |
| dkato | 5:49a61433290a | 245 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 246 | /* SetTrackingIDToFace : Tracking result ID is linked to face information */ |
| dkato | 5:49a61433290a | 247 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 248 | VOID SetTrackingIDToFace(STB_INT32 TrackingNum,STB_INT32 DetectNum, TraObj *track,FaceObj *faces , const STBExecFlg *execFlg ) |
| dkato | 5:49a61433290a | 249 | { |
| dkato | 5:49a61433290a | 250 | STB_INT32 i,j; |
| dkato | 5:49a61433290a | 251 | |
| dkato | 5:49a61433290a | 252 | |
| dkato | 5:49a61433290a | 253 | /*If there is a detection result erased in the tracking result, it is deleted from the face information.*/ |
| dkato | 5:49a61433290a | 254 | for( i = 0 ; i < DetectNum; i++) |
| dkato | 5:49a61433290a | 255 | { |
| dkato | 5:49a61433290a | 256 | /*termination if no more detected results*/ |
| dkato | 5:49a61433290a | 257 | if(faces[i].nDetID < 0) |
| dkato | 5:49a61433290a | 258 | { |
| dkato | 5:49a61433290a | 259 | break; |
| dkato | 5:49a61433290a | 260 | } |
| dkato | 5:49a61433290a | 261 | |
| dkato | 5:49a61433290a | 262 | /*Search for the same ID as the detection result from the tracking result*/ |
| dkato | 5:49a61433290a | 263 | for( j = 0; j < TrackingNum ; j++) |
| dkato | 5:49a61433290a | 264 | { |
| dkato | 5:49a61433290a | 265 | if(track[j].nDetID == faces[i].nDetID) |
| dkato | 5:49a61433290a | 266 | { |
| dkato | 5:49a61433290a | 267 | faces[i].nTraID = track[j].nTraID; |
| dkato | 5:49a61433290a | 268 | break; |
| dkato | 5:49a61433290a | 269 | } |
| dkato | 5:49a61433290a | 270 | } |
| dkato | 5:49a61433290a | 271 | |
| dkato | 5:49a61433290a | 272 | if( j >= TrackingNum){ |
| dkato | 5:49a61433290a | 273 | /*If the detection ID is not included in the ID under tracking*/ |
| dkato | 5:49a61433290a | 274 | ClearFace ( faces , i , execFlg); |
| dkato | 5:49a61433290a | 275 | for(j = j + 1 ; j < DetectNum; j++) |
| dkato | 5:49a61433290a | 276 | { |
| dkato | 5:49a61433290a | 277 | if(faces[j].nDetID < 0) |
| dkato | 5:49a61433290a | 278 | { |
| dkato | 5:49a61433290a | 279 | /*Repeat until detection result disappears*/ |
| dkato | 5:49a61433290a | 280 | break; |
| dkato | 5:49a61433290a | 281 | } |
| dkato | 5:49a61433290a | 282 | /*Stuff up ahead of erasure*/ |
| dkato | 5:49a61433290a | 283 | CopyFace ( (faces+j),(faces+j-1), execFlg ); |
| dkato | 5:49a61433290a | 284 | } |
| dkato | 5:49a61433290a | 285 | } |
| dkato | 5:49a61433290a | 286 | } |
| dkato | 5:49a61433290a | 287 | /*After that, the processing for the face only during tracking (retry status)*/ |
| dkato | 5:49a61433290a | 288 | for( j = 0 ; j < TrackingNum; j++) |
| dkato | 5:49a61433290a | 289 | { |
| dkato | 5:49a61433290a | 290 | if( track[j].nDetID < 0) |
| dkato | 5:49a61433290a | 291 | { |
| dkato | 5:49a61433290a | 292 | ClearFace ( faces , i , execFlg );/*It should have been cleared but just in case*/ |
| dkato | 5:49a61433290a | 293 | faces[i].nDetID = track[j].nDetID; |
| dkato | 5:49a61433290a | 294 | faces[i].nTraID = track[j].nTraID; |
| dkato | 5:49a61433290a | 295 | i++; |
| dkato | 5:49a61433290a | 296 | } |
| dkato | 5:49a61433290a | 297 | } |
| dkato | 5:49a61433290a | 298 | |
| dkato | 5:49a61433290a | 299 | return; |
| dkato | 5:49a61433290a | 300 | } |
| dkato | 5:49a61433290a | 301 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 302 | /* SetFaceToPeInfo : Create input data for stabilization of property estimation from face information */ |
| dkato | 5:49a61433290a | 303 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 304 | VOID SetFaceToPeInfo(STB_INT32 TrackingNum,FaceObj *faces,STB_PE_DET *peInfo) |
| dkato | 5:49a61433290a | 305 | { |
| dkato | 5:49a61433290a | 306 | STB_INT32 nIdx,nIdx1; |
| dkato | 5:49a61433290a | 307 | |
| dkato | 5:49a61433290a | 308 | peInfo->num = TrackingNum; |
| dkato | 5:49a61433290a | 309 | for(nIdx=0 ; nIdx < TrackingNum;nIdx++) |
| dkato | 5:49a61433290a | 310 | { |
| dkato | 5:49a61433290a | 311 | /*tracking result*/ |
| dkato | 5:49a61433290a | 312 | peInfo->fcDet[nIdx].nDetID = faces[nIdx].nDetID ; |
| dkato | 5:49a61433290a | 313 | peInfo->fcDet[nIdx].nTraID = faces[nIdx].nTraID ; |
| dkato | 5:49a61433290a | 314 | /*Face direction estimation*/ |
| dkato | 5:49a61433290a | 315 | peInfo->fcDet[nIdx].dirDetConf = faces[nIdx].dirConf ; |
| dkato | 5:49a61433290a | 316 | peInfo->fcDet[nIdx].dirDetYaw = faces[nIdx].dirYaw ; |
| dkato | 5:49a61433290a | 317 | peInfo->fcDet[nIdx].dirDetPitch = faces[nIdx].dirPitch ; |
| dkato | 5:49a61433290a | 318 | peInfo->fcDet[nIdx].dirDetRoll = faces[nIdx].dirRoll ; |
| dkato | 5:49a61433290a | 319 | /*Age estimation*/ |
| dkato | 5:49a61433290a | 320 | peInfo->fcDet[nIdx].ageDetVal = faces[nIdx].ageVal ; |
| dkato | 5:49a61433290a | 321 | peInfo->fcDet[nIdx].ageDetConf = faces[nIdx].ageConf ; |
| dkato | 5:49a61433290a | 322 | /*Gaze estimation*/ |
| dkato | 5:49a61433290a | 323 | peInfo->fcDet[nIdx].gazDetLR = faces[nIdx].gazLR ; |
| dkato | 5:49a61433290a | 324 | peInfo->fcDet[nIdx].gazDetUD = faces[nIdx].gazUD ; |
| dkato | 5:49a61433290a | 325 | /*Gender estimation*/ |
| dkato | 5:49a61433290a | 326 | peInfo->fcDet[nIdx].genDetVal = faces[nIdx].genVal ; |
| dkato | 5:49a61433290a | 327 | peInfo->fcDet[nIdx].genDetConf = faces[nIdx].genConf ; |
| dkato | 5:49a61433290a | 328 | /*estimation of facial expression*/ |
| dkato | 5:49a61433290a | 329 | peInfo->fcDet[nIdx].expDetConf = faces[nIdx].expConf ; |
| dkato | 5:49a61433290a | 330 | for( nIdx1 = 0; nIdx1 < STB_EX_MAX; nIdx1++) |
| dkato | 5:49a61433290a | 331 | { |
| dkato | 5:49a61433290a | 332 | peInfo->fcDet[nIdx].expDetVal[nIdx1] = faces[nIdx].expScore[nIdx1]; |
| dkato | 5:49a61433290a | 333 | } |
| dkato | 5:49a61433290a | 334 | //blink |
| dkato | 5:49a61433290a | 335 | peInfo->fcDet[nIdx].bliDetL = faces[nIdx].bliL ; |
| dkato | 5:49a61433290a | 336 | peInfo->fcDet[nIdx].bliDetR = faces[nIdx].bliR ; |
| dkato | 5:49a61433290a | 337 | |
| dkato | 5:49a61433290a | 338 | |
| dkato | 5:49a61433290a | 339 | } |
| dkato | 5:49a61433290a | 340 | return; |
| dkato | 5:49a61433290a | 341 | } |
| dkato | 5:49a61433290a | 342 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 343 | /* SetFaceToFrInfo : Create input data for stabilization of face recognition from face information */ |
| dkato | 5:49a61433290a | 344 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 345 | VOID SetFaceToFrInfo(STB_INT32 TrackingNum,FaceObj *faces,STB_FR_DET *frInfo) |
| dkato | 5:49a61433290a | 346 | { |
| dkato | 5:49a61433290a | 347 | STB_INT32 nIdx; |
| dkato | 5:49a61433290a | 348 | |
| dkato | 5:49a61433290a | 349 | |
| dkato | 5:49a61433290a | 350 | frInfo->num = TrackingNum; |
| dkato | 5:49a61433290a | 351 | for(nIdx=0 ; nIdx < TrackingNum;nIdx++) |
| dkato | 5:49a61433290a | 352 | { |
| dkato | 5:49a61433290a | 353 | /*tracking result*/ |
| dkato | 5:49a61433290a | 354 | frInfo->fcDet[nIdx].nDetID = faces[nIdx].nDetID ; |
| dkato | 5:49a61433290a | 355 | frInfo->fcDet[nIdx].nTraID = faces[nIdx].nTraID ; |
| dkato | 5:49a61433290a | 356 | |
| dkato | 5:49a61433290a | 357 | /*Face direction estimation*/ |
| dkato | 5:49a61433290a | 358 | frInfo->fcDet[nIdx].dirDetConf = faces[nIdx].dirConf ; |
| dkato | 5:49a61433290a | 359 | frInfo->fcDet[nIdx].dirDetYaw = faces[nIdx].dirYaw ; |
| dkato | 5:49a61433290a | 360 | frInfo->fcDet[nIdx].dirDetPitch = faces[nIdx].dirPitch ; |
| dkato | 5:49a61433290a | 361 | frInfo->fcDet[nIdx].dirDetRoll = faces[nIdx].dirRoll ; |
| dkato | 5:49a61433290a | 362 | |
| dkato | 5:49a61433290a | 363 | /*recognition result*/ |
| dkato | 5:49a61433290a | 364 | frInfo->fcDet[nIdx].frDetConf = faces[nIdx].frConf ; |
| dkato | 5:49a61433290a | 365 | frInfo->fcDet[nIdx].frDetID = faces[nIdx].frVal ; |
| dkato | 5:49a61433290a | 366 | |
| dkato | 5:49a61433290a | 367 | } |
| dkato | 5:49a61433290a | 368 | return; |
| dkato | 5:49a61433290a | 369 | } |
| dkato | 5:49a61433290a | 370 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 371 | /* SetPeInfoToFace : Copy stabilization result of property estimation to face information */ |
| dkato | 5:49a61433290a | 372 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 373 | VOID SetPeInfoToFace(STB_INT32 TrackingNum,STB_PE_RES *peInfo,FaceObj *faces, const STBExecFlg *execFlg ) |
| dkato | 5:49a61433290a | 374 | { |
| dkato | 5:49a61433290a | 375 | STB_INT32 i,j; |
| dkato | 5:49a61433290a | 376 | |
| dkato | 5:49a61433290a | 377 | for( i = 0 ; i < TrackingNum; i++) |
| dkato | 5:49a61433290a | 378 | { |
| dkato | 5:49a61433290a | 379 | for( j = 0 ; j < TrackingNum; j++) |
| dkato | 5:49a61433290a | 380 | { |
| dkato | 5:49a61433290a | 381 | if(peInfo->peFace[j].nTraID == faces[i].nTraID ) |
| dkato | 5:49a61433290a | 382 | { |
| dkato | 5:49a61433290a | 383 | if( execFlg->gen == STB_TRUE ) |
| dkato | 5:49a61433290a | 384 | { |
| dkato | 5:49a61433290a | 385 | faces[i].genStatus = peInfo->peFace[j].gen.status ; |
| dkato | 5:49a61433290a | 386 | faces[i].genVal = peInfo->peFace[j].gen.value ; |
| dkato | 5:49a61433290a | 387 | faces[i].genConf = peInfo->peFace[j].gen.conf ; |
| dkato | 5:49a61433290a | 388 | } |
| dkato | 5:49a61433290a | 389 | if( execFlg->age == STB_TRUE ) |
| dkato | 5:49a61433290a | 390 | { |
| dkato | 5:49a61433290a | 391 | faces[i].ageStatus = peInfo->peFace[j].age.status ; |
| dkato | 5:49a61433290a | 392 | faces[i].ageVal = peInfo->peFace[j].age.value ; |
| dkato | 5:49a61433290a | 393 | faces[i].ageConf = peInfo->peFace[j].age.conf ; |
| dkato | 5:49a61433290a | 394 | } |
| dkato | 5:49a61433290a | 395 | if( execFlg->exp == STB_TRUE ) |
| dkato | 5:49a61433290a | 396 | { |
| dkato | 5:49a61433290a | 397 | faces[i].expStatus = peInfo->peFace[j].exp.status ; |
| dkato | 5:49a61433290a | 398 | faces[i].expVal = peInfo->peFace[j].exp.value ; |
| dkato | 5:49a61433290a | 399 | faces[i].expConf = peInfo->peFace[j].exp.conf ; |
| dkato | 5:49a61433290a | 400 | } |
| dkato | 5:49a61433290a | 401 | if( execFlg->gaz == STB_TRUE ) |
| dkato | 5:49a61433290a | 402 | { |
| dkato | 5:49a61433290a | 403 | faces[i].gazStatus = peInfo->peFace[j].gaz.status ; |
| dkato | 5:49a61433290a | 404 | faces[i].gazConf = peInfo->peFace[j].gaz.conf ; |
| dkato | 5:49a61433290a | 405 | faces[i].gazLR = peInfo->peFace[j].gaz.LR ; |
| dkato | 5:49a61433290a | 406 | faces[i].gazUD = peInfo->peFace[j].gaz.UD ; |
| dkato | 5:49a61433290a | 407 | } |
| dkato | 5:49a61433290a | 408 | if( execFlg->dir == STB_TRUE ) |
| dkato | 5:49a61433290a | 409 | { |
| dkato | 5:49a61433290a | 410 | faces[i].dirPitch = peInfo->peFace[j].dir.pitch ; |
| dkato | 5:49a61433290a | 411 | faces[i].dirRoll = peInfo->peFace[j].dir.roll ; |
| dkato | 5:49a61433290a | 412 | faces[i].dirYaw = peInfo->peFace[j].dir.yaw ; |
| dkato | 5:49a61433290a | 413 | faces[i].dirStatus = peInfo->peFace[j].dir.status ; |
| dkato | 5:49a61433290a | 414 | faces[i].dirConf = peInfo->peFace[j].dir.conf ; |
| dkato | 5:49a61433290a | 415 | } |
| dkato | 5:49a61433290a | 416 | if( execFlg->bli == STB_TRUE ) |
| dkato | 5:49a61433290a | 417 | { |
| dkato | 5:49a61433290a | 418 | faces[i].bliL = peInfo->peFace[j].bli.ratioL ; |
| dkato | 5:49a61433290a | 419 | faces[i].bliR = peInfo->peFace[j].bli.ratioR ; |
| dkato | 5:49a61433290a | 420 | faces[i].bliStatus = peInfo->peFace[j].bli.status ; |
| dkato | 5:49a61433290a | 421 | } |
| dkato | 5:49a61433290a | 422 | break; |
| dkato | 5:49a61433290a | 423 | } |
| dkato | 5:49a61433290a | 424 | } |
| dkato | 5:49a61433290a | 425 | } |
| dkato | 5:49a61433290a | 426 | |
| dkato | 5:49a61433290a | 427 | return; |
| dkato | 5:49a61433290a | 428 | } |
| dkato | 5:49a61433290a | 429 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 430 | /* SetFrInfoToFace : Copy stabilization result of face recognition to face information */ |
| dkato | 5:49a61433290a | 431 | /*------------------------------------------------------------------------------------------------------------------*/ |
| dkato | 5:49a61433290a | 432 | VOID SetFrInfoToFace(STB_INT32 TrackingNum,STB_FR_RES *frInfo,FaceObj *faces) |
| dkato | 5:49a61433290a | 433 | { |
| dkato | 5:49a61433290a | 434 | STB_INT32 i,j; |
| dkato | 5:49a61433290a | 435 | |
| dkato | 5:49a61433290a | 436 | for( i = 0 ; i < TrackingNum; i++) |
| dkato | 5:49a61433290a | 437 | { |
| dkato | 5:49a61433290a | 438 | for( j = 0 ; j < TrackingNum; j++) |
| dkato | 5:49a61433290a | 439 | { |
| dkato | 5:49a61433290a | 440 | if(frInfo->frFace[j].nTraID == faces[i].nTraID) |
| dkato | 5:49a61433290a | 441 | { |
| dkato | 5:49a61433290a | 442 | faces[i].frStatus = frInfo->frFace[j].frRecog.status ; |
| dkato | 5:49a61433290a | 443 | faces[i].frVal = frInfo->frFace[j].frRecog.value ; |
| dkato | 5:49a61433290a | 444 | faces[i].frConf = frInfo->frFace[j].frRecog.conf ; |
| dkato | 5:49a61433290a | 445 | break; |
| dkato | 5:49a61433290a | 446 | } |
| dkato | 5:49a61433290a | 447 | } |
| dkato | 5:49a61433290a | 448 | } |
| dkato | 5:49a61433290a | 449 | return; |
| dkato | 5:49a61433290a | 450 | } |