Renesas / Mbed OS GR-PEACH_HVC-P2_sample

Sample to operate omron HVC-P2 on GR-PEACH.

Dependencies:   AsciiFont

Information

Please see here for Japanese version.
日本語版はこちらを参照ください。

What is this ?

This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.

/media/uploads/dkato/hvcp2_demo_img3.jpg

HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.

In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/

Constitution

  1. HVC-P2 x 1
  2. USBA-microUSB conversion cable x 2
  3. USBA-microUSB conversion adapter x 1
  4. GR-PEACH x 1
  5. 4.3inc LCD shield x 1

/media/uploads/dkato/composition_hvcp2_demo.jpg

/media/uploads/dkato/composition_hvcp2_demo_2.jpg

Please close JP3 of GR-PEACH.
/media/uploads/RyoheiHagimoto/usb.jpg

How to use

It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.

  • Function ON : orange or green
  • Function OFF : blue or gray

Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.

Register Data (Face Recognition)

Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.

/media/uploads/dkato/hvcp2_demo_img2.jpg

Change parameters

When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.

/media/uploads/dkato/hvcp2_demo_config_icon.jpg
/media/uploads/dkato/hvcp2_demo_config.jpg

Change transfer image size

By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
/media/uploads/dkato/gr-peach_switch2.jpg

HVC/STBLib/src/STB/STBTracking.c@5:49a61433290a, 2017-09-05 (annotated)

Committer:
dkato
Date:
Tue Sep 05 10:01:51 2017 +0000
Revision:
5:49a61433290a
Add HVC sensing result stabilizing library

Who changed what in which revision?

UserRevisionLine numberNew contents of line
dkato 5:49a61433290a 1 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 2 /* Copyright(C) 2017 OMRON Corporation */
dkato 5:49a61433290a 3 /* */
dkato 5:49a61433290a 4 /* Licensed under the Apache License, Version 2.0 (the "License"); */
dkato 5:49a61433290a 5 /* you may not use this file except in compliance with the License. */
dkato 5:49a61433290a 6 /* You may obtain a copy of the License at */
dkato 5:49a61433290a 7 /* */
dkato 5:49a61433290a 8 /* http://www.apache.org/licenses/LICENSE-2.0 */
dkato 5:49a61433290a 9 /* */
dkato 5:49a61433290a 10 /* Unless required by applicable law or agreed to in writing, software */
dkato 5:49a61433290a 11 /* distributed under the License is distributed on an "AS IS" BASIS, */
dkato 5:49a61433290a 12 /* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. */
dkato 5:49a61433290a 13 /* See the License for the specific language governing permissions and */
dkato 5:49a61433290a 14 /* limitations under the License. */
dkato 5:49a61433290a 15 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 16
dkato 5:49a61433290a 17 #include "STBTracking.h"
dkato 5:49a61433290a 18 #include "STB_Debug.h"
dkato 5:49a61433290a 19
dkato 5:49a61433290a 20 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 21 /* SetTrackingObjectBody */
dkato 5:49a61433290a 22 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 23 VOID SetTrackingObjectBody(const STB_FRAME_RESULT_BODYS* stbINPUTbodys,TraObj *bodys)
dkato 5:49a61433290a 24 {
dkato 5:49a61433290a 25
dkato 5:49a61433290a 26 STB_INT32 nCount;
dkato 5:49a61433290a 27 STB_INT32 i;
dkato 5:49a61433290a 28
dkato 5:49a61433290a 29
dkato 5:49a61433290a 30 /*make the human body information*/
dkato 5:49a61433290a 31 nCount = stbINPUTbodys->nCount;
dkato 5:49a61433290a 32
dkato 5:49a61433290a 33 for ( i = 0; i < nCount; i++)
dkato 5:49a61433290a 34 {
dkato 5:49a61433290a 35 bodys[i].nDetID = i;
dkato 5:49a61433290a 36 bodys[i].pos.x = stbINPUTbodys->body[i].center.nX ;
dkato 5:49a61433290a 37 bodys[i].pos.y = stbINPUTbodys->body[i].center.nY ;
dkato 5:49a61433290a 38 bodys[i].conf = stbINPUTbodys->body[i].nConfidence;
dkato 5:49a61433290a 39 bodys[i].size = stbINPUTbodys->body[i].nSize ;
dkato 5:49a61433290a 40 bodys[i].nTraID = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 41 }
dkato 5:49a61433290a 42
dkato 5:49a61433290a 43 }
dkato 5:49a61433290a 44 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 45 /* SetTrackingObjectFace */
dkato 5:49a61433290a 46 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 47 VOID SetTrackingObjectFace ( const STB_FRAME_RESULT_FACES *stbINPUTfaces ,TraObj *faces )
dkato 5:49a61433290a 48 {
dkato 5:49a61433290a 49
dkato 5:49a61433290a 50 STB_INT32 nCount;
dkato 5:49a61433290a 51 STB_INT32 i;
dkato 5:49a61433290a 52
dkato 5:49a61433290a 53
dkato 5:49a61433290a 54 /*make the human body information*/
dkato 5:49a61433290a 55 nCount = stbINPUTfaces->nCount;
dkato 5:49a61433290a 56 for ( i = 0; i < nCount; i++)
dkato 5:49a61433290a 57 {
dkato 5:49a61433290a 58 faces[i].nDetID = i;
dkato 5:49a61433290a 59 faces[i].pos.x = stbINPUTfaces->face[i].center.nX ;
dkato 5:49a61433290a 60 faces[i].pos.y = stbINPUTfaces->face[i].center.nY ;
dkato 5:49a61433290a 61 faces[i].conf = stbINPUTfaces->face[i].nConfidence;
dkato 5:49a61433290a 62 faces[i].size = stbINPUTfaces->face[i].nSize ;
dkato 5:49a61433290a 63 faces[i].nTraID = STB_STATUS_NO_DATA;
dkato 5:49a61433290a 64 }
dkato 5:49a61433290a 65
dkato 5:49a61433290a 66 }
dkato 5:49a61433290a 67 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 68 /* SetSrcTrFace */
dkato 5:49a61433290a 69 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 70 VOID SetSrcTrFace ( STB_INT32 nDetCntFace , TraObj *trFace, STB_TR_DET *trSrcInfo)
dkato 5:49a61433290a 71 {
dkato 5:49a61433290a 72 STB_INT32 i;
dkato 5:49a61433290a 73
dkato 5:49a61433290a 74 trSrcInfo->fcNum = nDetCntFace;
dkato 5:49a61433290a 75 for( i = 0; i < nDetCntFace; i++)
dkato 5:49a61433290a 76 {
dkato 5:49a61433290a 77 trSrcInfo->fcDet[i].conf = trFace[i].conf ;
dkato 5:49a61433290a 78 trSrcInfo->fcDet[i].posX = trFace[i].pos .x ;
dkato 5:49a61433290a 79 trSrcInfo->fcDet[i].posY = trFace[i].pos .y ;
dkato 5:49a61433290a 80 trSrcInfo->fcDet[i].size = trFace[i].size ;
dkato 5:49a61433290a 81 }
dkato 5:49a61433290a 82 }
dkato 5:49a61433290a 83 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 84 /* SetSrcTrBody */
dkato 5:49a61433290a 85 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 86 VOID SetSrcTrBody ( STB_INT32 nDetCntBody , TraObj *trBody, STB_TR_DET *trSrcInfo)
dkato 5:49a61433290a 87 {
dkato 5:49a61433290a 88 STB_INT32 i;
dkato 5:49a61433290a 89
dkato 5:49a61433290a 90 trSrcInfo->bdNum = nDetCntBody;
dkato 5:49a61433290a 91
dkato 5:49a61433290a 92 for( i = 0; i < nDetCntBody; i++)
dkato 5:49a61433290a 93 {
dkato 5:49a61433290a 94 trSrcInfo->bdDet[i].conf = trBody[i].conf ;
dkato 5:49a61433290a 95 trSrcInfo->bdDet[i].posX = trBody[i].pos .x ;
dkato 5:49a61433290a 96 trSrcInfo->bdDet[i].posY = trBody[i].pos .y ;
dkato 5:49a61433290a 97 trSrcInfo->bdDet[i].size = trBody[i].size ;
dkato 5:49a61433290a 98 }
dkato 5:49a61433290a 99 }
dkato 5:49a61433290a 100
dkato 5:49a61433290a 101 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 102 /* SetTrackingInfoToFace : Reflect tracking result in structure of detection result */
dkato 5:49a61433290a 103 /*------------------------------------------------------------------------------------------------------------------*/
dkato 5:49a61433290a 104 VOID SetTrackingInfoToFace( STB_TR_RES_FACES *fdResult ,STB_INT32 *pnTrackingNum ,TraObj *faces )
dkato 5:49a61433290a 105 {
dkato 5:49a61433290a 106 STB_INT32 nIdx;
dkato 5:49a61433290a 107
dkato 5:49a61433290a 108 *pnTrackingNum = fdResult->cnt;
dkato 5:49a61433290a 109 for (nIdx = 0; nIdx < *pnTrackingNum; nIdx++)
dkato 5:49a61433290a 110 {
dkato 5:49a61433290a 111 faces[nIdx].nDetID = fdResult->face[nIdx].nDetID ;
dkato 5:49a61433290a 112 faces[nIdx].nTraID = fdResult->face[nIdx].nTraID ;
dkato 5:49a61433290a 113 faces[nIdx].pos .x = fdResult->face[nIdx].pos.x ;
dkato 5:49a61433290a 114 faces[nIdx].pos .y = fdResult->face[nIdx].pos.y ;
dkato 5:49a61433290a 115 faces[nIdx].size = fdResult->face[nIdx].size ;
dkato 5:49a61433290a 116 faces[nIdx].conf = fdResult->face[nIdx].conf ;
dkato 5:49a61433290a 117 }
dkato 5:49a61433290a 118
dkato 5:49a61433290a 119 return;
dkato 5:49a61433290a 120 }
dkato 5:49a61433290a 121
dkato 5:49a61433290a 122 VOID SetTrackingInfoToBody(STB_TR_RES_BODYS *bdResult,STB_INT32 *pnTrackingNum,TraObj *bodys)
dkato 5:49a61433290a 123 {
dkato 5:49a61433290a 124 STB_INT32 nIdx;
dkato 5:49a61433290a 125
dkato 5:49a61433290a 126 *pnTrackingNum = bdResult->cnt;
dkato 5:49a61433290a 127 for (nIdx = 0; nIdx < *pnTrackingNum; nIdx++)
dkato 5:49a61433290a 128 {
dkato 5:49a61433290a 129 bodys[nIdx].nDetID = bdResult->body[nIdx].nDetID ;
dkato 5:49a61433290a 130 bodys[nIdx].nTraID = bdResult->body[nIdx].nTraID ;
dkato 5:49a61433290a 131 bodys[nIdx].pos .x = bdResult->body[nIdx].pos.x ;
dkato 5:49a61433290a 132 bodys[nIdx].pos .y = bdResult->body[nIdx].pos.y ;
dkato 5:49a61433290a 133 bodys[nIdx].size = bdResult->body[nIdx].size ;
dkato 5:49a61433290a 134 bodys[nIdx].conf = bdResult->body[nIdx].conf ;
dkato 5:49a61433290a 135 }
dkato 5:49a61433290a 136
dkato 5:49a61433290a 137 return;
dkato 5:49a61433290a 138 }