Daiki Kato / Mbed OS GR-PEACH_HVC-P2_sample_client

Send the data of GR-PEACH_HVC-P2_sample to the cloud.

Dependencies:   AsciiFont GR-PEACH_video GraphicsFramework LCD_shield_config R_BSP USBHost_custom easy-connect-gr-peach

Fork of mbed-os-example-client by mbed-os-examples

Note at the time of sample import

Please not check the "Update all libraries to the latest version" at the time of import.

Warning!

When exporting and using it, increase the following stack size.

mbed-os/features/FEATURE_LWIP/lwip-interface/lwipopts.h

#define TCPIP_THREAD_STACKSIZE      1024
->
#define TCPIP_THREAD_STACKSIZE      2048

Overview

This is a sample to send the analysis result of GR-PEACH_HVC-P2_sample to the cloud using mbed-client. Please refer to following for operation of HVC-P2.

Import programGR-PEACH_HVC-P2_sample

Sample to operate omron HVC-P2 on GR-PEACH.

Last commit 28 Sep 2018 by Renesas


Required hardware

Application setup

Client credentials

To register the application to mbed Device Connector, you need to create and set the client side certificate.

  1. Go to https://connector.mbed.com/ and log in with your mbed account
  2. On mbed Device Connector, go to https://connector.mbed.com/#credentials and click the Get my device security credentials button to get new credentials for your device.
  3. Replace the contents in security.h of this example with content copied above.

Ethernet settings

This sample uses Ethernet as the default connection type. To change the connection type, set WIFI_BP3595 in mbed_app.json:

mbed_app.json

"network-interface":{
    "help": "Options are ETHERNET, WIFI_ESP8266, WIFI_BP3595",
    "value": "ETHERNET"
},


To specify MAC address, add fllowing function to main.cpp. (When using Wifi, setting of MAC address is not necessary.)

Specify MAC address

// set mac address
void mbed_mac_address(char *mac) {
    mac[0] = 0x00;
    mac[1] = 0x02;
    mac[2] = 0xF7;
    mac[3] = 0xF0;
    mac[4] = 0x00;
    mac[5] = 0x00;
}


Wifi settings

This example can use BP3595 Wifi Interface for managing the wireless connectivity. To run this example using Wifi, you need:

  1. A BP3595 Wifi module ( https://developer.mbed.org/components/BP3595-for-GR-PEACH/ )
  2. Mount BP3595 onto GR-PEACH
  3. Close GR-PEACH's JP21 (https://developer.mbed.org/teams/Renesas/wiki/Jumper-settings-of-GR-PEACH)
  4. In the mbed_app.json file, change

mbed_app.json

"network-interface":{
    "help": "Options are ETHERNET, WIFI_ESP8266, WIFI_BP3595",
    "value": "WIFI_BP3595"
},


Provide your Wifi SSID and password here and leave \" in the beginning and end of your SSID and password as shown in the example below:

mbed_app.json

"wifi-ssid": {
    "help": "WiFi SSID",
    "value": "\"SSID\""
},
"wifi-password": {
    "help": "WIFI Password",
    "value": "\"Password\""
}


Specify the security type for connection to be used. When the security type is WPA2, you need to specify NSAPI_SECURITY_WAP as follows:

mbed_app.json

"wifi-security":{
    "help": "Options are NSAPI_SECURITY_WEP, NSAPI_SECURITY_WPA, NSAPI_SECURITY_WPA2, NSAPI_SECURITY_WPA_WPA2",
    "value": "NSAPI_SECURITY_WEP"
},

By default, NSAPI_SECURITY_WPA_WPA2 is specified here.

Application resources

This example exposes four resources listed below:

  1. 3202/0/5700. Recognition result from HVC-P2 (GET).
  2. 3201/0/5850. Blink function, blinks LED when executed (POST).
  3. 3201/0/5853. Blink pattern, used by the blink function to determine how to blink. In the format of 1000:500:1000:500:1000:500 (PUT).
  4. 3201/0/5855. Blink color, used by the blink function. Any of red, green, blue, cyan, yellow and magenta is acceptable (PUT).

For more info on how to get notifications when resource 1 changes, or how to use resource 2, 3 and 4, please look at

Import programGR-PEACH_mbed-connector-ZXingSample-node

Node.js based Web Application for mbed Device Connector specific to GR-PEACH_mbed-os-client-ZXingSample

Last commit 10 Mar 2017 by Renesas

# This is a Web Application for GR-PEACH_mbed-os-client-ZXingSample, but it can also be used for this sample.

HVCApi/HVCDef.h

Committer:
dkato
Date:
2017-03-14
Revision:
74:bf6d9bd511bd
Parent:
73:fbc0212c2eaf

File content as of revision 74:bf6d9bd511bd:

/*---------------------------------------------------------------------------*/
/* Copyright(C)  2017  OMRON Corporation                                     */
/*                                                                           */
/* Licensed under the Apache License, Version 2.0 (the "License");           */
/* you may not use this file except in compliance with the License.          */
/* You may obtain a copy of the License at                                   */
/*                                                                           */
/*     http://www.apache.org/licenses/LICENSE-2.0                            */
/*                                                                           */
/* Unless required by applicable law or agreed to in writing, software       */
/* distributed under the License is distributed on an "AS IS" BASIS,         */
/* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.  */
/* See the License for the specific language governing permissions and       */
/* limitations under the License.                                            */
/*---------------------------------------------------------------------------*/

#ifndef HVCDef_H__
#define HVCDef_H__

/*----------------------------------------------------------------------------*/
/* Execution flag */
#define HVC_ACTIV_BODY_DETECTION        0x00000001
#define HVC_ACTIV_HAND_DETECTION        0x00000002
#define HVC_ACTIV_FACE_DETECTION        0x00000004
#define HVC_ACTIV_FACE_DIRECTION        0x00000008
#define HVC_ACTIV_AGE_ESTIMATION        0x00000010
#define HVC_ACTIV_GENDER_ESTIMATION     0x00000020
#define HVC_ACTIV_GAZE_ESTIMATION       0x00000040
#define HVC_ACTIV_BLINK_ESTIMATION      0x00000080
#define HVC_ACTIV_EXPRESSION_ESTIMATION 0x00000100
#define HVC_ACTIV_FACE_RECOGNITION      0x00000200

/* Image info of Execute command */
#define HVC_EXECUTE_IMAGE_NONE          0x00000000
#define HVC_EXECUTE_IMAGE_QVGA          0x00000001
#define HVC_EXECUTE_IMAGE_QVGA_HALF     0x00000002

/*----------------------------------------------------------------------------*/
/* Error code */

/* Parameter error */
#define HVC_ERROR_PARAMETER             -1

/* Send signal timeout error */
#define HVC_ERROR_SEND_DATA             -10

/* Receive header signal timeout error */
#define HVC_ERROR_HEADER_TIMEOUT        -20
/* Invalid header error */
#define HVC_ERROR_HEADER_INVALID        -21
/* Receive data signal timeout error */
#define HVC_ERROR_DATA_TIMEOUT          -22


/*----------------------------------------------------------------------------*/
/* Album data size */
#define HVC_ALBUM_SIZE_MIN              32
#define HVC_ALBUM_SIZE_MAX              816032

/*----------------------------------------------------------------------------*/
/* Expression */
typedef enum {
    EX_NEUTRAL = 1,
    EX_HAPPINESS,
    EX_SURPRISE,
    EX_ANGER,
    EX_SADNESS
}EXPRESSION;

/*----------------------------------------------------------------------------*/
/* Struct                                                                     */
/*----------------------------------------------------------------------------*/
/*----------------------------------------------------------------------------*/
/* Devicefs model and version info                                           */
/*----------------------------------------------------------------------------*/
typedef struct {
    UINT8   string[12];
    UINT8   major;
    UINT8   minor;
    UINT8   relese;
    UINT8   revision[4];
}HVC_VERSION;

/*----------------------------------------------------------------------------*/
/* Detection result                                                           */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   posX;       /* Center x-coordinate */
    INT32   posY;       /* Center y-coordinate */
    INT32   size;       /* Size */
    INT32   confidence; /* Degree of confidence */
}DETECT_RESULT;

/*----------------------------------------------------------------------------*/
/* Face direction                                                             */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   yaw;        /* Yaw angle */
    INT32   pitch;      /* Pitch angle */
    INT32   roll;       /* Roll angle */
    INT32   confidence; /* Degree of confidence */
}DIR_RESULT;

/*----------------------------------------------------------------------------*/
/* Age                                                                        */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   age;        /* Age */
    INT32   confidence; /* Degree of confidence */
}AGE_RESULT;

/*----------------------------------------------------------------------------*/
/* Gender                                                                     */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   gender;     /* Gender */
    INT32   confidence; /* Degree of confidence */
}GENDER_RESULT;

/*----------------------------------------------------------------------------*/
/* Gaze                                                                       */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   gazeLR;     /* Yaw angle */
    INT32   gazeUD;     /* Pitch angle */
}GAZE_RESULT;

/*----------------------------------------------------------------------------*/
/* Blink                                                                      */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   ratioL;     /* Left eye blink result */
    INT32   ratioR;     /* Right eye blink result */
}BLINK_RESULT;

/*----------------------------------------------------------------------------*/
/* Expression                                                                 */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   topExpression;  /* Top expression */
    INT32   topScore;       /* Top score */
    INT32   score[5];       /* Score of 5 expression */
    INT32   degree;         /* Negative-positive degree */
}EXPRESSION_RESULT;

/*----------------------------------------------------------------------------*/
/* Face Recognition                                                           */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   uid;        /* User ID */
    INT32   confidence; /* Degree of confidence */
}RECOGNITION_RESULT;

/*----------------------------------------------------------------------------*/
/* Face Detection & Estimations result                                        */
/*----------------------------------------------------------------------------*/
typedef struct{
    DETECT_RESULT       dtResult;           /* Face detection result */
    DIR_RESULT          dirResult;          /* Face direction estimation result */
    AGE_RESULT          ageResult;          /* Age Estimation result */
    GENDER_RESULT       genderResult;       /* Gender Estimation result */
    GAZE_RESULT         gazeResult;         /* Gaze Estimation result */
    BLINK_RESULT        blinkResult;        /* Blink Estimation result */
    EXPRESSION_RESULT   expressionResult;   /* Expression Estimation result */
    RECOGNITION_RESULT  recognitionResult;  /* Face Recognition result */
}FACE_RESULT;

/*----------------------------------------------------------------------------*/
/* Human Body Detection results                                               */
/*----------------------------------------------------------------------------*/
typedef struct{
    UINT8           num;            /* Number of Detection */
    DETECT_RESULT   bdResult[35];   /* Detection result */
}BD_RESULT;

/*----------------------------------------------------------------------------*/
/* Hand Detection results                                                     */
/*----------------------------------------------------------------------------*/
typedef struct{
    UINT8           num;            /* Number of Detection */
    DETECT_RESULT   hdResult[35];   /* Detection result */
}HD_RESULT;

/*----------------------------------------------------------------------------*/
/* Face Detection & Estimations results                                       */
/*----------------------------------------------------------------------------*/
typedef struct{
    UINT8           num;            /* Number of Detection */
    FACE_RESULT     fcResult[35];   /* Detection & Estimations result */
}FD_RESULT;

/*----------------------------------------------------------------------------*/
/* Image data                                                                 */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   width;
    INT32   height;
    UINT8   image[320*240];
}HVC_IMAGE;

/*----------------------------------------------------------------------------*/
/* Eesult data of Execute command                                             */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32       executedFunc;   /* Execution flag */
    BD_RESULT   bdResult;       /* Human Body Detection results */
    HD_RESULT   hdResult;       /* Hand Detection results */
    FD_RESULT   fdResult;       /* Face Detection & Estimations results */
    HVC_IMAGE   image;          /* Image data */
}HVC_RESULT;

/*----------------------------------------------------------------------------*/
/* Threshold of confidence                                                    */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   bdThreshold;        /* Threshold of confidence of Human Body Detection */
    INT32   hdThreshold;        /* Threshold of confidence of Hand Detection */
    INT32   dtThreshold;        /* Threshold of confidence of Face Detection */
    INT32   rsThreshold;        /* Threshold of confidence of Face Recognition */
}HVC_THRESHOLD;

/*----------------------------------------------------------------------------*/
/* Detection size                                                             */
/*----------------------------------------------------------------------------*/
typedef struct{
    INT32   bdMinSize;          /* Minimum detection size of Human Body Detection */
    INT32   bdMaxSize;          /* Maximum detection size of Human Body Detection */
    INT32   hdMinSize;          /* Minimum detection size of Hand Detection */
    INT32   hdMaxSize;          /* Maximum detection size of Hand Detection */
    INT32   dtMinSize;          /* Minimum detection size of Face Detection */
    INT32   dtMaxSize;          /* Maximum detection size of Face Detection */
}HVC_SIZERANGE;

#endif /* HVCDef_H__ */