Renesas / Mbed OS GR-PEACH_IoT_Platform_HTTP_sample

Sample program for communicating with Fujitsuu IoT Platform using HTTP

Dependencies:   AsciiFont GR-PEACH_video GraphicsFramework LCD_shield_config R_BSP USBHost_custom easy-connect-gr-peach mbed-http picojson BM1383GLV KX022 rohm-sensor-hal rohm-bh1745

Overview

This sample program shows how to send the cognitive data and sensing data gathered by Omron HVC-P2 and Rohm Sensor Shield respectively to IoT Platform managed by FUJITSU ( http://jp.fujitsu.com/solutions/cloud/k5/function/paas/iot-platform/ ).

Required Hardware

• GR-PEACH ( https://developer.mbed.org/platforms/Renesas-GR-PEACH/ )
• LCD Shield ( https://developer.mbed.org/teams/Renesas/Wiki/LCD-shield )
• HVC-P2 ( Human Vision Components B5T-007001 ) ( https://plus-sensin.omron.com/product/B5T-007001/ )
• SensorShield-EVK-001 ( Rohm Sensor Evaluation Kit ) ( http://www.rohm.com/web/global/sensor-shield-support )

Application Setup

1. Configure the connection type. For details, please refer to the following link:
   https://developer.mbed.org/teams/Renesas/code/GR-PEACH_IoT_Platform_HTTP_sample/wiki/Connection-Type
2. Configure Ethernet settings. For details, please refer to the following link:
   https://developer.mbed.org/teams/Renesas/code/GR-PEACH_IoT_Platform_HTTP_sample/wiki/Ethernet-settings
3. Set up the Access Code of resource where the gathered data would be stored. For details on Access Code, please refer to the following links:
   https://iot-docs.jp-east-1.paas.cloud.global.fujitsu.com/en/manual/userguide_en.pdf
   https://iot-docs.jp-east-1.paas.cloud.global.fujitsu.com/en/manual/apireference_en.pdf
   https://iot-docs.jp-east-1.paas.cloud.global.fujitsu.com/en/manual/portalmanual_en.pdf
   
4. Set up URI for the resource where the gathered data would be stored. For details, please refer to the following link:
   https://iot-docs.jp-east-1.paas.cloud.global.fujitsu.com/en/manual/userguide_en.pdf
   https://iot-docs.jp-east-1.paas.cloud.global.fujitsu.com/en/manual/apireference_en.pdf
   

Building Example

1. Import this sample program onto mbed Compiler
2. Configure the program in accordance with the description of Application Setup above
3. Compile the sample program
4. Plug the Ethernet cable into GR-PEACH if you would like Ethernet mode
5. Plug micro-USB cable into the OpenSDA port which lies on the next to the RESET button
6. Copy the binary previously downloaded to your PC to GR-PEACH in order to flash this program. When the copy is successfully completed, the drive named MBED should be re-mounted automatically
7. Press the RESET button on the board to run the sample application

Data Format sent to IoT Platform

In this sample program, the cognitive data and sensing data are serialized into the following JSON format using picojson (https://developer.mbed.org/users/mimil/code/picojson/):

• Face detection data

{
    "RecordType": "HVC-P2(face)",
    "id": "<GR-PEACH ID>-<Sensor ID>",
    "Age": xxx,
    "FaceRectangle": {
        "Height": xxx,
        "Left": xxx,
        "Top": xxx,
        "Width": xxx
    },
    "Gender": xxx,
    "Scores": {
        "Anger": xxx,
        "Happiness": xxx,
        "Neutral": xxx,
        "Sadness": xxx,
        "Surprise": xxx
    }
}

• Body detection data

{
    "RecodeType": "HVC-P2(body)",
    "id": "<GR-PEACH ID>-<Sensor ID>",
    "BodyRectangle": {
        "Height": xxx,
        "Left": xxx,
        "Top": xxx,
        "Width": xxx
    }
}

• Accelerometer data

{
    "RecodeType": "Accelerometer",
    "id": "<GR-PEACH ID>-<Sensor ID>",
    "data": [ acceleratoin(x-direction), acceleration(y-direction), acceleration(z-direction), null, null, null ]
}

Note that data[0], data[1] and data[2] are filled with the acceleration data in x, y and z direction respectively, and the remaining elements are filled with null.

• Atmosphere data

{
    "RecodeType": "Atmosphere",
    "id": "<GR-PEACH ID>-<Sensor ID>",
    "data": [ atmosphere data, null, null, null, null, null ]
}

Note that data[0] is filled with atmosphere data, and the remaining elements are filled with null.

• Color sensor data

{
    "RecodeType": "Color",
    "id": "<GR-PEACH ID>-<Sensor ID>",
    "data": [ Red, Green, Blue, Alpha, null, null]
}

Note that data[0], data[1], data[2] and data[3] are filled with Red, Green, Blue and Alpha elements of color respectively, and the remaining elements are filled with null.

• Temperature data

{
    "RecodeType": "Temperature",
    "id": "<GR-PEACH ID>-<Sensor ID>",
    "data": [ Temperature, null, null, null, null, null ]
}

Note that data[0] is filled with temperature data, the remaining elements are filled with null.

• Geomagnetism

{
    "RecodeType": "Geomagnetism",
    "id": "<GR-PEACH ID>-<Sensor ID>",
    "data": [ geomagnetism(x-direction), geomagnetism(y-direction), geomagnetism(z-direction), null, null, null]
}

Note that data[0], data[1] and data[2] are filled with the geomagnetism data in x, y and z direction respectively, and the remaining elements are filled with null.

#ifndef IOT_READY_PROCESSING_H
#define IOT_READY_PROCESSING_H

#include "HVCApi.h"
#include "HVCDef.h"
#include "clib_drivers.h"

#define DETECT_MAX 35
#define WAIT_TIME 5000

#define USE_SENSOR_SHIELD
#define USE_HVC_P2
//#define ENABLED_NTP

typedef struct {
    INT32 score_neutral;
    INT32 score_anger;
    INT32 score_happiness;
    INT32 score_surprise;
    INT32 score_sadness;
} IotReadyExpression_t;

typedef struct {
    int x;
    int y;
    int z;
} Accelerometer_t;

typedef struct {
    int red;
    int green;
    int blue;
    int alpha;
} Color_t;

/* Face data detected by HVC-P2 to send to IOT Platform */
typedef struct {
    AGE_RESULT				age;			/* Age Estimation result */
    GENDER_RESULT			gender;			/* Gender Estimation result */
    IntBoxType		face_rectangle;	/* rectangle of face detection result */
    IotReadyExpression_t	scores; 		/* Score of 5 expression */
} result_hvcp2_fd_t;

/* Body data detected by HVC-P2 to send to IOT Platform */
typedef struct {
    IntBoxType		body_rectangle;	/* rectangle of body detection result */
} result_hvcp2_bd_t;

/* Data detected by SENSORSHIELD-EVK-001 to send to IOT Platform */
typedef struct {
    int	Temperature;
    int	Atmosphere;
    Accelerometer_t Accelerometer;
    Color_t Color;
} result_sensor_shield_t;

#define _DEBUG_IOT
#ifdef _DEBUG_IOT
extern Serial pc;
#define DEBUG_PRINT(...) pc.printf(__VA_ARGS__)
#else
#define DEBUG_PRINT(...)
#endif

extern result_hvcp2_fd_t result_hvcp2_fd[DETECT_MAX];
extern result_hvcp2_bd_t result_hvcp2_bd[DETECT_MAX];
extern uint32_t result_hvcp2_bd_cnt;
extern uint32_t result_hvcp2_fd_cnt;

extern result_sensor_shield_t result_sensorshield;
extern Semaphore iot_ready_semaphore;
extern int semaphore_wait_ret;

#endif