How to collect and analyze sensing data of IoT platform

Posted on September 22, 2015 by embeddist

This post shows how to connect IoT platform to Cloud service and how to display sensing data for graphical analysis.
* Scope of post
* Platform : WIZwiki-W7500
* cloud data loger : data.sparkfun.com (Phant.io)
* cloud chart : analog.io
* IDE; Web-Compiler(mbed.com)
* HTTP Query

data.sparkfun.com

What is Phant?
- Phant is a open source cloud server platform by powered Sparkfun Electronics.
- Sparkfun created data.spartfun.com ,which is a free cloud service running phant. –
- To collect data from your device to cloud service, you just need to register a new stream.
- After register, you get two keys for accessing the data; one is q private key is required to update that stream, other is a public key grants access to any other stream on the service.
- All communication with Phant is carried out over HTTP. So, your device should be acted as HTTP Client.
- http://data.sparkfun.com/input/%5BpublicKey%5D?private_key=%5BprivateKey%5D&%5Bfield1%5D=%5Bvalue%5D&%5Bfield2%5D=%5Bvalue%5D
Phant : Phant.io

Phant is a modular node.js based data logging tool for collecting data from the Internet of Things. It is the open source software that powers data.sparkfun.com, and is actively maintained by SparkFun Electronics. Phant is short for elephant. Elephants are known for their remarkable recall ability, so it seemed appropriate to name a data logging project in honor of an animal that never forgets.

analog.io

3rd party of data.sparkfun.com
Graphing front end
>analog.io is a full stack IoT web service and hardware platforms where people can create connected devices and share them with the world. It is designed to solve all kinds of world problems from air pollution, improving farm output or studying the bee population. It is really only limited by the users imagination. (for more detail)
//embedr.flickr.com/assets/client-code.js

Prepare materials

Hardware
//embedr.flickr.com/assets/client-code.js
- mbed platform : WIZwiki-W7500
  - ARM® Cortex™-M0 Core 48MHz
  - 128KB Flash memory
  - 16KB to 48 KB SRAM (Min 16KB available if 32KB socket buffer is used, Max 48KB available if no socket buffer is used)
  - Hardwired TCP/IP Core (8 Sockets, MII: Medium-Independent Interface)
  - 12-bit, 8ch ADC
  - 53 I/Os
  - 1ch Watchdog, 4ch Timers and 8ch PWM
  - 3ch UART
  - 2ch SPI
  - 2ch I2C
- Sensors (ywrobot easy module shield v1): DHT11
  //embedr.flickr.com/assets/client-code.js
Registrations
- data.sparkfun.com
  To create a data stream, head over to data.sparkfun.com, and click “CREATE”.
  - Create a Data Stream
    //embedr.flickr.com/assets/client-code.js
    * Fields – This comma-separated list of words defines data stream to post a list of unique values.
    * Stream Alias – This testbox defines domain name for you Data Stream
  - New Stream example: After creating a data Stream, you will confirm URL, Keys for accessing for your data stream.
    //embedr.flickr.com/assets/client-code.js

Software

//embedr.flickr.com/assets/client-code.js
* Used Lib
* WIZnetInterface Lib. : for Ethernet connectivity of W7500
* DHT Lib. : for DHT11 sensor

Codes flow

mbed.org repositories : https://developer.mbed.org/users/embeddist/code/Data_Sparkfun_io/
Configuration Arduino’s I/O pins

/*
 *Input Pins, Misc
 * D4 - Temp. and Hum. Sensor
 * D3 - Push buttom
 */
DHT sensor(D4, DHT11);
DigitalIn  triggerPin(D3);

Configuration Phat Stuff

/*
 * Phant Stuffs
 * Insert your publicKey
 * Insert your privateKey
 * Generat Fileds; 'Files name shoud be same "field name" in Create Stream form'
 */
char publicKey[] = "insert_your_publicKey";
char privateKey[] = "insert_your_privateKey";
uint8_t NUM_FIELDS = 2;
char fieldNames1[] = "hum";
char fieldNames2[] = "temp";

Network Configuration : DHCP Client

   // Enter a MAC address for your controller below.
    uint8_t mac_addr[6] = {0x00, 0x08, 0xDC, 0x00, 0x01, 0x02};     

    printf("initializing Ethernetrn");
    // initializing MAC address
    eth.init(mac_addr);

    // Check Ethenret Link
    if(eth.link() == true)   printf("- Ethernet PHY Link-Done rn");
    else printf("- Ethernet PHY Link- Failrn");

    // Start Ethernet connecting: Trying to get an IP address using DHCP
    if (eth.connect()<0)    printf("Fail - Ethernet Connecing");

    // Print your local IP address:
    printf("IP=%snr",eth.getIPAddress());
    printf("MASK=%snr",eth.getNetworkMask());
    printf("GW=%snr",eth.getGateway());

HTTP Client

/*
 *  - If the trigger pin (3) goes low, send the data.
 *      - Get sensing datas by using analogread()
 *      - Call postData
 *          - Open socket as TCP Client
 *          - Try to connet TCP server (data.sparkfun.com); if needs, do DNS clinet for getting IP address of server
 *          - Make query string based on Phant frame
 *          - Send query
 *          - Check for a response from the server, and route it out the serial port.
 */

    while(1)
    {
        if(triggerPin ==0)
        {
            sensor.readData();
            c   = sensor.ReadTemperature(CELCIUS);
            h   = sensor.ReadHumidity();
           printf("Temperature in Celcius: %4.2f", c);
           printf("Humidity is %4.2fn", h, dp, dpf);

          sock.connect("data.sparkfun.com", 80);

          snprintf(http_cmd, http_cmd_sz,  "GET /input/%s?private_key=%s&%s=%2.2f&%s=%3.3f HTTP/1.1rnHost: data.sparkfun.comrnConection: closernrn", 
                                            publicKey, privateKey, fieldNames1, h, fieldNames2, c);
          sock.send_all(http_cmd, http_cmd_sz-1);

          while ( (returnCode = sock.receive(buffer, buffer_sz-1)) > 0)
          {
              buffer[returnCode] = '';
              printf("Received %d chars from server:nr%sn", returnCode, buffer);
          }

          sock.close();         
        }

        wait(2);
    }

Make Query string over HTTP
http://data.sparkfun.com/input/%5BpublicKey%5D?private_key=%5BprivateKey%5D&hum=%5Bvalue%5D&temp=%5Bvalue%5D

snprintf(http_cmd, http_cmd_sz,  "GET /input/%s?private_key=%s&%s=%2.2f&%s=%3.3f HTTP/1.1\r\nHost: data.sparkfun.com\r\nConection: close\r\n\r\n", publicKey, privateKey, fieldNames1, h, fieldNames2, c);
sock.send_all(http_cmd, http_cmd_sz-1);

Demo

Serial Monitor

DHCP Clinet message
Press the button to send query to server.

Confirm the response message on serial terminal and data.spark.com/your_stream

initializing Ethernet
- Ethernet PHY Link-Done
IP=192.168.11.224
MASK=255.255.255.0
GW=192.168.11.1
Temperature in Celcius: 27.00Humidity is 55.00
Received 299 chars from server:
HTTP/1.1 200 OK
Access-Control-Allow-Origin: *
Access-Control-Allow-Methods: GET,POST,DELETE
Access-Control-Allow-Headers: X-Requested-With, Phant-Private-Key
Content-Type: text/plain
X-Rate-Limit-Limit: 300
X-Rate-Limit-Remaining: 298
X-Rate-Limit-Reset: 1441353380.898
Date: Fri, 04 Sep 20
Received 299 chars from server:
15 07:46:03 GMT
Transfer-Encoding: chunked
Set-Cookie: SERVERID=phantworker2; path=/
Cache-control: private

https://data.sparkfun.com/office_monitoring

//embedr.flickr.com/assets/client-code.js

analog.io: import stream from data.sparkfun.com/your_stream

How to Import Stream
1. Click ‘+Import Stream’ button on menu
  //embedr.flickr.com/assets/client-code.js
2. Select ‘Sparkfun’ on Host drop box and input Public key of data.sparkfun.com
  //embedr.flickr.com/assets/client-code.js
3. Confirm your Stream
  //embedr.flickr.com/assets/client-code.js

How to push data to data.sparkfun.com for Internet of Things

Posted on August 27, 2015 by embeddist

How to push data to data.sparkfun.com for Internet of Things

This post shows how to connect Arduino platform to data.sparkfun.com for Internet of Things.
* Scope of post
* Internet Connectivity : W5500 Ethernet Shield
* Cloud Service : data.sparkfun.com
* Arduino IDE 1.7.6 (arduino.org); surpports Ethernet libraries for W5500
* HTTP Query

data.sparkfun.com

What is Phant?
- Phant is a open source cloud server platform by powered Sparkfun Electronics.
- Sparkfun created data.spartfun.com ,which is a free cloud service running phant. –
- To collect data from your device to cloud service, you just need to register a new stream.
- After register, you get two keys for accessing the data; one is q private key is required to update that stream, other is a public key grants access to any other stream on the service.
- All communication with Phant is carried out over HTTP. So, your device should be acted as HTTP Client.
- http://data.sparkfun.com/input/%5BpublicKey%5D?private_key=%5BprivateKey%5D&%5Bfield1%5D=%5Bvalue%5D&%5Bfield2%5D=%5Bvalue%5D
Phant : Phant.io

Phant is a modular node.js based data logging tool for collecting data from the Internet of Things. It is the open source software that powers data.sparkfun.com, and is actively maintained by SparkFun Electronics. Phant is short for elephant. Elephants are known for their remarkable recall ability, so it seemed appropriate to name a data logging project in honor of an animal that never forgets.

Prepare materials

Hardware
//embedr.flickr.com/assets/client-code.js
- Arudino Board : Arduino due ,[SCH]
- Ethernet Shield : W5500 Ethernet Shield,[SCH]
- Sensors (ywrobot easy module shield v1): LM35(Temp.), PhotoCell(light)
  //embedr.flickr.com/assets/client-code.js
Tool : Arduino IDE
- Arduino IDE@arduion.org
  Arduino 1.7.6 (http://www.arduino.org/downloads) of arduino.org supports Ethernet2 libraries for Ethernet shield based on W5500, while Ethernet libraries supports Ethernet shield based on W5100.
- Arduino IDE@arduion.cc
  To use W5500 Ethernet Shield on Arduion IDE of Arduino.cc, you should be install the WIZnet Ethernet Library.
Registration on data.sparkfun.com
To create a data stream, head over to data.sparkfun.com, and click “CREATE”.
- Create a Data Stream
  - New Stream example
    ![Registration2 @ data.sparkfun.com](C:\Users\root\Desktop\CC_AUG\FIG\EDITED\E_New Stream.png)
    - Fields – This comma-separated list of words defines data stream to post a list of unique values.
    - Stream Alias – This testbox defines domain name for you Data Stream
  - Create Data Steam: After creating a data Stream, you will confirm URL, Keys for accessing for your data stream.
    ![Registration1 @ data.sparkfun.com](C:\Users\root\Desktop\CC_AUG\FIG\EDITED\E_New Stream1.png)

Software

Codes flow

Configuration Arduino’s I/O pins
- D3 – Active-low momentary button (pulled high internally)
- A1 – Photoresistor (which is combined with a 10k resistor to form a voltage divider output to the Arduino).
- A2 – Temporature Sensor (LM35)
Configuration Phat Stuff
- Insert your publicKey
- Insert your privateKey
- Generat Fileds; ‘Files name shoud be same “field name” in Create Stream form’
setup()
- Call Serial.begin(115200);
- Setting Input pins
- Call setupEthernet(): do DHCP Client and writing MAC Addrerss
loop()
- If the trigger pin (3) goes low, send the data.
  - Get sensing datas by using analogread()
  - Call postData
    - Open socket as TCP Client
    - Try to connet TCP server (data.sparkfun.com); if needs, do DNS clinet for getting IP address of server
    - Make query string based on Phant frame
    - Send query
    - Check for a response from the server, and route it out the serial port.

Arduino’s I/O pins:

const int triggerPin = 3;
const int lightPin = A1;
const int tempPin = A2; 

void setup()
{
...

  // Setup Input Pins:
  pinMode(triggerPin, INPUT_PULLUP);
  pinMode(lightPin, INPUT_PULLUP);
  pinMode(tempPin, INPUT_PULLUP);
...
}

Phant Stuff

const String publicKey = "insert_your_publicKey"; 
const String privateKey = "insert_your_privateKey";

const byte NUM_FIELDS = 2;
const String fieldNames[NUM_FIELDS] = {"lux", "temp"}; // Fileds shoud be same "field names" in Create Stream.
int fieldData[NUM_FIELDS];

Make Query string over HTTP

Format
http://data.sparkfun.com/input/%5BpublicKey%5D?private_key=%5BprivateKey%5D&lux=%5Bvalue%5D&temp=%5Bvalue%5D

client.print("GET /input/");
client.print(publicKey);
client.print("?private_key=");
client.print(privateKey);
for (int i=0; i<NUM_FIELDS; i++)
{
  client.print("&");
  client.print(fieldNames[i]);
  client.print("=");
  client.print(fieldData[i]);
}
client.println(" HTTP/1.1");
client.print("Host: ");
client.println(server);
client.println("Connection: close");
client.println();

Phant_Ethernet.ino

/*****************************************************************
Phant_Ethernet.ino
Post data to SparkFun's data stream server system (phant) using
an Arduino and an Ethernet Shield.
Jim Lindblom @ SparkFun Electronics
Original Creation Date: July 3, 2014
Roy Kim(Soohwan Kim) embeddist@gmail.com
Modified DateL August 26, 2015
S

This sketch uses an Arduino Uno to POST sensor readings to 
SparkFun's data logging streams (http://data.sparkfun.com). A post
will be initiated whenever pin 3 is connected to ground.

Before uploading this sketch, there are a number of global vars
that need adjusting:
1. Ethernet Stuff: Fill in your desired MAC and a static IP, even
   if you're planning on having DCHP fill your IP in for you.
   The static IP is only used as a fallback, if DHCP doesn't work.
2. Phant Stuff: Fill in your data stream's public, private, and 
data keys before uploading!

Hardware Hookup:
  * These components are connected to the Arduino's I/O pins:
    <Original>
    * D3 - Active-low momentary button (pulled high internally)
    * A0 - Photoresistor (which is combined with a 10k resistor
           to form a voltage divider output to the Arduino).
    * D5 - SPDT switch to select either 5V or 0V to this pin.
    <Modified>
    * D3 - Active-low momentary button (pulled high internally)
    * A1 - Photoresistor (which is combined with a 10k resistor
           to form a voltage divider output to the Arduino).
    * A2 - Temporature Sensor (LM35)

  * A CC3000 Shield sitting comfortable on top of your Arduino.

Development environment specifics:
    <Original>
    IDE: Arduino 1.0.5 
    Hardware Platform: RedBoard & PoEthernet Shield
    <Modified>
    IDE: Arduino 1.7.6 
    Hardware Platform: Arduino DUE & W5500 Ethernet Shield

This code is beerware; if you see me (or any other SparkFun 
employee) at the local, and you've found our code helpful, please 
buy us a round!

Much of this code is largely based on David Mellis' WebClient
example in the Ethernet library.

Distributed as-is; no warranty is given.
*****************************************************************/
#include <SPI.h> // Required to use Ethernet
//#include <Ethernet.h> // The Ethernet library includes the client for W5100
#include <Ethernet2.h> // The Ethernet library includes the client for W5500
//#include <Progmem.h> // Allows us to sacrifice flash for DRAM //@Modified: Don't use

///////////////////////
// Ethernet Settings //
///////////////////////
// Enter a MAC address for your controller below.
byte mac[] = { 0xDE, 0xAD, 0xBE, 0xEF, 0xFE, 0xED };

// if you don't want to use DNS (and reduce your sketch size)
// use the numeric IP instead of the name for the server:
//IPAddress server(54,86,132,254);  // numeric IP for data.sparkfun.com
char server[] = "data.sparkfun.com";    // name address for data.sparkFun (using DNS)
// Set the static IP address to use if the DHCP fails to assign
IPAddress ip(192,168,0,177);

// Initialize the Ethernet client library
// with the IP address and port of the server 
// that you want to connect to (port 80 is default for HTTP):
EthernetClient client;

/////////////////
// Phant Stuff //
/////////////////
const String publicKey = "6JZbNolApzF4om2l9yYK";
const String privateKey = "Ww0vPW1yrkUNDqWPV9jE";

const byte NUM_FIELDS = 2;
const String fieldNames[NUM_FIELDS] = {"lux", "temp"};
int fieldData[NUM_FIELDS];

//////////////////////
// Input Pins, Misc //
//////////////////////
const int triggerPin = 3;
const int lightPin = A1;
const int tempPin = A2; 

float tempC;
int reading;
//String name = "Ether-anon";
String name = "Roy";
boolean newName = true;

void setup()
{
  Serial.begin(115200);

  // Setup Input Pins:
  pinMode(triggerPin, INPUT_PULLUP);
  pinMode(lightPin, INPUT_PULLUP);
  pinMode(tempPin, INPUT_PULLUP);

  // Set Up Ethernet:
  setupEthernet();

  Serial.println(F("=========== Ready to Stream ==========="));
  Serial.println(F("Press the button (D3) to send an update"));
#if 0 // don't use
  Serial.println(F("Type your name (no spaces!), followed by '!' to update name"));
#endif
}

void loop()
{
  // If the trigger pin (3) goes low, send the data.
  if (!digitalRead(triggerPin))
  {
    // Gather data:
        fieldData[0] = analogRead(lightPin);
        fieldData[1] = analogRead(tempPin);
    //fieldData[2] = name;

    Serial.println("Posting!");
    postData(); // the postData() function does all the work, 
                // check it out below.

    delay(1000);
  }
#if 0 // don't use
  // Check for a new name input:
  if (Serial.available())
  {
    char c = Serial.read();
    if (c == '!')
    {
      newName = true;
      Serial.print("Your name is ");
      Serial.println(name);
    }
    else if (newName)
    {
      newName = false;
      name = "";
      name += c;
    }
    else
    {
      name += c;
    }
  }
#endif
}

void postData()
{
  // Make a TCP connection to remote host
  if (client.connect(server, 80))
  {
    // Post the data! Request should look a little something like:
    // GET /input/publicKey?private_key=privateKey&light=1024&switch=0&name=Jim HTTP/1.1n
    // Host: data.sparkfun.comn
    // Connection: closen
    // n
    client.print("GET /input/");
    client.print(publicKey);
    client.print("?private_key=");
    client.print(privateKey);
    for (int i=0; i<NUM_FIELDS; i++)
    {
      client.print("&");
      client.print(fieldNames[i]);
      client.print("=");
      client.print(fieldData[i]);
    }
    client.println(" HTTP/1.1");
    client.print("Host: ");
    client.println(server);
    client.println("Connection: close");
    client.println();
  }
  else
  {
    Serial.println(F("Connection failed"));
  } 

  // Check for a response from the server, and route it
  // out the serial port.
  while (client.connected())
  {
    if ( client.available() )
    {
      char c = client.read();
      Serial.print(c);
    }      
  }
  Serial.println();
  client.stop();
}

void setupEthernet()
{
  Serial.println("Setting up Ethernet...");
  // start the Ethernet connection:
  if (Ethernet.begin(mac) == 0) {
    Serial.println(F("Failed to configure Ethernet using DHCP"));
    // no point in carrying on, so do nothing forevermore:
    // try to congifure using IP address instead of DHCP:
    Ethernet.begin(mac, ip);
  }
  Serial.print("My IP address: ");
  Serial.println(Ethernet.localIP());
  // give the Ethernet shield a second to initialize:
  delay(1000);
}

Demo:

Serial Monitor

DHCP Clinet message
Press the button to send query to server, then postData() is called.
Confirm the response message

https://data.sparkfun.com/office_monitoring

Before sending query
//embedr.flickr.com/assets/client-code.js
After sending query : lux and temp are filed names.
//embedr.flickr.com/assets/client-code.js

How to connect mbed LPC114FN28 to AXEDA for Internet of Things?

Posted on March 4, 2015 by embeddist

This post shows how to connect mbed LPC114FN28 to AXEDA Service for Internet of Things.

mbed LPC1114FN28

platform partner : switch-science

The mbed LPC1114FN28 operates at CPU frequencies of 48 MHz. The LPC1114FN28 includes up to 32 kB of flash memory, up to 4 kB of data memory, one Fastmode Plus I2C-bus interface, one RS-485/EIA-485 UART, one SPI interface with SSP features, four general purpose counter/timers, a 10-bit ADC, and up to 22 general purpose I/O pins.

*http://developer.mbed.org/platforms/LPC1114FN28/

Note: LPC1114FN28 platform doesn’t support RTOS due to its flash size. Please do not import mbed-rtos library into your project.

mbed LPC1114FN28 has very limited size memory size and no Internet connectivity.
In addition, LPC114EN28 doesn’t support RTOS and EthernetInterface.

How to connect mbed LPC114FN28 to AXEDA (IoT Cloud Platform)?
An answer is WIZ550io.

WIZ550io is an auto configurable Ethernet controller that includes a W5500 (TCP/IP hardwired chip and PHY embedded), a transformer and RJ45. It supports Serial Peripheral Interface (SPI) bus as host interface. Therefore,
host system can be simply connect to Internet without EthernetInterface or TCP/IP software stack (included in RTOS).
http://developer.mbed.org/components/WIZ550io/

Hardware – mbed LPC1114FN28 + WIZ550io

mbed LPC1114FN28

WIZ550io: Ethernet Connectivity

pin name LPC1114FN28 direction WIZ550io

miso dp1 J1:3

sck dp6 —> J1:5

scs dp26 —> J1:6

RSTn dp25 —> J2:3
Potentiometer:

pin name LPC1114FN28 direction Potentiometer

AnalogIn dp13 <— 2(OUT)

pin name	LPC1114FN28	direction	WIZ550io
miso	dp1		J1:3
sck	dp6	—>	J1:5
scs	dp26	—>	J1:6
RSTn	dp25	—>	J2:3

pin name	LPC1114FN28	direction	Potentiometer
AnalogIn	dp13	<—	2(OUT)

Software – AxedaGo-mbedNXP + W5500Interface

Import AxedaGo-mbedNXP
- click and import this program : AxedaGo-mbedNXP
Change a platform as mbed LPC1114FN28
- This program is made for LPC1768. But, we will use LPC1114FN28. So, LPC1114EN28 is selected the right platform in the compiler.
Delete EthernetInterface and mbed-rtos on AxedaGo-mbedNXP_WIZ550io
Import W5500Interface
- click and import this program : W5500Interface
Porting main.cc
- For using WIZ550io, EthernetInterface Init. should be changed as below,

#if defined(TARGET_LPC1114)
    SPI spi(dp2, dp1, dp6); // mosi, miso, sclk
    EthernetInterface eth(&spi, dp25, dp26); // spi, cs, reset
    AnalogIn pot1(dp13);
#else
    EthernetInterface eth;
    AnalogIn pot1(p19);
    AnalogIn pot2(p20);
#endif

* AnalogIn ports should be also configured by depending on platform.

AXEDA

Ref.: Axeda Go Kit for mbed NXP LPC1768 Prototyping Board
- site link :http://developer.axeda.com/Instructions/axeda-go-kit-mbed-NXP-LPC176
make dashboard on Axeda
1. Click "AXEDA REDY"
2. Select mbed LPC1768 and enter device name
3. Copy serial number
4. input serial number in code(main.cc)

    char *SERIAL_NUM = "SerialNumber";

Enjoy AXEDA with LPC1114FN24 + WIZ550io

Before Enjoy Axeda, click the Compile button at the top of the page and download .bin on your platform.

Serial Terminal Log.
You will comfirm DHCP IP address, Protentiometer value and sending message in debugging message.
Connected to COM42.

initializing Ethernet
 - Ethernet ready
Ethernet.connecting 
 - connecting returned 0 
Trying to get IP address..
  -  IP address:192.168.13.53    //&lt;---  DHCP IP address 
Sending Value for well1 0.00     //&lt;--- Potentiometer value
Received 36 chars from server:   //sending message
HTTP/1.1 200 
Content-Lengtved 36 chars from server:
HTTP/1.1 200 
Content-Length: 0

Sending Value for well1 0.14     //&lt;--- Potentiometer value
Received 36 chars from server:   //sending message
HTTP/1.1 200 
Content-Length: 0

Sending Value for well1 0.27    
Received 36 chars from server:
HTTP/1.1 200 
Content-Length: 0

Sending Value for well1 0.29
Received 36 chars from server:
HTTP/1.1 200 
Content-Length: 0

Axeda Developer Toolbox
Your mbed board is now connected to your Axeda Toolbox account.
Open up the mbed Widget by proceeding to your dashboard from the staging page.

mbed LPC1114FN28

In Data Items, it is able to displays to Potentiometer values from LPC1114FN24 + WIZ550io with graphic line.
mbed LPC1114FN28

Comparison of mbed LPC1768 and mbed LPC1114FN28 for Axeda

	mbed LPC1768 (lwIP)	mbed LPC1114FN28 (WIZ550io)
Codes
Memory usage

In casd of mbed LPC1768, the code size for Axeda is more than double the size of the Flash memory of the LPC1114 to 66.8kB. On the other hand, memory usage of LPC1114FN28 + WIZ550io is 65% (20.8kB).

Get Codes

http://developer.mbed.org/users/embeddist/code/AxedaGo-mbedNXP_WIZ550io/

Firewall SoC with TCP/IP Offload Engine for Internet of Things

Posted on February 17, 2015 by embeddist

There is no doubt that the number of IoTs will increase explosively.

Gartner, Inc. forecasts that 4.9 billion connected things will be in use in 2015, up 30 percent from 2014, and will reach 25 billion by 2020.

As the IoT device continues to increase, IoT devices will be faced with the network flooding attack, such as DDoS, more frequently. However, because of its capacity of memory and MCU, nearly most IoT devices are very vulnerable to heavy network attacks and traffisc.

Weakness of these IoT device must be a great opportunity to TOE-embedded MCU, W7500. While TOE under Network attack is to reduce the MCU and memory resources of IoT device, because it is possible to protect the System of IoT device.

What is Firewall TCP/IP offload Engine for IoT?

Software TCP/IP stack

First, let’s examine the Software TCP/IP stack.

Software TCP/IP stack implemented on host system requires more capacity of extra memory and extra processing power for network communications. Normally, ARM Cortex-M core copies data from Ethernet MAC buffer to memory, analyze the received packets in memory using the software stack and then executes an appropriate process.

Software TCP/IP Stack

If network flooding attack has occurres, Cortex-M will repeatedly excute process in order to process flooding packets. Therefor, excessive number of TCP requests such as SYN-flooding attacks will overload the IoT device.

Hardware TCP/IP TOE

On the other hand, the hardware TCP/IP TOE, which is implemented as Hardwired logic from Ethernet MAC Layer to TCP/IP Layer, is able to protect IoT system against network attack under excessive number of flooding packet by making discard flooding packets detected.

Comparison of Software TCP/IP stack and Hardware TCP/IP TOE under the Network attack such as DDoS.

Hardware TCP/IP SoC

This means that Cortex-M does not have to handle the flooding packet even under Network attack. Further, because the TCP / IP stack processing is performed in TOE, it is possible to save the amount of memory for TCP/IP communications.

These TOE features are not to limited to the Network attack, it is also possible to expect the same performance under heavy network traffic.

We compared the network performance of software TCP/IP stack and Hardware TCP/IP TOE under DoS Attack (Syn-flood attack).

Comparison of Software and Hardware TCP/IP System

	Software TCP/IP	Hardware TCP/IP
Platform Pic.
Platform Name	mbed1768	W7500 EVB
Max Clock (MHz)	96	48
Flash (KB)	512	128
RAM (KB)	64	32
Use DMA	O	O
software	RTOS + lwIP	Non-OS + Fireware
Code size (KB)	Flash:64.5 / RAM:35.2	Flash: 9.09 / RAM: 8.99
Compiler	Web-compiler (mbed.org)	keil
Test tools	Iperf.exe, scapy (python)

Network configurations for Network Performancs tests

Network config

How to use iperf

Iperf is a tool to measure maximum TCP bandwidth, allowing the tuning of various parameters and UDP characteristics. Iperf reports bandwidth, delay jitter, datagram loss.

https://iperf.fr/

# ex.) host IP(192.168.77.34):port[5000], display format is Mbit/sec, interval 1 sec.
>iperf.exe -c 192.168.77.34 -p 5000 -f m -i 1

-c : –client host, -c will connect to the host specified.
-p : –port #, the server port for the server to listen.
-f : –format [], ‘m’ = Mbit/sec
-i : –interval #, Sets the interval time in seconds between periodic bandwidth through performance

Scripts for DoS Attack (Syn-flood attack)

We used the scapy (python library) as DoS Attack.

Scapy is a powerful interactive packet manipulation program. It can easily handle most classical tasks like scanning, tracerouting, probing, unit tests, attacks or network discovery.
http://www.secdev.org/projects/scapy/

from scapy.all import
inter = input('inter(time in seconds to wait between 2packets) :')

def synFlood(src, tgt, inter):
    IPlayer = IP(src, dst=tgt)
    TCPlayer= TCP(sport=3000, dport=3000) # as your env. change source and destination port
    pkt = IPlayer / TCPlayer
    send(pkt, loop=1, inter=inter) #

#send(pkts, inter=0, loop=0, verbose=None)
#  Send packets at layer 3, using the conf.L3socket supersocket. pkts can
#  be a packet, an implicit packet or a list of them.
#  loop: send the packets endlessly if not 0.
#  inter: time in seconds to wait between 2 packets
#  verbose: override the level of verbosity. Make the function totally silent when 0.
#   * Refer to http://www.secdev.org/projects/scapy/files/scapydoc.pdf for more detail.

# as your env. change to real IP address and so on.
src = "192.168.77.253" # PC IP address
tgt = "192.168.77.34"  # target board
synFlood(src, tgt, inter)

Network performance

Network_performance

It is possible to prove that the network performance of Hardware TCP/IP TOE is better and more stable than software TCP/IP stack under SYN flood attack. In particular, when interval is 0.001sec., the network performance of TOE is 9 times better than the software TCP/IP stack even though the platform embedded software TCP/IP stack is better than TOE platform.

It is confirmed that the Hardware TCP/IP TOE is able to maintain the network performance even if SYN-flood attack is increased. Otherwise, it is possible to observe that the network performance of software TCP/IP stack became extremely worse according to the interval of SYN-attack.

Firewall for Internet of Things

Posted on February 4, 2015 by embeddist

Intro

** What is a firewall for IoT ?**
– We will compare the traditional method and the proposed method under DoS Attack (SYN-flood attack).

IoT Platform: mbed NXP LPC1768

mbed LPC1768

It is based on the NXP LPC1768, with a 32-bit ARM Cortex-M3 core running at 96MHz. It includes 512KB FLASH, 32KB RAM and lots of interfaces including built-in Ethernet, USB Host and Device, CAN, SPI, I2C, ADC, DAC, PWM and other I/O interfaces. The pinout above shows the commonly used interfaces and their locations. Note that all the numbered pins (p5-p30) can also be used as DigitalIn and DigitalOut interfaces.
– Link1: For more detail

Traditional method: LwIP (TCP/IP software stack) + Ethernet MAC (LPC1768) + Ethernet PHY (DP83848J)@mbed application board (Ethernet connector)

mbed application board
* Feature list
* 128×32 Graphics LCD
* 5 way joystick
* 2 x Potentiometers
* 3.5mm Audio jack (Analog Out)
* Speaker, PWM connected
* 3 Axis /1 1.5g Accelerometer
* 3.5mm Audio jack (Analog In)
* 2x Servo motor headers
* RGB LED, PWM connected
* USB-mini-B Connector
* Temperature sensor
* Socket for for Xbee (Zigbee) or RN-XV (Wifi)
* RJ45 Ethernet Connector
* USB-A Connector
* 1.3mm DC Jack input

Link2: mbed application board in mbed.org

Proposed method: WIZ550io (TOE + Ethernet MAC + Ethernet PHY)

– Link3: WIZ550io components in mbed.org
– Link4: W5500 components in mbed.org

Application for iperf

Recv only code for Software stack

fixed an echo server on mbed.

#include "mbed.h"
#include "EthernetInterface.h"

EthernetInterface eth;
int main() 
{
    printf("Trying rn");
    // as your env. change to real IP address and so on.
    int ret = eth.init("192.168.77.34", "255.255.255.0", "192.168.77.1");    

    if (!ret) {
        printf("Initialized, MAC: %snr", eth.getMACAddress());
        printf("Connected, IP: %s, MASK: %s, GW: %snr",
               eth.getIPAddress(), eth.getNetworkMask(), eth.getGateway());
    } else {
        printf("Error eth.init() - ret = %dnr", ret);
        return -1;
    }

  eth.connect();
  printf("IP Address is %sn", eth.getIPAddress());

    TCPSocketServer server;
    server.bind(5000);
    server.listen();

    while (true) {
        printf("nWait for new connection...n");
        TCPSocketConnection client;
        server.accept(client);
        client.set_blocking(false, 1500); // Timeout after (1.5)s

        printf("Connection from: %sn", client.get_address());

        char buffer[2048];
        while (true) {
            int n = client.receive(buffer, sizeof(buffer));

            if (n < 0) break; // !_is_connected

        }
        client.close();
    }
}

Recv only code for TOE

#include <stdio.h>
#include <string.h>
#include "mbed.h"
#include "EthernetInterface.h"


//DigitalOut myled(LED1);
//Serial pc(USBTX , USBRX);
int main() {

    printf("Test - WIZ550iorn");

    /** Set the spi bus clock frequency
     *
     *  @param hz SCLK frequency in hz (default = 1MHz)
     *  Maximum SPI data bit rate of 12.5 Mbit/s in LPC176X
    */
    spi.frequency(12500000);     
    SPI spi(p5, p6, p7); // mosi, miso, sclk
    EthernetInterface eth(&spi, p8, p11); // spi, cs, reset

    // as your env. change to real IP address and so on.
    int ret = eth.init("192.168.77.34", "255.255.255.0", "192.168.77.1");    
    if (!ret) {
        printf("Initialized, MAC: %snr", eth.getMACAddress());
        printf("Connected, IP: %s, MASK: %s, GW: %snr",
               eth.getIPAddress(), eth.getNetworkMask(), eth.getGateway());
    } else {
        printf("Error eth.init() - ret = %dnr", ret);
        return -1;
    }

    printf("IP Address is %sn", eth.getIPAddress());

    TCPSocketServer server;
    server.bind(5000);
    server.listen();

    while (true) {
        printf("nWait for new connection...n");
        TCPSocketConnection client;
        server.accept(client);
        client.set_blocking(false, 1500); // Timeout after (1.5)s

        printf("Connection from: %sn", client.get_address());

        char buffer[2048];
        while (true) {
            int n = client.receive(buffer, sizeof(buffer));

            if (n < 0) break; // !_is_connected
        }
        client.close();
    }
}

Comparison of memory Size

	Software stack	TOE (W5500)
Codes
Memory usage

35.2kB(110%) : The LPC1768 has 3 RAM banks: One general purpose one of 32kB, and two additional ones of 16kB each for Ethernet/USB/CAN purposes. Ethernet completely fills one of those additional banks. The online compiler does take this into account for the total RAM usage, but assumes only 32kB is available, so it gets over the 100% what it displays, still will work fine though. (from mbed.org: http://developer.mbed.org/questions/3579/mbed-LPC-1768-RAM-Usage-128-what-does-th/)

** TOE can reduce the flash and RAM usage of by 7% and 119% respectively. **

DoS Attack (Syn-flood attack)

We used the scapy based on python library for DoS Attack.

from scapy.all import

inter = input('inter(time in seconds to wait between 2packets) :')

def synFlood(src, tgt, inter):
    IPlayer = IP(src, dst=tgt)
    TCPlayer= TCP(sport=3000, dport=3000) # as your env. change source and destination port
    pkt = IPlayer / TCPlayer
    send(pkt, loop=1, inter=inter) #

#send(pkts, inter=0, loop=0, verbose=None)
#  Send packets at layer 3, using the conf.L3socket supersocket. pkts can
#  be a packet, an implicit packet or a list of them.
#
#  loop: send the packets endlessly if not 0.
#  inter: time in seconds to wait between 2 packets
#  verbose: override the level of verbosity. Make the function totally silent when 0.
#   * Refer to http://www.secdev.org/projects/scapy/files/scapydoc.pdf for more detail.


# as your env. change to real IP address and so on.
src = "192.168.77.253" # PC IP address
tgt = "192.168.77.34"  # target board (LPC1768)

synFlood(src, tgt, inter)

How to use iperf

Iperf is a tool to measure maximum TCP bandwidth, allowing the tuning of various parameters and UDP characteristics. Iperf reports bandwidth, delay jitter, datagram loss

https://iperf.fr/

# ex.) host IP(192.168.77.34):port[5000], display format is Mbit/sec, interval 1 sec.
>iperf.exe -c 192.168.77.34 -p 5000 -f m -i 1

-c : –client host, -c will connect to the host specified.
-p : –port #, the server port for the server to listen.
-f : –format [], ‘m’ = Mbit/sec
-i : –interval #, Sets the interval time in seconds between periodic bandwidth
Through performance

Network Configuration

**Fig. Network configurations to measure performance **

Network performance

Fig. Traditional method: lwIP performance according to traffic of SYN packet
Fig. Proposed method: TOE(W5500) performance according to traffic of SYN packet.

**The network performance of traditional method is better the proposed method when DoS attack is weak. Because, the traditional method used the bus-interface for MAC. (The proposed method doesn’t used spi-dma.)
However, The proposed method kept up the network performance under SYN-flood attack.
Otherwise, the network performance of the traditional method is became extremely worse according to the interval of SYN-attack.
**

An Simple IoT example – connected CO2 Sensor with WIZ550S2E

Posted on December 22, 2014 by embeddist

WIZ5500S2E and S-300

This IoT example shows how to connect CO2 sensor to your ethernet network, and how to send sensing data by using Serial-to-Ethernet gateway module as UDP client. Using S-to-E gatewat module, your device does not need any additional codes and hardware requried.

In this example, WIZ550S2E-232 as a S-to-E module and S-300 as a CO2 sonsor module are used.

WIZ550S2E-232: This module is a gateway module that converts RS-232 protocol into TCP/IP protocol and enables remote gauging, remote management of the device through the network based on the Ethernet and the TCP/IP by connecting to existing equipment with RS-232 serial interface.
S-300: This SO2 (Carbon Dioxide) sensor module designed by ELT (http://eltsensor.co.kr/) and has available output with TTL-UART for sampling interval of about 3 seconds .

Block Diagram and Network Configurations

This figure is shown the block diagram and network configurations for this project.
- IoT Sensor Node is made up as follows
  - S-to-E : WIZ550S2E-232
  - CO2 Sonsor : S-300
  - UDP Client embedded on S-to-E
- Monitoring Server is composed as follows
  - UDP server : Hercules (TCP/IP utils) on PC
Serial-to-Ethernet Module : WIZ550S2E-232
- Gateway module that converts RS-232 protocol into TCP/IP protocol
- Serial to Ethernet Module based on W5500 & Cortex-M0
- RJ-45 mounted, Pin-header type module
- Serial signals : TXD, RXD, RTS, CTS, GND
- Support the configuration method of AT command & Configuration tool program
- Configuration tool program operates on Windows, Linux & MAC OS
- Support the interface board for RS-232 and RS422/485
- 10/100Mbps Ethernet & Max.230kbps serial speed
- Support WIZ VSP (Virtual Serial Port) program
- Dimension (mm) : 55(L) x 30 x 23.49 (H)
Co2 Sensor: ELT Sensor : S-300
- Non-Dispersive Infrared (NDIR) technology used to measure CO₂levels.
- Pre-calibrated
- Available outputs : TTL-UART, I2C, ALARM, PWM/Analog Voltage.
- Gold-plated sensor provides long-term calibration stability.
- Installed re-calibration function
- Operate as ACDL mode (Automatic Calibration in Dimming Light mode).
- Manual Re-Calibration function is executable.
- ROHS Directive- 2011/65/EU,[EN50581 : 2012,IEC 62321-3-1 : 2013]
- Size : 33mmx33mmx13.1mm
- Weight : 10 grams

Hardware connections

Three lines as below the may be connected for Sensor node.
The TXD in S-300 and RXD in WIZ550S2E should be connected together.

WIZ550S2E	Direction	S-300 JIG
RXD	<—	TXD
VCC(baseboard)	<—	VCC (5V)
GND		GND

WIZ550S2E
S-300 JIG

Software

WIZ550S2E Side: Sensor Node
- wiznet_configuration_tool is dedicated utility to configure the WIZ550S2E.
- WIZ550 Configruation Tool Download : wiznet_configuration_tool_ver1.02.zip
- WIZ550 Configruation Tool User Guide : WIZ550 Configruation Tool Guides
PC tools: Monitoring Server
- Herdules
  
  > Hercules SETUP utility is useful serial port terminal (RS-485 or RS-232 terminal) , UDP/IP terminal and TCP/IP Client Server terminal. It was created for HW group internal use only, but today it’s includes many functions in one utility and it’s Freeware! With our original devices (Serial/Ethernet Converter, RS-232/Ethernet Buffer or I/O Controller) it can be used for the UDP Config.
- Hercules download : version3.2.8
- Hercules user guide : User Guide

Setting

WIZ550S3E Side: Sensor Node
- Refer to User Guide for more details
  - Korean- user guide
  - English- user guide
PC tools: Monitoring Server

Excuting

UART frame of S-300
CO2 Data received from the Sensor node
CO2 Data shown in text format
CO2 Data shown in Hex format

souliss

Posted on November 20, 2014 by embeddist

souliss

Distributed Framework for Home Automation and Internet of Things

What’s Souliss?

It’s an open source framework which runs over multiple platfoms crossing different the phy layer, as like WiFi, Wireless, and ethernet.

Souliss can not only control and monitor your networked objects, but also share datas and have the trigger-based action from the shared data.

Platform for Souliss

Supports Hardware Platform
Arduino Boards
KMTronic DINo
Olimex AVR / OLIMEXINO boards
AirQ Network Boards
Tranceiver
AT86RF230
Nordic nRF24L01 and RF24L01+
WIZnet W5100 / W5200/ W5500
Micodhip ENC28J60

Souliss’s Materials

https://code.google.com/p/souliss/

List of Cloud Service appications for Openhardware

Posted on October 24, 2014 by embeddist

There are so many cloud-based service platform for Internet of Things.
The platform which is cobined by “Arduino + Ethernet shied” is chosen as their reference end-node device. So, I found the list cloud platform which uses Ethernet shield for their device.

#Cloud Service는 이제 Smart phone으로 대표되는 Smart Device만의 전유물리 아닌 #IoT의 화두가 되었습니다.

Xively가 처음 보여주었던 #Visualization은 물론이고 이제는 #Log, #Trigger, #Alert까지 그 기능이 확대되고 있습니다.

쉽게 말씀드리면, IoT Device가 보내온 데이터를 수신한 Cloud Server는 그 데이터를 수신하여 그 데이터를 기반으로 (log) 임의의 설정 값과 비교하여 설정값에서 (Trigger) Twitter같은 SNS와 연동하여 개인에게 메시지를 (Alert)를 보내고 있습니다. 한마디로 IoT / SNS / Cloud 의 장벽이 모호해지고 있습니다.

아래에 리스트된 Could Service업체들은 Arduino Platform이 IoT Device에 가능하면서 Ethernet혹은 WiFi를 가진 업체들입니다. 아래의 업체들도 지원하겠지만, 3G/BLE/Zigbee등을 지원하는 업체까지 포함하면 더욱 많은 업체들이 있습니다.

친근하게 접할 수 있는 OpenHardware Platform인 Arduino에서 Ethernet Shield에 적용한 업체들의 Blog/Github/Website/Forum을 살펴보았습니다.

리스트업해보니 Cloud Service의 IoT Node가 갖추어야할 요소기술 (Restful, CoAP, MQTT, IFHTTP, PHTTP…)에 대해서도 살펴봐야겠습니다.

Carriots : www.carriots.com

Ethernet Shield
Blog	http://yczhu.org/author/zyc262626/
Carriots Forum	http://forum.carriots.com/index.php/topic/4-arduino-connection-to-carriots/

WiFi : CC3000 설명이 제세하네요
Adafruit:Learn	https://learn.adafruit.com/wireless-gardening-arduino-cc3000-wifi-modules/introduction

nimbits : http://www.nimbits.com/

Ethernet Shield
Nimbits Blog	http://nimbits.blogspot.kr/2010/11/data-in-connect-arduino-to-cloud.html
Nimbits Github	https://github.com/bsautner/com.nimbits/blob/master/samples/arduino/NimbitsClient/examples/SocketExample/SocketExample.ino

-evrythng : www.evrythng.com/

WIZ550io
5.Mbed.org	https://developer.mbed.org/teams/EthernetInterfaceW5500-makers/code/EvrythngApiExampleW5500/

-grovestreams : www.grovestreams.com

Ethernet Shield
Grovestreams web	https://grovestreams.com/developers/getting_started_arduino_temp.html

-Lelylan : http://www.lelylan.com/

Ethernet Shield
github	https://gist.github.com/andreareginato/6725485

exsite : http://exosite.com/

Ethernet Shield
Arduino.cc	http://playground.arduino.cc/Code/Exosite

Axeda : www.axeda.com

Ethernet Shield (SEEED Ethernet Shield (v1.0 or v2.0))
Axeda web	http://developer.axeda.com/Instructions/axeda-go-kit-arduino-Mega-2560

Xively : www.xively.com

Ethernet Shield
github	https://github.com/xively/xively_arduino

BlueMix : http://www-01.ibm.com/software/ebusiness/jstart/bluemix/

Ethernet Shield
IBM web	http://www.ibm.com/developerworks/cloud/library/cl-bluemix-arduino-iot2/index.html

Temboo : https://www.temboo.com

Ethernet Shield
Temboo	https://www.temboo.com/arduino/others/getting-started
embeddist	https://embeddist.wordpress.com/2014/10/15/arduino-with-temboo/

Embedded System, TCP/IP Stack, SoC, Open Source Hardware

Prepare materials

Software

Codes flow

Demo

Serial Monitor

analog.io: import stream from data.sparkfun.com/your_stream

How to push data to data.sparkfun.com for Internet of Things

data.sparkfun.com

Prepare materials

Software

Codes flow

Arduino’s I/O pins:

Phant Stuff

Make Query string over HTTP

Phant_Ethernet.ino

Demo:

Serial Monitor

mbed LPC1114FN28

Hardware – mbed LPC1114FN28 + WIZ550io

Software – AxedaGo-mbedNXP + W5500Interface

AXEDA

Enjoy AXEDA with LPC1114FN24 + WIZ550io

Comparison of mbed LPC1768 and mbed LPC1114FN28 for Axeda

Get Codes

What is Firewall TCP/IP offload Engine for IoT?

Software TCP/IP stack

Hardware TCP/IP TOE

Comparison of Software TCP/IP stack and Hardware TCP/IP TOE under the Network attack such as DDoS.

Comparison of Software and Hardware TCP/IP System

Network configurations for Network Performancs tests

How to use iperf

Scripts for DoS Attack (Syn-flood attack)

Network performance

Intro

IoT Platform: mbed NXP LPC1768

Traditional method: LwIP (TCP/IP software stack) + Ethernet MAC (LPC1768) + Ethernet PHY (DP83848J)@mbed application board (Ethernet connector)

Proposed method: WIZ550io (TOE + Ethernet MAC + Ethernet PHY)

Application for iperf

Recv only code for Software stack

Recv only code for TOE

Comparison of memory Size

DoS Attack (Syn-flood attack)

How to use iperf

Network Configuration

Network performance

Block Diagram and Network Configurations

Hardware connections

Software

Setting

Excuting

souliss

What’s Souliss?

Platform for Souliss

Souliss’s Materials