David Smart / Mbed 2 deprecated Smart-WiFly-WebServer

A sample program demonstrating a small but powerful web server using the Wifly module. This uses several libraries from others, but has a custom version of the WiflyInterface library, with numerous improvement to the mbed standard library.

Dependencies:   SW_HTTPServer WiflyInterface mbed C12832 IniManager

Here's the code

But you also might want to check out the SmartBoard-WiFly project page.

Basic Web Server

• Serves static files from the selected file system. This is a compile-time setting, and a typical configuration supports gif, jpg, jpeg, ico, png, zip, gz, tar, txt, pdf, htm, and html.
• It is designed to be small, thereby better supporting the limited resources of an embedded environment.

Advanced Web Services

• Serves dynamically generated pages, where your software registers for a path, and then everything to that path activates your handler. Your handler then defines the header and body response.
• Dynamic handlers can process GET query parameters (e.g. /dyn1?sky=blue&grass=green).
• Dynamic handlers can process POST query parameters, as delivered from submission of a form.
• Dynamic handlers can protect a resource with user:password access.

Run-Time Configurations

• File System Support - using either the "local" file system supported by the magic chip, or from either an SD-Card or a USB flash drive.
• Configurable to the maximum number of dynamic handlers (minimize memory requirements).
• Configurable to the maximum number of name=value pairs for dynamic handlers (minimize memory requirements).

Compile-Time Configurations

• Default filename for URL ending in '/' - default is 'index.htm'.
• Configurable buffer sizes permit minimizing RAM requirements.
• Configurable header response information.
• Configurable for which serial port is used to communicate to the WiFly module.
• Improved security option - to disable telnet access.

Diagnostics

• API to determine the largest header (to more efficiently size the buffers).
• API to gather the run-time characteristics - header processing time and content delivery time.

Limitations / Constraints

Known Issues

These are known issues, not yet resolved.

1. Occasionally fails to serve a page - one test will constantly reload a web page every 30 seconds. It may run for hours, or minutes, then fail to load. Behaviors then are:
   • Hit the reload button in the browser and away it goes.
   • Hit the reload and you'll see the Wifly LEDs energize from the request, but no response by the web server. It appears that the embedded code does not "accept()" the connection in the TCP Socket Server.
     • In this case, the Wifly module has gone through an internal watchdog reset and the configuration parameters are such that it does not gracefully recover. Microchip is aware of this issue, but has not solved it.

Wifly Limitations

• Single thread - it doesn't respond to overlapping requests (e.g. an embedded image may be requested before the main page completes transfer - the request is lost and the image not shown).
• Single client - goes along with the single thread, but it doesn't support more than one client at a time.

Smart-Wifly-WebServer

• Dynamic memory allocation - it does use dynamic memory allocation, which would be discouraged/avoided in many embedded systems. Here it uses it in parsing a request and it releases those resources upon completion of that request. If there is no other dynamic allocation that persists beyond a transaction, it should not cause memory fragmentation. Note that with multi-threading (if this is implemented with an OS), you then have race conditions that could cause fragmentation.

Web Server

Here's the web server in action. A combination of static pages served from the file system and dynamically generated pages.

	Part of the main demo page, which basically has all the specifications, configurations, and limitations.
	A zoomed out view of the same page.
	It would be possible to configure the server via the web.
	One of the dynamically generated pages. This one has parsed the query parameters.
	A simple form which has a dynamic handler on the back end. Here it takes the value associated with "leds" and uses that to set the 4 LEDs on the mbed module.
	A dynamic handler can require authentication.
	Success!

But I've now gone so far beyond that in the current version. Here's what this one can do:

1. It serves static web pages from a file system. I've only tested with the local file system and an SD card, but should work for any, so long as you remember that the local file system can't read subdirectories.
2. It can serve dynamically generated web pages. This lets you accept name=value pairs using the URL (using either a GET or POST method). It can also accept them from forms. The demo lets you control the 4 LEDs from a form.
3. As safely as possible it retrieves your credentials to the Wi-Fi Access Point. After using them, it overwrites that ram so they can't be as easily extracted.
4. I made a large number of changes to the Wifly driver. It had too short of a timeout and I found quite a number of optimizations for performance and robustness.
5. I have the start on a security feature - you can configure a resource to require user credentials to access it. The browser typically provides a username and password dialog. Take care however, as it does not support a secure (https) connection, so the credentials are not as securely transferred as I would like.

Optimizations I'd like to do:

1. speed it up - I'm running the mbed to wifly module interface at 230K, which is about the top speed w/o flow control. There are other places where some time delays remain - I have eliminated a number of them.
2. make it non-blocking, so other work can happen.
3. integrate it with the rtos
4. When a web page has referenced resources (e.g. an image tag), it rarely loads the image on the first try. I think the request for the resource comes in while it is still in the WiflyInterface cleaning up from the last connection. The Wifly module supports only a single connection at a time. I worked around this with a small bit of javascript to load the images after the web page.

But all in all I think it is a good start.

Program prerequisite

Here's the link to the program, but when you open it up, note a few very important items.

1. Port Numbers listed in the constructor match the SmartBoard Baseboard.
2. I sped up the communication baud rate to the mbed from the default 9600. Match your terminal program accordingly.
3. Download this zip. Place it and an unzipped copy into the mbed local file system. These are the demo files.
4. The typical ssid and password are not shown. See below to set yours.

ssid and password

You need to create a simple text file on your mbed root folder named "config.ini". The easiest way perhaps is to create "config.txt", add the information shown below and then rename it. This will be read at startup to connect you to the network. Something quite simple, like this:

[Wifi]
ssid=your_ssid
pass=your_pass_code

The program

And the program.

--- a/main.cpp	Mon Aug 12 23:06:52 2013 +0000
+++ b/main.cpp	Sun Sep 01 19:54:42 2013 +0000
@@ -1,22 +1,26 @@
 /** @file main.cpp contains the main program that a user would write.
  * see the documentation above "main"
  */
-#include "mbed.h"               // ver 63
+#include "mbed.h"               // ver 66
 //#include "SDFileSystem.h"       // ver 2, standard
 
 // Modified standard components
-#include "WiflyInterface.h"     // ver 4+, derived from version 4 with my mods
+#include "WiflyInterface.h"     // ver 33, derived from version 4 with my mods
 
 // My components
+#include "SW_HTTPServer.h"      // ver 16, the initial release.
+
+// Project features
 #include "Utility.h"
 #include "Credentials.h"        // ver 0, credential manager
-#include "SW_HTTPServer.h"      // ver 0, the initial release.
+
 #include "DynamicPages.h"       // my dynamically generated pages
+#include "SecurePage.h"         // my secure pages
 #include "ServerConfig.h"
+
 #define HTTP_SERVER_PORT 80
 
 Serial pc(USBTX, USBRX);
-//BusOut testLEDs(LED2, LED1);
 
 LocalFileSystem local("local");         // some place to hold settings and maybe the static web pages
 //SDFileSystem sd(p5, p6, p7, p8, "sd");  // for the static web pages
@@ -26,9 +30,10 @@
 InterruptIn button(p24);
 DigitalIn actStatus(p24);
 
+Timer onceinawhile;
+
 void flip() {
     act = actStatus;
-    //pc.printf("**** FLIP %d\r\n", actStatus.read());
 }
 
 // A time-bound hook on startup to permit the user to access the wifly module
@@ -39,7 +44,7 @@
     const int baudrates[] = {2400, 4800, 9600, 19200, 38400, 57600, 115200, 230400};
     static int i = 0;
     
-    pc.printf("Pausing 5 sec for user to interact with WiFly (press <enter>).\r\n");
+    pc.printf("Pausing 5 sec for shell access to WiFly (press <enter>).\r\n");
     userTimer.start();
     do {
         if (pc.readable()) {
@@ -73,7 +78,7 @@
             }
         }
     } while (userTimer.read_ms() < 5000);
-    pc.printf("shell closed.\r\n");
+    pc.printf("  WiFly shell closed.\r\n");
 }
 
 
@@ -119,35 +124,20 @@
     credentials cr;     // handles the credentials
 
     pc.baud(460800);    // I like a snappy terminal, so crank it up!
-
     pc.printf("\r\nSmart WiFly - Build " __DATE__ " " __TIME__ "\r\n");
 
     if (!ReadCredentials("/local/user.crd", &cr)) {
         pc.printf("**** ERROR, no /local/user.crd file was found. ****\r\n");
-        pc.printf("     Nothing else I can do until you fix this.\r\n");
         wait(1.0);
-        error("     Waiting for user to fix this problem.         \r\n");       // flash and die
+        error("     Waiting for user to fix this problem.         \r\n"); // flash and die
     }
 
-    // instantiate the WiflyInterface, then release the credentials
+    // Instantiate the WiflyInterface
     WiflyInterface wifly(p28, p27, p23, p24, cr.ssid, cr.pass, WPA);
+    // Release the credentials, which also secures them
     FreeCredentials(&cr);
 
-
-    // baud test
-#if 0
-    wifly.init(); // start it up as a client of my network using DHCP
-    const int testBauds[] = {9600, 2400, 12345, 19200, 2400, 4800, 115200, 230400, 230400, 4800, 2400, 57600};
-    for (int i=0; i<(sizeof(testBauds)/sizeof(testBauds[0])); i++)
-        {
-        int r = wifly.baud(testBauds[i]);
-        pc.printf("wifly.baud(%d) returned %d\r\n\r\n", testBauds[i], r);
-        }
-    pc.printf("wifly.baud() test complete.\r\n");
-    while (1)
-        ;
-#endif
-
+    // Bring the WiFly interface online
     do {
         wifly.init(); // start it up as a client of my network using DHCP
         wifly.baud(230400);     // Only 230K w/o HW flow control
@@ -158,7 +148,7 @@
         wifly.reset();
     } while (1);
 
-    WiFlyShell(wifly, pc);
+    WiFlyShell(wifly, pc);  // 5 second access at startup - in case you need it.
 
     // Now let's instantiate the web server - along with a few settings:
     // the Wifly object, the port of interest (typically 80),
@@ -167,32 +157,32 @@
     // the maximum number of dynamic pages that can be registered,
     // the serial port back thru USB (for development/logging)
     HTTPServer svr(&wifly, HTTP_SERVER_PORT, "/local/", 15, 30, 10, &pc);
-    pc.printf("Connect to this server at http://%s\r\n", wifly.getIPAddress());
+    pc.printf("Connect to this server at http://%s:%d\r\n", wifly.getIPAddress(), HTTP_SERVER_PORT);
 
     // But for even more fun, I'm registering a few dynamic pages
-    // which you see the handlers for in DynamicPages.cpp.
+    // You see the handlers for in DynamicPages.cpp.
     // Here you can see the path to place on the URL.
     // ex. http://192.168.1.140/dyn
     svr.RegisterHandler("/dyn",  SuperSimpleDynamicPage);
     svr.RegisterHandler("/dyn1", SimpleDynamicPage);
     svr.RegisterHandler("/dyn2", SimpleDynamicForm);
-
     svr.RegisterHandler("/pass", SimpleSecurityCheck);
-    
     svr.RegisterHandler("/config", ServerConfig);
 
     // Let the human know it is ready - if they are watching
     pc.printf("Waiting for a connection...\r\n");
 
-// wifly active pin    
+// wifly active pin
 button.rise(&flip);
 button.fall(&flip);
-    
+
+    onceinawhile.start();
     while (true) {
-        //if (testLEDs == 1)
-        //    testLEDs = 2;
-        //else
-        //    testLEDs = 1;
+        if (onceinawhile.read_ms() >= 1000)
+            {
+            onceinawhile.reset();
+            pc.printf("Largest free mem block is %d\r\n", Free());
+            }
         svr.Poll();   // non-blocking, but not deterministic
         //pc.printf("this %d, longest %d\r\n", thisRun, longestRun);
         if (pc.readable())