Dynamically Adding Elements to Zend_Form

There have been some requests on the Zend Framework mailing lists for information on how to dynamically add elements to Zend_Form.  This is something that I’ve been looking into myself, and I’d like to share what I’ve come up with.

Please note that this code is a proof of concept / request for peer review detailing the work that I’ve done to date, and not an example of what I might consider the best way to address this use case.  Special thanks go to Cory Wiles who helped me think things through when I first started giving this a go.

First, let’s do a high level walk through of what the code is going to do, then take a look at the code, and wrap up with a live example.

High Level Overview

The form in this example extends Zend_Form and consists of a hidden element that stores an ID, a single text element, buttons for adding and removing dynamic elements, and a submit button.  The add and remove buttons are used to trigger a jQuery script that adds and removes dynamic elements. The jQuery script uses the value of the hidden ID element to set element order and make the dynamic element names and IDs unique.

The form class consists of the standard init() method for building the form and two custom methods for dealing with dynamic elements.  There is a preValidation() method, called after the form is submitted but before it is validated, that searches the submitted form data for dynamically added fields.  If any new fields are found, the addNewField() method takes care of adding the new fields to the form.

jQuery is used to request the new form element from the form’s Controller via Ajax, utilizing the AjaxContext action helper. jQuery is also used to find the most recently added dynamic element, allowing for easy removal of dynamically added elements from the form.

The action controller contains the action that displays the form, and it also has a newfieldAction() that utilizes the AjaxContext to return markup for new fields.

The Zend_Form Subclass

Let’s start with the code for the form.  The most important item here is that each form element has its order property set.  You can see the huge jump in the order between the “name” element and the  “addElement” button.  This gap occurs so the dynamic elements can be placed exactly where I want them and so they’ll maintain their position in the form once they’ve been added to the form object.

public function init() {
 
  $this->addElement('hidden', 'id', array(
    'value' => 1
  ));
 
  $this->addElement('text', 'name', array(
    'required' => true,
    'label'    => 'Name',
    'order'    => 2,
  ));
 
  $this->addElement('button', 'addElement', array(
    'label' => 'Add',
    'order' => 91
  ));
 
  $this->addElement('button', 'removeElement', array(
    'label' => 'Remove',
    'order' => 92
  ));
 
  // Submit
  $this->addElement('submit', 'submit', array(
    'label' => 'Submit',
    'order' => 93
  ));
}

Action Controller

The action that displays the form is straightforward.  If you’ve ever done any work with Zend_Form, I’m sure you recognize what’s going on here.  The only thing to note is the $form->preValidation() method.  That’s where the magic happens.  We’ll get to that in a bit.

/**
 * Shows the dynamic form demonstration page
 */
public function dynamicFormElementsAction() {
 
  $form = new Code_Form_Dynamic();
 
  // Form has not been submitted - pass to view and return
  if (!$this->getRequest()->isPost()) {
    $this->view->form = $form;
    return;
  }
 
   // Form has been submitted - run data through preValidation()
  $form->preValidation($_POST);
 
   // If the form doesn't validate, pass to view and return
  if (!$form->isValid($_POST)) {
    $this->view->form = $form;
    return;
  }
 
   // Form is valid
  $this->view->form = $form;
}

Next comes the controller’s newfieldAction().  This action utilizes the AjaxContext action helper to pass the new field’s markup back to the form view.

/**
 * Ajax action that returns the dynamic form field
 */
public function newfieldAction() {
 
  $ajaxContext = $this->_helper->getHelper('AjaxContext');
  $ajaxContext->addActionContext('newfield', 'html')->initContext();
 
  $id = $this->_getParam('id', null);
 
  $element = new Zend_Form_Element_Text("newName$id");
  $element->setRequired(true)->setLabel('Name');
 
  $this->view->field = $element->__toString();
}

jQuery

The jQuery script is also fairly straightforward.  I attach event listeners to the “Add” and “Remove” buttons that call the ajaxAddField and removeField methods respectively.

The ajaxAddField method makes a post request to the newfieldAction using jQuery’s .ajax method, passing in the current value of the hidden ID element.  On success, the new element’s markup is added to the form, and the ID is incremented and stored in the hidden ID element.

The removeField method finds the last element in the page with the class dynamic, removes it, then decrements the current ID and stores the new value in the hidden ID element.

<script type="text/javascript">
 
$(document).ready(function() {
 
  $("#addElement").click( 
      function() { 
          ajaxAddField();
       }
    );
 
  $("#removeElement").click(
      function() {
          removeField();
      }
    );
  }
);
 
// Get value of id - integer appended to dynamic form field names and ids
var id = $("#id").val();
 
// Retrieve new element's html from controller
function ajaxAddField() {
  $.ajax(
    {
      type: "POST",
      url: "<?=$this->url(array('action' => 'newfield', 'format' => 'html'));?>",
      data: "id=" + id,
      success: function(newElement) {
 
        // Insert new element before the Add button
        $("#addElement-label").before(newElement);
 
        // Increment and store id
        $("#id").val(++id);
      }
    }
  );
}
 
function removeField() {
 
  // Get the last used id
  var lastId = $("#id").val() - 1;
 
  // Build the attribute search string.  This will match the last added  dt and dd elements.  
  // Specifically, it matches any element where the id begins with 'newName<int>-'.
  searchString = '*[id^=newName' + lastId + '-]';
 
  // Remove the elements that match the search string.
  $(searchString).remove()
 
  // Decrement and store id
  $("#id").val(--id);
}
</script>

Zend_Form: preValidation() and addNewField()

Now on to the fun stuff.  All of the code up to this point is present to support what happens in the form’s preValidation() method.  Remember that preValidation() is called after the form has been submitted but before the form is validated.  preValidation() searches through the submitted form’s data for new fields.  If it finds any new fields, it calls addNewField() and adds the new fields to the form object.  By adding the new form fields to the form object before validation, any filters and validators attached to the new fields will be run as if those fields had always existed in the form object.

/**
 * After post, pre validation hook
 * 
 * Finds all fields where name includes 'newName' and uses addNewField to add
 * them to the form object
 * 
 * @param array $data $_GET or $_POST
 */
public function preValidation(array $data) {
 
  // array_filter callback
  function findFields($field) {
    // return field names that include 'newName'
    if (strpos($field, 'newName') !== false) {
      return $field;
    }
  }
 
  // Search $data for dynamically added fields using findFields callback
  $newFields = array_filter(array_keys($data), 'findFields');
 
  foreach ($newFields as $fieldName) {
    // strip the id number off of the field name and use it to set new order
    $order = ltrim($fieldName, 'newName') + 2;
    $this->addNewField($fieldName, $data[$fieldName], $order);
  }
}
 
/**
 * Adds new fields to form
 *
 * @param string $name
 * @param string $value
 * @param int    $order
 */
public function addNewField($name, $value, $order) {
 
  $this->addElement('text', $name, array(
    'required'       => true,
    'label'          => 'Name',
    'value'          => $value,
    'order'          => $order
  ));
}

Live Example

If you’d like to see working version of this proof of concept, please visit the live example at code.jeremykendall.net.

Summary

The ability to dynamically add form fields to Zend_Form is a feature I’d really like to see added to Zend_Form.  If I were talented enough, I might attempt to make a formal proposal myself.  In the meantime, what I’ve come up with can perhaps serve as a starting point for adding very simple elements to very simple forms.

Thanks again to Cory Wiles for helping me work out some of the kinks during the planning phase. Any mistakes, bad practices, or egregious coding errors are the result of my implementation, not his insight and suggestions.

Request for Comments / Peer Review

If you’ve made it this far, I’m grateful to you for hanging in with me.  If you have suggestions for improvements to the code, an implementation of your own, or if you see mistakes I’ve made or poor practices that I’ve employed, I’d appreciate your input.  Thank you in advance for taking the time to discuss this concept with myself and with the ZF community at large.

Full Controller, Form, and View Code

If you’re interested in the complete code for the controller, form, and views, I’ve posted them over at pastebin. Follow the links below to view / grab the code.

Further reading:

Zebra Tables with jQuery

I’ve used the classic A List Apart Zebra Tables technique to stripe my tables for years.  It’s always worked well, and I never really considered updating the technique until last week.  I’ve been making heavy use of the jQuery library lately, and I really disliked including another external js file whenever I wanted to stripe a table, so I thought I’d see if someone had come up with a jQuery friendly table striping technique.  It took about 10 seconds on Google to find what I was looking for, and the solution was so simple and elegant that I wanted to kick myself for not thinking of it, er, myself.

For the whole scoop, head over and read the tutorial.  If you’re like me, you want to get right to the point, so here goes.

The idea is to use jQuery to select alternate rows from your table and apply a css class to them. In the example below, the table has a class of ‘striped’ and jQuery adds the class ‘alt’ to the even rows.

$(document).ready(function(){
    $(".striped tr:even").addClass("alt");
});

Whip up a little css that adds a background color to .alt and you’re done. Not bad, huh?

The tutorial author also included an example of jQuery code that allows for a nice hover effect when you mouse over the table rows.  I wasn’t as interested in that, so you’ll have to head over there for the scoop.

Dynamic Content on Static Pages using Zend Json and jQuery

The Problem

One of the most highly trafficked sites on the intranet where I work is the cafeteria’s web site.  Employees from all across the enterprise visit daily to see what’s on the menu.  Maintaining the menu pages on the cafeteria site has been a constant challenge for our content folks.

As the bulk of our intranet is still mostly static (PHP isn’t even installed on our main intranet box), our content people have to work really hard to keep the menu up-to-date.  The process consists of the cafeteria folks emailing an updated menu over to our content people and our content folks manually updating the menu’s html.  Since the cafeteria is open seven days a week, that means our content folks have to manage eight separate pages: the cafeteria homepage featuring the current day’s menu in a side bar and separate menu pages for each day of the week.

The Solution, Almost

The solution to this issue began with a simple Java CRUD app, allowing the cafeteria employees to manage the menu themselves.  The “Menu Builder” application spits out an XML document for consumption on the cafeteria website.  During the development process, I extended Zend_Http_Client and wrote a simple index page to parse the XML for display.  While the PHP solution for displaying the menu was nice, clean, and simple, it turned out to be completely useless.

As I mentioned above, the majority of our intranet is still running on a server without PHP installed.  We’re working to move away from that server, but the process is slow and painful.  Without the ability to use PHP to serve the daily menu, we had to come up with something else.  AJAX was the obvious choice, but how to deal with the fact that we’d have to make cross-domain requests in order to retrieve the application’s XML output?

Cross-Domain JSON with jQuery

After a little digging around, one of my co-workers turned me on to jQuery and JSONP.  As of version 1.2, jQuery provides native support for JSONP, a method of retrieving JSON data across domains.  The implementation can be found in jQuery.getJSON.

Once the decision was made to utilize jQuery’s getJSON, I had to come up with a way to convert the menu’s XML output to JSON.  Since the Menu Builder app was already spitting out XML, there was no way I was going to add a module to the application to support the new JSON requirement.  I needed a simple way to convert XML to JSON, and I didn’t want to spend any time rolling my own solution.

Zend Framework to the Rescue

Since we’re already using Zend Framework on our intranet, I decided to look to Zend Json and see if it could do the job.  Sure enough, there’s a static fromXml() method that takes care of the conversion beautifully.

After that, it was fairly quick work to create some JavaScript functions to parse the returned JSON and display it on the cafeteria website.

[Side note: As of ZF 1.6, the Dojo JavaScript library is integrated with Zend Framework.  Well before that integration occurred, we made the decision that jQuery would be our library of choice.  That's why I'm using jQuery for this solution rather than Dojo.]

The Code

First is an example of the XML returned from the Menu Builder application.

<?xml version="1.0" encoding="UTF-8"?>
<menu>
  <timeStamp>Thu Oct 16 13:18:50 CDT 2008</timeStamp>
  <day>Thursday</day>
  <date>October 16, 2008</date>
  <meal descr="Breakfast Feature">
    <category descr="None (will not display to users)">
      <item>
        <itemdescr>French Toast</itemdescr>
        <itemprice>0.45</itemprice>
      </item>
      <item>
        <itemdescr>Biscuit</itemdescr>
        <itemprice>0.25</itemprice>
      </item>
    </category>
  </meal>
  <meal descr="Lunch">
    <category descr="Grab &amp; Go">
      <item>
        <itemdescr>Garden Vegetables</itemdescr>
        <itemprice>0.89</itemprice>
      </item>
    </category>
    <category descr="Papa J's Pizza by the Slice">
      <item>
        <itemdescr>Sausage Egg &amp; Cheese Biscuit</itemdescr>
        <itemprice>2.09</itemprice>
      </item>
    </category>
  </meal>
</menu>

Running the above XML through Zend_Json::fromXml() provided me with the JSON representation I needed.

{
    "menu": {
        "timeStamp": "Thu Oct 16 13:18:50 CDT 2008",
        "day": "Thursday",
        "date": "October 16, 2008",
        "meal": [
            {
                "@attributes": {
                    "descr": "Breakfast Feature"
                },
                "category": {
                    "@attributes": {
                        "descr": "None (will not display to users)"
                    },
                    "item": [
                        {
                            "itemdescr": "French Toast",
                            "itemprice": "0.45"
                        },
                        {
                            "itemdescr": "Biscuit",
                            "itemprice": "0.25"
                        }
                    ]
                }
            },
            {
                "@attributes": {
                    "descr": "Lunch"
                },
                "category": [
                    {
                        "@attributes": {
                            "descr": "Grab &amp; Go"
                        },
                        "item": {
                            "itemdescr": "Garden Vegetables",
                            "itemprice": "0.89"
                        }
                    },
                    {
                        "@attributes": {
                            "descr": "Papa J's Pizza by the Slice"
                        },
                        "item": {
                            "itemdescr": "Sausage Egg &amp; Cheese Biscuit",
                            "itemprice": "2.09"
                        }
                    }
                ]
            }
        ]
    }
}

As you can see in the samples above, menu items belong to categories and categories belong to meals. Both meals and categories are described in XML attributes rather than in a description node.

Next is the PHP script that I wrote to get the menu XML, convert it to JSON, and echo it out to the jQuery.getJSON call.

// Include required files
require_once dirname(dirname(dirname(__FILE__))).'/cafeteria/lib/base.php';
 
// Set service uri
$uri  = $cafeteriaConfig->menu->serviceuri;
 
// Valid days of the week
$validDays = array('monday', 'tuesday', 'wednesday', 'thursday', 'friday', 'saturday', 'sunday');
 
// Get day from querystring, validate
if (isset($_GET['day'])) {
 
  $getDay = $_GET['day'];
 
  if (in_array($getDay, $validDays)) {
    $day = $getDay;
    $uri = $uri . '?day=' . $day;
  }
 
}
 
// Get xml from cafeteria service
$xml = file_get_contents($uri);
 
// Encode returned xml as JSON, do not ignore XML attributes
$json = Zend_Json::fromXml(trim($xml), false);
 
// Return response, wrapping response in the requested callback
// @see http://remysharp.com/2007/10/08/what-is-jsonp/
// @see http://docs.jquery.com/Release:jQuery_1.2/Ajax
echo $_GET['callback'] . '(' . $json . ')';

There are a couple of important things to note in the script above.

First, we keep a lot of code in a base.php file. This includes Zend_Loader::registerAutoload() and the creation of a Zend_Config object, among other things, allowing for much DRYer code.

Second, you’ll notice that I’m using the second, optional parameter for fromXml().  Set to false, fromXml() will return a representation of the XML attributes present in the input.  fromXml() ignores XML attributes by default.

Finally, you can see how the callback name and parentheses are wrapped around the returned JSON before outputting anything back to jQuery.getJSON.  This is required.  Without it, your cross-domain request won’t return anything at all.

The next bit of code is the JavaScript that parses the returned JSON and outputs the full menu to the web.  Notice that there are two output functions.  This is to allow for two different styles of menu tables: one for the cafeteria homepage (sidebar), and one for the daily menu page (full sized).

// Parses JSON representation of cafeteria menu and returns Menu table
// Requires jQuery
 
var menu = '';
 
// Builds sidebar menu for cafeteria home page
function outputSidebarMenu(json) {
	var day = json.menu.day;
	var heading = '<h4><a href="' + menuLink + '?requestedDay=' + day.toLowerCase() + '">' + day + "'s Menu</a></h4>\n";
	menu = '<table id="side_datatable">' + getMeals(json.menu.meal) + '</table>';
	return timeStampComment(json) + heading + menu;
}
 
// Builds table for daily menu page
function outputDailyMenu(json) {
	var day = json.menu.day;
	var date = json.menu.date;
	var meal = json.menu.meal;
	var heading = '<h4 style="text-align:right; font-weight:normal;"><span style="float:left; font-weight:bold;">' + day + '\'s Menu</span>' + date + "</h4>\n";
	menu = '<table class="datatable" width="400">' + "\n" + getMeals(meal) + "</table>\n";
	return timeStampComment(json) + heading + menu;
}
 
// Get menu meals
function getMeals(meals) {
	var mealList = '';
	if (meals != null) {
		if (meals instanceof Array) {
			$.each(meals, function(i,meal) {
				mealList += buildMealRow(meal);
				mealList += getCategories(meal.category);
			});
		} else {
			mealList += buildMealRow(meals);
			mealList += getCategories(meals.category);
		}
	}
	return mealList;
}
 
// Get meal's categories
function getCategories(categories) {
	var catList = '';
	if (categories != null) {
		// Is categories an array?
		if (categories instanceof Array) {
			$.each(categories, function(i, category) {
				catList += buildCategoryRow(category);
			    catList += getItems(category.item);
			});  
		} else {
			catList += buildCategoryRow(categories);
			catList += getItems(categories.item);
		}
	}
	return catList;
}
 
// Get category's items
function getItems(items) {
	var itemList = '';
	// Is items an array?
	if (items instanceof Array) {
		$.each(items, function(i, item) {
			itemList += buildItemRow(item);
		});  
	} else {
		itemList += buildItemRow(items);
	}
	return itemList;
}
 
// Build individual meal's table row
function buildMealRow(meal) {
	var descr = meal['@attributes'].descr;
	var mealRow = '<tr><th colspan="2">' + descr + "</th></tr>\n";
	return mealRow;
}
 
// Build individual category's table row
function buildCategoryRow(category) {
	var catRow = '';
	if (category != null) {
		var descr = category['@attributes'].descr;
		// Do not display the 'None' category
		if (descr.search(/None/) == -1) {
			catRow = '<tr class="title"><td colspan="2">' + descr + "</td></tr>\n";
		}
	}
	return catRow;
}
 
// Build individual item's table row
function buildItemRow(item) {
	var itemRow = '';
	if (item != null) { 
		var itemDescr = item.itemdescr;
		var itemPrice = item.itemprice;
		itemRow = '<tr><td>' + itemDescr + '</td><td>$' + itemPrice + "</td></tr>\n";
	}
	return itemRow;
}
 
// Update Cafeteria Daily Menu page title with "[day]'s Menu"
function updatePageTitle(json) {
    // Get day to use in page title
    var titleDay = json.menu.day;
    // Append day to page title
    document.title = document.title + ' | ' + titleDay + "'s Menu";
}
 
// Output html comment with note on when menu was last cached for troubleshooting
// and debugging
function timeStampComment(json) {
	  var day = json.menu.day;
	  var cacheTimeStamp = json.menu.timeStamp;
	  var timeStampComment = "\n<!-- " + day + "'s menu last cached: " + cacheTimeStamp + " -->\n";
	  return timeStampComment;
}

There’s one big gotcha in the code above.  Notice how I’m setting the descr variable in both the buildMenuRow() and the buildCategoryRow() functions. If you don’t use array notation with @attributes (['@attributes']), this code will fail in IE.

Finally, let’s take a look at how I displayed the menu on the cafeteria home page and on the daily menu page.

This first snippet displays the sidebar menu on the cafeteria homepage. Since the homepage always displays the current day’s menu, the only parameter that I’m passing with the querystring is the required callback.

// URL to menu display page
    var menuLink = 'http://www.example.com/cafeteria/dailyMenu.shtml';
 
    $(document).ready(function() {
 
       // Get JSON representation of cafeteria menu for today
        $.getJSON("http://www.cross-domain-example.com/service/cafeteria/json.php?callback=cafeteriaMenu", function(json) {
            // Build html menu table
            var content = outputSidebarMenu(json);
            // Add table to .sidebarMenu div
            $(".sidebarMenu").html(content);
        });
    });

The last snippet displays the full sized menu on the daily menu page. Since I only want a single daily menu page, rather than a page for each day of the week, I had to have some way to grab a “requestedDay” parameter from the querystring. The jQuery Query String Object plugin solved that problem perfectly.

// Menu display requires jQuery and jQuery querystring plugin (jQuery.query.js)
    $(document).ready(function() {
 
          // JSON service URL
        var jsonUrl = 'http://www.cross-domain-example.com/service/cafeteria/json.php?callback=?';
 
        // Get requested day from QueryString
        // @see http://plugins.jquery.com/project/query-object
        var reqDay = $.query.get('requestedDay');
        jsonUrl = jsonUrl + '&day=' + reqDay.toLowerCase();
 
        // Get JSON representation of cafeteria menu for today            
        $.getJSON(jsonUrl, function(json) {
 
            // Add "[day]'s Menu" to page title
            updatePageTitle(json);
 
            // Build html menu table
            var content = outputDailyMenu(json);
 
            // Add table to #menuBuilder div
            $("#menuBuilder").html(content);
        });
 
    });

Wrapping Up

When you’re in a situation where you can’t use PHP (or your programming language of choice) to display dynamic content, AJAX can be an excellent solution.  With the right tools, good documentation, and a little time spent on Google, it’s relatively simple to overcome the limitations of your environment and deliver rich, up-to-date content to your users.  Combining Zend Framework, the jQuery JavaScript Library, and JSONP made for a nice, lightweight solution to the cafeteria menu problem, saving my clients and co-workers a lot of time and effort they can now expend elsewhere.