Emergent Development

Fun with Rails, JRuby, and JEE

2012-01-29T16:41:00.000-08:00

Background

So a little while ago we were looking at a possible complete rewrite of our customer's web site and we started evaluating what we could do. My first thought was to do a Rails app. I've done a few small Rails projects but none for a public site for an actual customer that expects results. Now our customer's data center only supports .Net and JEE applications so this posed an interesting integration issue. I had heard that you could get Rails applications to run in a JEE application server using JRuby but I had never done it. So I took some time to experiment with it and this is what I found...

First try

So first off I just installed JRuby. I'm on Ubuntu 11.10 so I just did what I do for installing anything:

apt-get install jruby

This got me a JRuby 1.5.1 installed. I then proceeded to install warbler (a Rails to JEE war file packager).

gem install warbler

Then I created an empty Rails app to experiment with:

rails new testapp --database mysql

This created a standard rails app directory. I then created a simple scaffold just to get something in there that would actually interact with the database.

rails g scaffold Person string:first_name string:last_name

I made sure that the databases existed:

mysql -u root mysql -e 'create database testapp...'

I then migrated the databases:

rake db:migrate RAILS_ENV=production

I then proceeded to package up the app in a war file by executing the warble command that the warble gem provides:

warble

And it churned out a testapp.war file. I then deployed the war file to my local Tomcat directory, started it up and hit the app with my browser. All the static content was served up just fine and all the dynamic content that actually touched ruby code did not. In fact, when trying to reach the dynamic portions, the request timed out. Not a 500 error message or anything, just nothing. And nothing showed up in the Tomcat logs either. Which made trying to guess the issue a nasty nightmare.

Resulting war file

So of course I took a look at the generated war file and looked to see what was in there. And surprisingly enough, it looked much like my Rails directory. All the public content (static html, style sheet, javascript files) was in the top level so it could be served up by regular requests to the files. In the WEB-INF folder you get the app, config, gems, and vendor directories with what you would expect in them. The web.xml is real simple: a few context parameters and a request filter pointing all traffic to a RackFilter:


<!DOCTYPE web-app PUBLIC
  "-//Sun Microsystems, Inc.//DTD Web Application 2.3//EN"
  "http://java.sun.com/dtd/web-app_2_3.dtd">
<web-app>
  <context-param>
    <param-name>public.root</param-name>
    <param-value>/</param-value>
  </context-param>

  <context-param>
    <param-name>rails.env</param-name>
    <param-value>production</param-value>
  </context-param>

  <filter>
    <filter-name>RackFilter</filter-name>
    <filter-class>org.jruby.rack.RackFilter</filter-class>
  </filter>
  <filter-mapping>
    <filter-name>RackFilter</filter-name>
    <url-pattern>/*</url-pattern>
  </filter-mapping>

  <listener>
    <listener-class>org.jruby.rack.rails.RailsServletContextListener</listener-class>
  </listener>
</web-app>

And of course in the lib directory you get the 3 jar files that do all the black magic: jruby-core-XXX.jar, jruby-rack-XXX.jar, jruby-stdlib-XXX.jar These files hand off all servlet requests to the Ruby code that's hidden in the WEB-INF folders. Quite remarkable really. Simple. Noninvasive. Just wish it worked.

Logging and debugging

In general, I like the debugging that you get with Rails. Development logs are very verbose and you get lots of good information. However, there's a disconnect between what JRuby/Rails would log (actual errors in the Ruby code) and what Tomcat would log (war deployment issues and lifecycle errors). After a little googling I found that you can set Rails' logging to go to the STDOUT. That way Tomcat would pick it up in the regular Tomcat logging. Great! So I went into my Rails application and in the config/application.rb I added a line:

config.logger = Logger.new(STDOUT)

So I re-warbled (I'm liking that as a verb) and redeployed to Tomcat. And when I went to access the dynamic portion of the site, I got a stack trace in the log. Wonderful! Now I could try to fix something. Well at the top I noticed something rather odd. It said that I was using Ruby 1.8. Well when I got all the Rails stuff working I was working with a RVM install of Ruby 1.9.2. And I thought my JRuby was new enough that it'd be using 1.9 as well.

Version confusion

So I found out that you can get JRuby via RVM as well. So I installed the latest JRuby from RVM (1.6.5). And I found out that when you use JRuby with RVM your standard Ruby becomes JRuby.


rvm use jruby-1.6.5
ruby -v
jruby 1.6.5 (ruby-1.8.7-p330) (2011-10-25 9dcd388) (Java HotSpot(TM) Server VM 1.6.0_22) [linux-i386-java]

Note that in parenthesis it shows what Ruby version JRuby will be emulating. So even the latest JRuby was still going to be running as Ruby 1.8. After more googling I found that you can specify to use 1.9 mode as an argument to JRuby or you can set an environment variable to always use the 1.9 mode.


jruby --1.9 -v
jruby 1.6.5 (ruby-1.9.2-p136) (2011-10-25 9dcd388) (Java HotSpot(TM) Server VM 1.6.0_22) [linux-i386-java]

export JRUBY_OPTS=--1.9
jruby -v
jruby 1.6.5 (ruby-1.9.2-p136) (2011-10-25 9dcd388) (Java HotSpot(TM) Server VM 1.6.0_22) [linux-i386-java]

Later I was informed by @brianthesmith via @headius that just recently, JRuby master now uses Ruby 1.9 as the default. So hopefully this little version issue will go away with the next release.

The next issue I had was kinda a stupid on my part but again I'm not too familiar with the workings of Ruby/JRuby. When I install a gem using Ruby, either by doing a gem install or a bundler install, it doesn't install as a gem system wide that JRuby would be able to use. It's only available to that Ruby install. So JRuby knows nothing of the gems installed in your standard Ruby. Seems a little obvious now, but at the time it was a bit frustrating. And, JRuby cannot use native gems. Meaning that if something uses native code (like a database driver), JRuby will not be able to use it. For example, in your Rails app you might have ActiveRecord use the mysql2 adapter gem. In JRuby you would need the activerecord-jdbcmysql-adapter gem.

Also fun, is that if you execute:

gem install rails

You will get the latest greatest Rails (3.2 as of writing this). If you want to use an earlier version, good luck! You have to change your Gemfile to have an earlier version. But there are several gems listed in the automatically generated Gemfile that are dependent on a the initial version of Rails. In fact, there are several gems specified in the Gemfile that you don't need right away. Such as sass-rails and coffee-rails which are tied to the Rails version. The standard auto-gen Gemfile looks like this:


source 'https://rubygems.org'

gem 'rails', '3.2.1'

# Bundle edge Rails instead:
# gem 'rails', :git => 'git://github.com/rails/rails.git'

gem 'activerecord-jdbcmysql-adapter'

gem 'jruby-openssl'

# Gems used only for assets and not required
# in production environments by default.
group :assets do
  gem 'sass-rails',   '~> 3.2.3'
  gem 'coffee-rails', '~> 3.2.1'

  # See https://github.com/sstephenson/execjs#readme for more supported runtimes
  gem 'therubyrhino'

  gem 'uglifier', '>= 1.0.3'
end

First off, I noticed that when you execute bundle install it took forever or timed out. But if you change the source to point to http://rubygems.org instead of https://rubygems.org, or better yet, set the source to :rubygems, you'll actually be able to do a bundle install.

Another fun thing is that if you're using JRuby whilst executing rails new appname, it will give you JDBC database adapters in the Gemfile, but not in the config/database.yml file. But if you re-warble and create a war file with the non-JDBC adapters, it won't work in your JEE deployment. Fun.

What I wish the Gemfile defaulted to was this:


source :rubygems

gem 'rails', '3.2.1'
gem 'activerecord-jdbcmysql-adapter'
gem 'jruby-openssl'

Then add other gems as you need them. And if you want to use an earlier version of Rails, you could by just specifying a different version (ie. gem 'rails', '3.0.7').

Warble configuration

Finally, there's some adjustments I needed to make to the warble packager for the specifics of my app. To configure warble, you need to execute the following at the top directory level of your application:


warble config

This will generate a config/warble.rb file where you can make changes to the warble configuration.

So one change I needed to make was to provide a list of all the gems that the webapp needed when it is deployed. This will bundle them up in the war file. It'd be really nice if warble could read through your Gemfile and update this setting itself. But for now, it's pretty simple to explicitly specify the needed gems. To do this, go in and uncomment the config.gems line in config/warble.rb:


config.gems += ["activerecord-jdbcmysql-adapter", "jruby-openssl"]

One last configuration in the warble config file that I had to do was to set the JRuby compatibility version:


config.webxml.jruby.compat.version = "1.9"

This will set a context parameter in your web.xml file that will tell JRuby to be in the 1.9 mode.

Finally it works!

At this point, I was good to go. Re-warbled my app to get a new war file then deploy to my Tomcat server. And everything seemed to function as expected.

It seems that these war files are self-contained such that you don't need JRuby or any gems in a location outside of the server installed on the deployment server. So any standard JEE server should be able to deploy the JRuby/Rails app without any knowledge of Ruby or JRuby. That's pretty cool. So if your datacenter does not support Ruby on their production servers but will support JEE servers, this may be an alternative for you and your team.

Last thoughts

Well this was my first experience with JRuby and I gotta admit that these little hiccups were a bit frustrating. I'm not quite sure how things could be changed to help out complete noobs like me to setup an initial deployment, but I hope that this will help someone who's possibly struggling with the same setup issues. And if I got something terribly wrong in the above description, please correct me and I'll edit the post. Thanks!

Animations in Java 3D

2009-07-11T04:15:00.000-07:00

Wow, I haven't done much on this blog in a while... I haven't done a whole lot with the game lately but I got it up on github if anyone is interested: http://github.com/caspian311/boardgame.

So I have been messing around a bit with how the pieces move. The way it use to get done was by using keyframes. The problem with that there was no way to tell when you had reached the end of the animation to signal something else to happen. So I finally just switched it over to using Behaviors instead.

From my understanding all that you need to do is extend the javax.media.j3d.Behavior class, set the scheduling bounds (setSchedulingBounds()), then add it to the scene graph. Then you to override two methods initialize() and processStimulus(Enumeration stimuli).

In the iniatilize method you specify what event, or wake up criterion, will trigger the behavior. For animations you can make it based on a certain number of frames has gone by or a specified amount of time has gone by or it an AWT even occurred.

In the processStimulus method you loop through all the stimuli looking for the wake up criterion that you specified. Then you do whatever you want done (move/rotate/whatever something a bit) then if you want to wake up when the next time a criterion happens you call the wakeupOn() method.

Ok I'm not great at describing it, let's just see some code...



public class AnimationBehviour extends Behavior {
 private static final float MOVEMENT_SPEED = 0.1f;
 private static final int ANIMATION_WAITING = 10;
 private final ListenerManager finishedListenerManager 
   = new ListenerManager();
 private final TransformGroup transformGroup;
 private final Vector3f currentLocation;
 private final Vector3f moveToLocation;
 private boolean atLocation;

 public AnimationBehviour(Bounds bounds, TransformGroup 
   transformGroup, Vector3f currentLocation, Vector3f 
   moveToLocation) {
  this.transformGroup = transformGroup;
  this.currentLocation = currentLocation;
  this.moveToLocation = moveToLocation;

  setSchedulingBounds(bounds);
 }

 @Override
 public void initialize() {
  wakeupOn(new WakeupOnElapsedTime(10));
 }

 @SuppressWarnings("unchecked")
 @Override
 public void processStimulus(Enumeration stimuli) {
  while (stimuli.hasMoreElements()) {
   WakeupCriterion criterion = (WakeupCriterion) 
         stimuli.nextElement();
   if (criterion instanceof WakeupOnElapsedTime) {
    moveCloser();

    if (!atLocation) {
     wakeupOn(new WakeupOnElapsedTime(ANIMATION_WAITING));
    } else {
     setEnable(false);
     finishedListenerManager.notifyListeners();
    }
   }
  }
 }

 private void moveCloser() {
  Transform3D transformation = new Transform3D();
  transformGroup.getTransform(transformation);

  if (isFinished(currentLocation)) {
   atLocation = true;
  } else {
   updatePosition(currentLocation, moveToLocation);
   transformation.set(currentLocation);
  }

  transformGroup.setTransform(transformation);
 }

 private void updatePosition(Vector3f currentPositionVector, 
   Vector3f endingPointVector) {
  float[] currentPosition = new float[3];
  currentPositionVector.get(currentPosition);
  float[] endingPoint = new float[3];
  endingPointVector.get(endingPoint);

  for (int i = 0; i < currentPosition.length; i++) {
   if (currentPosition[i] < endingPoint[i]) {
    currentPosition[i] += MOVEMENT_SPEED;
   } else if (currentPosition[i] > endingPoint[i]) {
    currentPosition[i] -= 0.1f;
   }
  }

  currentPositionVector.set(currentPosition);
 }

 private boolean isFinished(Vector3f currentPositionVector) {
  boolean finished = false;

  if (currentPositionVector.x <= moveToLocation.x + .1
    && currentPositionVector.x >= moveToLocation.x - .1) {
   if (currentPositionVector.y <= moveToLocation.y + .1
     && currentPositionVector.y >= moveToLocation.y - .1) {
    if (currentPositionVector.z <= moveToLocation.z + .1
      && currentPositionVector.z >= moveToLocation.z - .1) {
     finished = true;
    }
   }
  }

  return finished;
 }

 public void addAnimationFinishedListener(
   IListener animationFinishedListener) {
  finishedListenerManager.addListener(
      animationFinishedListener);
 }
}

Also, since you are specifying whether or not to continue on each iteration you can add listeners to when the animation is finished and notify them. Here's how I call this class.


 public void animateAlongPath(List path) {
  this.path = path;
  animateNextStep(getNextStep());
 }

 private void animateNextStep(Vector3f currentLocation) {
  final Vector3f moveToLocation = getNextStep();
  if (moveToLocation != null) {
   AnimationBehviour animationBehaviour = 
      new AnimationBehviour(bounds, transformGroup,
     currentLocation, moveToLocation);
   animationBehaviour.addAnimationFinishedListener(
      new IListener() {
    public void fireEvent() {
     parentGroup.removeChild(animationGroup);
     animateNextStep(moveToLocation);
    }
   });

   animationGroup.addChild(animationBehaviour);
   parentGroup.addChild(animationGroup);
  }
 }

 private Vector3f getNextStep() {
  Vector3f nextStep = null;
  if (pathIndex < path.size()) {
   nextStep = path.get(pathIndex);
   pathIndex++;
  }
  return nextStep;
 }

So the piece will walk through the path of locations specified and when the animation is done for a given step it will notify the next step animation.

The Importance of Stubs

2009-05-23T08:35:00.000-07:00

Wow, I haven't posted in a while. I'm still crunching away at the game but a few things have popped up at home that have kept me from spending too much time. Leaky basements and a new puppies tend to do that I guess.

Nothing new to report with the game, still just hammering away at the game's user stories. I did switch over from Continuum to Cruisecontrol for my integrated environment. I've been trying out git-svn with some success and liking it for the most part.

So to make this post a bit more interesting I decided to rant about something that I've seen in a couple of teams I've worked with both as a developer and as a coach. The issue is that of having dependencies on other teams for artifacts that are critical to my team's product. This is especially problematic with larger organizations pushing for an "enterprise" solution - which typically translates into multiple development teams working separately for months trying to configure an off-the-shelf, over-priced product and then throwing everything together in an integration nightmare and regression testing for a period that might out last the actual development time.

Being responsible for a product that you don't fully control all the moving pieces can be frustrating and at times paralyzing. But I've found a solution that's produced some good results: create a stub of everything that you depend on but don't control.

For example, if your team is building a web client that consumes services for all of your back-end work, stub out each of the services that you rely on. Define an interface that your team and the team building the service can agree upon and build a basic implementation.

If you're relying on a web service that provides search capabilities, get the WSDL and generate a client and service. Put just enough implementation into the service to make it functional. Have it return one of ten result sets based on ten different query strings - something simple but functional as far as inputs and outputs.

Once you have the stub in place, you can write your automated UATs (User Automated Tests) around your application using the stub and ensure that your application is processing the results correctly. Once your UATs are in place and you have your continuous integration environment, you can swap in their actual services and just kick off the build to verify the integration. This should make it fairly painless!

Now obviously the interfaces can change as the project continues but just make sure that when the changes occur, all dependent teams get an updated version of the interface. Then it's as simple as regenerating the stub service and client code and making a few adjustments here or there. Then run the UATs again to ensure that you have integrated the changes correctly so that the behavior of your application is still what the user expects.

I'm convinced that this practice alone will save large development departments millions of dollars of teams wasting their time trying to throw everything together at the last minute. And it will probably save developers the stress of the integration nightmare.

End rant.

Make things testable

2009-03-28T06:05:00.000-07:00

So I was going along with my stories and I realized that there's a bunch of stuff that I am not testing. In general with an MVP pattern, you make the V as slim as possible because it's really hard to test things in the view. Can do you write a test that says that your "ok" button actually shows up in the lower right corner of the popup dialog? So you make it really slim so that you just kinda assume that Swing or SWT knows how to render the stuff correctly to the screen and that you are using the API correctly. So with that in mind, I went about writing my game... which is mostly stuff in the view. At this point in the game, there's very little non-view stuff going on. So I'm not testing a whole bunch and that really bothers me.

So I started re-evaluating whether or not my view could be tested. I'm writing this using Java3D which is all java so it should be fairly testable. In the end, to make something show up, you need to add it to your branch graph. So I started looking at ways to inject stubs for my branch groups into my objects and see what gets populated. Unfortunately, Java3D does not code to interfaces. So I made a bunch of adapters around class that implemented interfaces containing the methods I was using. Next I created a bunch of factories to make sure that I always got the same sort of adapter wrapping object back. Then I exposed an interface on the factory and injected that into a few generators that would add my game grid and game pieces. So once I started pulling this out, I realized that very little of my code is actually Java3D code and it it's all really testable.

So I guess the lesson that I've learned with this and a few other projects I've worked on is to try to get around the API/Framework/Whatever that you're working with by using interfaces (and adapters where needed) so you can test your own code.

Here's an example from what I did with the BranchGroup...


public interface IBranchGroup {
 void compile();

 void addChild(Node node);

 void addChild(IBranchGroup child);

 BranchGroup getInternal();
}


public class BranchGroupAdapter implements IBranchGroup {
 private final BranchGroup branchGroup;

 public BranchGroupAdapter(BranchGroup branchGroup) {
  this.branchGroup = branchGroup;
 }

 public void compile() {
  branchGroup.compile();
 }

 public void addChild(Node child) {
  branchGroup.addChild(child);
 }

 public void addChild(IBranchGroup child) {
  branchGroup.addChild(child.getInternal());
 }

 public BranchGroup getInternal() {
  return branchGroup;
 }
}

public interface IBranchGroupFactory {
 IBranchGroup createBranchGroup();
}


public class BranchGroupFactory implements IBranchGroupFactory {
 public BranchGroupAdapter createBranchGroup() {
  return new BranchGroupAdapter(new BranchGroup());
 }
}

public class GameLauncher implements IGameLauncher {
 public void launchGame(IUniverse universe, IBranchGroupFactory branchGroupFactory,
   IGameEngineFactory gameEngineFactory) {
  IBranchGroup branchGroup = branchGroupFactory.createBranchGroup();
  IGameEngine gameEngine = gameEngineFactory.createGameEngine(branchGroup);

  ISelecterFactory selecterFactory = new SelecterFactory(universe);

  gameEngine.createScene(selecterFactory);
  gameEngine.createCamera(universe);

  branchGroup.compile();

  universe.addBranchGraph(branchGroup);
 }
}

Managing Your Tests

2009-03-14T15:08:00.001-07:00

So I've been writing some code for a while and knocking out a few stories and the code base is growing, and so are the tests. The thing that allows you to refactor and to explore better ways of doing something is having good tests that pass. And by good tests, I mean that there are both unit tests and integration tests on all classes. Before you write any code, you have to write a test. If you find a piece of functionality that you can't test, try pulling it apart or isolating the un-testable portion as much as possible. I like to think of the tests as a safety net for your code. The tests describe the behavior of my application and so as long as all the tests pass, the code is free to be massaged into whatever I like.

However, an interesting issue arrises as the tests grow. The tests begin to exhibit some code smells. There's probably some code duplication or possibly some tests that test the same behvavior. Especially with some extensive integration tests. Eventually, I start to want to refactor my tests. Which really makes sense because if you don't maintain your tests they will become unusable and you eventually try to get around them. So refactoring the tests really is a necessity.

Now the danger here is, how do you know that you didn't break a test? I write tests for my code so that I can refactor my code but there is no tests for my tests to ensure that I didn't break the tests. I can run them against the codebase and ensure that they still pass, but it's easy to get false positivies that way.

I've been running into this at work recently and I'm trying to find a good principle or something that will ensure the stability of the tests through refactoring. Unit tests are usually fairly easy to refactor. The tests themselves are straight forward and you see real easily what they're testing. Integration tests are not so clear, or at least they can be more challenging. My advice so far has been to make sure that there is good unit tests before you start refactoring the integration tests and only make small changes at a time and as much as possible verify all the changes all the time.

If anyone has some other comments or suggestions about what to do for refactoring test, please let me know!

What to do when you don't know what to do

2009-02-28T10:30:00.000-08:00

The last story that I was working on required me to do some animation in Java3D, which I didn't how to do. So, I did a little Spike to learn a bit more about what was involved with that, and I finally finished up the story. With this on my mind, I thought I would spend some time talking about Spikes.

I think Spikes are one of the most misused parts of Agile. The general understanding of a Spike is that it is a research story. If you have questions about how to do your User Story, you spend time researching or spiking the questions that you have. I've seen different teams handle Spikes in different ways. The worst I have witnessed are spike stories that drag on from iteration to iteration. After a time, when something is finally delivered, it's not in a state that is usable, but too much time has been spent on it, so it winds up being put into the code base with no tests, no pair programing, etc. The best use of a Spike is to only use it when you don't know enough to estimate the story, then you spike until you know just enough to do the story. Any code that you write to answer those questions are considered "spike code" and you throw it out.

One really good practice to get into to avoid spike abuse is to always have your Spikes be time-boxed. You set a limit on the amount of time you will spend researching. Once that limit has been reached, the team can then review whether or not they need more time or need to possibly take a different route. If you can't learn enough within a day or so, to estimate, you really should reevaluate if that technology is worth the time. If an off the shelf product takes a week's worth of time to "spike" so that you know how to use it, maybe a simpler approach that doesn't involve that product is the better approach.

I've worked with some people that use the term "Spike" to justify taking a long time to writing crumby code that is meant to be used as a prototype. Truth is, that when they finally get to the point that they can write that code, they know enough to estimate the actual story and then begin working on it. Time spent on a spike after you have answered your question is no longer time that should be spent on spiking, but time spent working on the story.

I've also heard the phrase "architectural spike," which boils down to taking entirely too much time to write up a document to give to the team (that they'll probably never read) describing the solution with many charts and diagrams. And to me, that just goes against the concept of letting your tests drive your code and letting the design emerge from your refactoring.

So to recap, spikes are suppose to be a time-boxed (maybe a day) research efforts that answer enough questions so that you can estimate a story. Anything else, should be your standard test driven development based on satisfying acceptance criteria on your user stories.

2009-02-21T15:05:00.001-08:00

Alright, so I blew through the first two stores that I was attempting:

1. User opens the application and sees the game board. Game board is a chess board (8 x 8 - alternating black and white squares) background is a gray. Camera is looking at the center from above and toward one side.

2. The user has one piece (a blue ball) on the board that is located on one side of the board on one of the center squares.

And up until now there was really no design to it. I started coding a class that had the capability of drawing on the 3D canvas and just kept going. Neither of these stories contain any user interaction yet so I was having a hard time coming up with testable code.

I eventually saw that there was a bit of logic needed for creating the checkered game board. So I thought I'd extract out something that would need to know how to do that. So I started going into an MVP pattern. I wanted the view to get something that it could use to create the proper rows and columns with the right alternating colors without too much logic. It wound up looking like this:


public void constructGrid(GameGridData data) {
 for (int x = 0; x < data.getTileData().length; x++) {
  for (int z = 0; z < data.getTileData()[0].length; z++) {
   Tile tile = new Tile(data.getTileData()[x][z]);
   board.addChild(tile);
  }
 }
}

The Tile class was an abstraction I had done to encapsulate the creation of the geometry and details of creating the individual squares. The TileData is a bean that I had to construct to keep the back-end models from knowing anything about the Java3D APIs. The GameGridData has the algorithm needed to get all the positions and colors in the right data structure (the TileData bean) that the view needed. I have a feeling that GameGridData may morph into an abstract class where subclasses will be specific for Chess boards or terrain looking grids or vast spans of black space. Once that was all pulled apart, I was able to construct a Model that generated these TileData beans and a Presenter that could communicate between the two.

Now what I have is a bunch of smaller classes that don't contain "view code" all of which are very testable! So that's where the first real signs of a design started to form. I had a need to be able to test what I was doing and no real good way of isolating the code that needed testing. So by separating out what was just calls to the framework's API (or my abstractions around the framework) and the logic needed for the correct calls, I was able to write a few tests and get things a bit more agile.

The third story actually got me into some user interaction:

3. The user can select a square on the board and the ball will move to that square. Movement is shown and not just a sudden change in location.

Selecting an object in Java3D is a bit more complicated than in Swing. Picking an object is basically translating a point that your mouse picked on the screen to a ray or cone that extends from the point down into the canvas and then seeing what objects intersect with that ray or cone. So my abstractions around the actual tiles in the grid by my Tile class paid off when I found out that the API will return the Node or Shape3D object that was in the intersection path. So I was able to retrieve the same TileData bean that I used to create the selected Tile object and then notify the presenters that are listening to the view.

And this is what it wound up looking like:


final PickCanvas pickCanvas = new PickCanvas(canvas3D, board);
pickCanvas.setMode(PickInfo.PICK_GEOMETRY);
pickCanvas.setTolerance(4.0f);

canvas3D.addMouseListener(new MouseAdapter() {
 @Override
 public void mouseClicked(MouseEvent mouseEvent) {
  pickCanvas.setShapeLocation(mouseEvent);
  PickInfo pickClosest = pickCanvas.pickClosest();
  if (pickClosest != null) {
   Tile tile = (Tile) pickClosest.getNode();
   selectedTile = tile.getTileData();
   tileSelectedListeners.notifyListeners();
  }
 }
});

So then I needed a way to move the user's game piece once the position selection took place. I made some similar refactorings to the code that created the user's piece with a MVP pattern. And then I let the model from the game grid and the model from the user piece be able to communicate with each other. And then the piece model notified it's presenter which in turn told the view to move the piece to the correct location.


public UserPieceModel(final IGameGridModel gameGridModel) {
 gameGridModel.addPositionSelectedListener(new IListener() {
  public void fireEvent() {
   currentPosition = gameGridModel.getSelectedPosition();
   adjustCurrentPositionForHeight();
   modelListenerManager.notifyListeners();
  }
 });
}

So this story is just about wrapped up. I currently just have the user's piece suddenly jumping to the new location but the story has some more specific requirements: "Movement is shown and not just a sudden change in location" I made it that way intentionally because I know nothing of Java3D's animation APIs. So now I'm just doing a quick spike to determine how to do that and then I'll be able to finish this story up and move on to the next.

So overall I think things are progressing nicely. I wasn't liking where this was going at first with a whole bunch of un-testable UI code but now it seems like I've got the start of a design that allows me to test what I'm creating. And really that's the point of this blog. I called it Emergent Development because that's what good software development should be. You start going and you realize you need something so that you can make it more testable, more loosely coupled, more flexible and so you interject a pattern or two so you can test your stuff and just keep going. So your design comes from need not from a over thought-out UML diagram that was created long before any real code started. Design comes as you need it, no sooner.

Doing a GUI application using TDD

2009-02-14T08:12:00.000-08:00

Testing user interfaces is always a pain point when doing TDD GUI apps. Web development has been able to get around this a bit with automated UAT testing using tools like Selenium or Watir. But with GUI apps, there's no really good, cheap (as in free) UAT tools (if anyone knows of one, please let me know!!!).

So when I create a GUI app I use a MVP pattern where the View is really, really thin because it's just impossible to right good tests around it. In the past with Swing and SWT/RCP application, I've been able to have the view be fairly simple with an exposed getter/setter-ish API on it so that the Presenter can be tested on how it manipulates the View and the Model can have it's own tests for the business rules and that leaves not a whole bunch to test in the View. You don't really need tests for the implementat of view.getUsername() when all it does is read the text from a text field.

Here's a sample login MVP of what I'm talking about...
(I didn't compile this so don't complain if it doesn't actually work)


public class Presenter {
    public MyPresenter(final IView view, final IModel model) {
        view.addLoginListener(new IListener() {
            public void fireEvent() {
                try {
                    model.authenticate(view.getUsername(), 
                        view.getPassword());
                } catch (AuthenticationException e) {
                    view.showErrorMessage(e.getMessage());
                }
            }
        });
    }
}

The API exposed on the view is real simple:


public interface IView {
  void addLoginListener(IListener listener);
  String getUsername();
  String getPassword();
  void showErrorMessage(String errorMessage);
}

And the API on the model is real simple too:


public interface IModel {
    String authenticate(String username, String password) 
        throws AuthenticationException;
}

So this example makes the presenter very testable. And it separates out the need to know how the stuff is displayed to the user verses and how the actual authentication needs to happen. And the model is is left with a single responsibility and a very simple API. So testing the model is now real easy also. And the view now has no complicated functionality.

Even if you wanted to have some fields in the view that enable or disable based on options that the user has selected in other parts of the view, you can create another MVP triad for that and you could have another interface for that the view implements that might have some methods that look like this...


    void enableSubmitButton();
    void disableSubmitButton();

So the View doesn't even know what the state of the submit button is. It just knows how to enable or disable the field. Again, all the logic can go off to a Model so that it is testable and the Presenter just acts as a mediator between the View and Model interfaces which keeps the Presenter really testable.

As a general rule of thumb, you write a test for anything that could possibly break. And at the point of where this view is at, what would you be testing? That Swing is working? You shouldn't be testing their code, just yours.

Now in my game, I'm using Java3D for my "View" so that's going to be a fairly complicated piece that needs to be split as thin as possible to provide testability. Because really that should be your goal: how can I make this code testable? If I abstract something out and hide it behind an interface and inject it in, I can test my classes better.

Setuping up the Project

2009-02-09T15:20:00.001-08:00

Ok, so I have a rough idea for the end result of my game and I started to write up some user stories.

Main Concept:

This is a board game where two players have a set of "pieces" that they can move around the board and attack the other player's pieces. The moves will be turn based: each turn the player gets to move one piece and cause one piece to perform an action. Actions may attack the other teams pieces which will may result in the termination of the attacked piece.

Ok, I'm hoping that with a little modification the game platform can provide the functionality for both a chess game and a Final Fantasy Tactics (great game by Squaresoft fyi for those who haven't played) style game.

User Stories:

User opens the application and sees the game board. Game board is a chess board (8 x 8 - alternating black and white squares) background is a gray. Camera is looking at the center from above and toward one side.

The user has one piece (a blue ball) on the board that is located on one side of the board.

The user can select a square on the board and the ball will move to that square. Movement is shown and not just a sudden change in location.

All movements are logged.

User can have eight balls. To move one, the user must select the ball to move first, then select where to move the piece.

The opponent will have 8 pieces also but of a different color.

User cannot move onto a square that is already occupied.

After the user moves a piece, the opponent will move one of its pieces in a random direction (no piece can move off of the board).

Pieces can move up to three square away.

When a user selects a piece to be moved, the squares that are within range will change color to indicate the possible ending positions for that piece. Attempts to move to a square that is not showing the indication is ignored.

User can choose to attack a piece belonging to the opponent if that piece is within 2 squares from the user's piece. To attack, the user selects the piece that they wish to attack with, then select the opponent's piece that is the target. The attack is logged.

Attacks are logged to the same log that the movements were logged.

Some visual representation of an attack between two pieces is shown.

Pieces have a sense of "health". Each piece can take two attacks before it is destroyed. Destroyed pieces simply disappear from the board.

Add an indicator for the health of the piece.

The pieces can be of different types:
- large, can only move 1 spaces but takes 3 hits to destroy
- medium, can move 2 and takes 2 hits to destroy
- small, can move 3 and takes 1 hit to destroy

Balls bounce in place while they wait their move.

The smaller the ball, the faster it bounces.

The pieces can be loaded in from an external model(s) - maybe spaceships.

When the game starts, the user can choose to play the CPU or play another player.

Network enabled games.

The user's stats are kept from game to game: wins, losses.

When the user starts the game they are asked who they are (username) so as to keep building on their stats.

The user's pieces' stats are kept: number of opponent pieces destroyed

Piece rank based on number of opponent pieces destroyed.

Upgradeable pieces based on number of opponent pieces destroyed.

It's a small backlog and it'll grow. And the stories that are further out are a bit more vague, but they'll become more clear when they start coming to the front.

Starting Development

In the meantime, I decided to setup my continuous integration environment. I am developing this in Java (the graphics done in Java3D) using Maven for my build and Continuum for my continuous integration. Java was chosen because I know it the best and I'm a bit more familiar with Java3D than other 3D programming APIs. Maven was chosen for the use of it's dependency management. I've written a couple of standalone applications in the past and I've refactored out some useful tools dealing with things like error handling and whatnot. And with Maven, it's real easy to include the dependency in the pom and not have to worry about it.

So I got the project all setup with automated builds going and email notifications upon failure. I really think that this is crucial for any project starting up. Get your CI environment up and running. Now I don't have any other developers joining my project at the moment, but non-the-less, it is vital to make sure that whatever you have in your repository is stable (tests pass) at all times.

Interesting bit on the email notifications... GMail has been gracious enough to allow external smtp access to their servers. So it made setting up the mail notifications really simple.

And now I'm all ready to start tackling the first story...

Starting to blog...

2009-02-07T10:16:00.001-08:00

So I've been told that blogs are good to get your ideas down and let others comment and possibly help you out occasionally. So here's my go at it. I'm a software engineer by trade and by hobby. I've been indoctrinated into the Agile software methodologies and I'm starting to put them into practice, not just at work where we're required to, but at home in my little side projects.

So I also have a hobby of videogaming and that tends to creep its way into my hobby of writing software. I've had grand schemes of writing the most amazing game that's interesting, replayable, exensible and just generally really fun. So I've had several failed attempts and I keep them all in my local SVN repo and occassionally dig them out and remember why I stopped that approach.

I think the reason why I fail most often in my attempts is that I try to do too much. In Agile terms, my stories are entirely too big. So I've decided that I need a backlog of stories that I can massage down to what would be doable and then focus on each one and get a sence of accomplishment and direction of where I'm going next. I've also decided to scale down the scope of my game. For the moment, it will involve moving pieces around a board and possibly taking your opponents pieces. Sounds very checkeredy but I figure that if I can start there, I can build uppon it. Maybe make it multiplayer, then make it networkable, then be able to load in different pieces, then make the board changeable. Then maybe I can pull out a framework that would allow me to create great extensible game that I know everyone will love and want to play! ... maybe...

Ok, first things first. Gotta get a backlog to work with. In order to do that, I need a good game concept. So that will be this weeks task. Some sort of game concept and the beginning of a backlog. And next week I'll plan on doing a release planning and start in on the fun.