Over the past few weeks I’ve been spending most of my spare time developing a couple of web sites.  These sites are based on the Drupal CMS written in PHP.  And I’ve taken a bit of a crash course in Drupal module design.

When I set out developing these, I faced a challenge that I’d been aware of, but managed to avoid in the past.  How do I work on these projects in a predictable, constant environment, and still bring my code with me to work on my home machine, work machine, laptop, and anything else I happen to sit down in front of?

This blog post is about how I’ve accomplished this so far.  Read more after the break…

Portable Storage Device

Your first inclination will probably be to install these tools on a USB thumb drive that you can easily store in your pocket.  And you’d be in good company, this was my first choice too.  However, after getting everything going, I quickly realized that it simply wasn’t fast enough.  Others have reported different results, and a lot has to do with the particular device, and the file system (NTFS is best).

That said, I chose to go a different route, with fewer unknowns, and picked up a Seagate FreeAgent Go 250GB USB harddrive.  I picked it up with a docking port from our local Costco for $80 and it eliminates concerns I had about performance.

File Structure

Throughout the rest of this article, I’m going to refer to files in my file structure, so I may as well show it to you so that these references can make sense.  This probably isn’t the best layout, but it’s what works for me.

• FreeAgent Go Root
  • ampp
    • lampp
    • wampp
    • shared
      • htdocs
        • <code>
      • mysql
        • data
          • <databases>
  • Portable
  • cygwin
  • libs
    • java-runtime
      • jre1.6.0_06
  • Program Files
  • 7-ZipPortable
  • eclipse
  • FirefoxPortable
  • junction
  • Rapidsvn
  • soapui-2.5.1

Foundation (AMPP)

The first thing we’re going to needed is a good Apache, MySQL, PHP setup.  For this I did some quick googling and stumbled upon XAMPP.  This is an Apache Friends project that packages all the server side components I need.  You can check them out, and download it over at their site.

I just downloaded the zip file, and extracted it to my drive at \ampp\wampp.  If you don’t unzip this project to the root of your device, you’ll need to run the “setup_xampp.bat” batch script supplied.

Shared Source & Database Files

For the sake of organization, and the ability to run this system on both Windows and Linux boxes (see notes below about linux), I’m keeping my htdocs and MySQL database files outside of the normal directory structure of the XAMPP installation.

See my File Structure above..

This way all of the web files for my individual websites and projects go in the “htdocs” directory, while the database data files go in the “mysql\data” directory, making them easy to find.

Of course, this presents a problem since the XAMPP install won’t be looking in those directories for the databases and code.  So, to solve this I’ve written another small batch script which lives in the “shared” directory.  This script uses the microsoft system tool Junction.exe to create links of my shared directories in the location that XAMPP is looking.  The junction.exe file is in an “Installers” directory on the drive, though I should probably move it somewhere more logical.  Here’s the script that deletes old junctions, and creates new ones.  You’ll want to run this when you move from computer to computer, since the drive letter of the USB drive will likely change, and the junctions are to absolute paths.  I put this file in \ampp\shared and it uses relative paths, so that’s important.

refresh-junctions.bat

[text toolbar="false"]for /d %%A in (htdocs\*) do "..\..\Portable\Program Files\junction\junction.exe" -d "..\xampp\%%A"
for /d %%A in (htdocs\*) do "..\..\Portable\Program Files\junction\junction.exe" -s "..\xampp\%%A" "%%A"

for /d %%A in (mysql\data\*) do "..\..\Portable\Program Files\junction\junction.exe" -d "..\xampp\%%A"
for /d %%A in (mysql\data\*) do "..\..\Portable\Program Files\junction\junction.exe" -s "..\xampp\%%A" "%%A"
[/text]

The requirement here of course is that you always create new sites by creating a directory in \ampp\shared\htdocs, and that any time you create a new database, you must move it’s directory from \ampp\wampp\mysql\data\<database> to \ampp\shared\mysql\data\<database> then re-run the refresh-junctions.bat script while the MySQL server is not running.  But it’s a fairly workable solution.

Integrated Development Environment (IDE)

Okay, so we’ve got a nice predictable, repeatable hosting environment.  Now to  write some code!

My personal choice of IDE is Eclipse with the PHP Development Tools (PDT).  Eclipse is by it’s nature portable since it’s a Java application, and the installation for the PDT is just to unzip it to a drive.  There are a couple of pitfalls though, and here’s what I’ve done to overcome them.

First, since Eclipse does require the Java runtime you have two choices.

1. Make sure that a current JVM is installed on any machine you intend to run your portable environment on.
2. Carry a copy of the JVM with you!

I chose #2, and used instructions found here to do it.  Basically, store a copy of the JVM on your disk and edit the Eclipse startup batch script to use your portable copy.  In my case, the JVM is in the Portable/libs/java-runtime directory as shown in my File Structure above.

Secondly, I thought it would be a good idea to just store my workspace on the portable drive as well, so I could keep all my settings with me.  Thus far I haven’t found an elegant way to do this, since it apparently uses absolute paths for projects.  So instead I keep a workspace on each system I work on that has the settings.  I hope to find a better solution to this, and if I do I’ll post it here.

Portable Firefox Browser & Plugins

Alright, so now we’ve got a web server to show our code, a nice IDE to write code in.  What we need is a predictable way to view it all.  You could install your favorite browser on every computer you interact with, or you could bring it with you!  In my case, Firefox is my very favorite browser so I used Firefox Portable so that I can take it and all my configuration preferences as well as Firefox Add-Ons with me.  My core set of Add-Ons which I find invaluable are..

• Firebug
• IE View
• Web Developer

Portable *NIX tools with Cygwin

So we’ve written some code in our portable IDE, we’ve tested it out using our portable web server and Firefox browser and we’re satisfied with the results, and want to upload them to our production server.  My very favorite method of doing so is over RSYNC so I transfer only what’s changed, and it’s secure.  In order to do that, I usually use cygwin.

On the surface it seems like it’d be easy to just install cygwin to a directory on your portable drive.  And in part, it is.  You can simply install to that directory, and you’re all set.  Problem is as soon as you move it to another computer, and that computer assigns your drive a different drive letter, everything breaks down real quick.  Some quick google searching revealed a way to make this work.  I had to make some minor tweaks in order to fit within my File Structure but you can find the inspiration for my changes here.

My changes are to the X.bat and uninstall.bat files.  I instead called them ~cygwin-install-X.bat and ~cygwin-uninstall.bat and put them in the cygwin install directory at Portable\cygwin.  Here they are.

~cygwin-install-X.bat

[text]for /F %%A in (‘cd’) do set WD=%%A
bin\mount -m | bin\sed s/mount/"%WD%\/bin\\/mount"/ > tmp\mount.log
bin\umount -c
bin\umount -A
bin\mount -bfu %WD%/ /
bin\mount -bfu %WD%/bin /usr/bin
bin\mount -bfu %WD%/lib /usr/lib

set path=%path%;%WD%\bin;%WD%\usr\X11R6\bin
start bin\rxvt.exe -title "" -bg "#fafad2" -fg "#000040" -color10 green4 -color14 brown -fn "Lucida Console-14" -geometry 80×58+0+0 -sl 4000 -sr -tn rxvt -e /bin/bash –login -i
set DISPLAY=localhost:0.0
run usr\X11R6\bin\XWin -multiwindow -emulate3buttons 200
[/text]

~cygwin-uninstall.bat

[text]bin\umount -c
bin\umount -A
bin\bash tmp\mount.log
bin\rm tmp\mount.log
[/text]

Portable Source Control (SVN)

Lastly, you’ll probably want to submit your changes to some sort of source control.  In my case I’m using Concurrent Versioning (CVS) or Subversion (SVN) for my source control, and both are handled nicely by the portable version of RapidSVN.

So there you have it, my end to end solution for doing web development from a portable flash drive on any windows box you happen to come across.  My original intention was to be able to just plug this drive into any windows OR linux box and work, but I have some kinks to work out with the linux solution.  Watch this space for more on that as I develop it.

Hopefully this helps you if you’re trying to setup a nice portable webdev environment!

Okay, so I’ve been a bit preoccupied with a couple projects which have slowed my efforts at blogging etc.

In both cases, I’ve been working on websites that leverage the PHP based Drupal CMS.  One of those projects is over at http://www.chasejarvisshoeproject.com.  That site is basically a small community forum for some folks that are sending a pair of shoes around the world, and taking pictures of them in various locations and situations.  Pretty cool.  The result of this effort is a Flickr photo pool and a good time.

So, of course a website devoted to a group on Flickr, is going to require some integration with Flickr.  Enter the Drupal Flickr Module.  When I started using it, this module was still in either an alpha, or beta (can’t seem to remember) and has released it’s 1.0 as of the 25th of March.  Throughout the time I’ve been using it however, there’ve been a few functions of the Flickr API which I needed, and the module didn’t support.  Those were.

• flickr.groups.pools.getPhotos
• flickr.urls.getGroup
• flickr.urls.getUserPhotos

Since the framework of the module did the hard work of making the calls, it was easy to write my own methods which performed these Flickr API functions for me.  And as the module developers released new versions, I just copy/pasted my code back into the new file, and went about my business.

Well when 1.0 was released, I took a closer look.  It turns out they’d implemented the call to get photos from a group pool, but still nothing for the URL’s.  So I figured I’d contribute and write a patch for the two calls I was still in need of.  And that, is what you see here.

569,597d568
< }
<
< /**
<  * @param $nsid
<  *   nsid of the group whose pool url will be returned
<  * @return
<  *   The URL portion of the response from the flickr method flickr.urls.getGroup
<  */
< function flickr_urls_get_group($nsid)
< {
<   $response = flickr_request('flickr.urls.getGroup', array('group_id' => $nsid));
< if($response)
<     return $response['group']['url'];
<
<   return FALSE;
< }
<
< /**
<  * @param $nsid
<  *   nsid of the user whose photostream url will be returned
<  * @return unknown_type
<  */
< function flickr_urls_get_user_photos($nsid)
< {
<   $response = flickr_request('flickr.urls.getUserPhotos', array('user_id' => $nsid));
< if($response)
<     return $response['user']['url'];
<
<   return FALSE;

As you can see, pretty basic but I figured I'd contribute.  I posted this as a feature request/issue over on the Flickr Module's issue queue, but have yet to receive a response.  If nothing else, I can use this to patch the next version.  Hopefully it helps someone else as well.