Go, Do, Be.

• ALL
• PHOTO
• TECH
• MUSIC
• FUN
• FOOD

So if you happen to find something in your access_log that mentions GFSearcher, it's me. Apologies if this is a nuisance. I'm running some tests with Nutch on a small number of sites for my day job.

GFSearcher/GFSearch-0.9

I'll follow up this post with some info about how everything works out.

Well, I did it. I tossed a little pile of code onto google's open source site.

A few years ago I wrote (in my spare time) a little test harness around some simple command-line utilities. I wanted something to help me answer some simple questions about what was going on some large clusters of servers. Rather than clicking through a bunch of nicely formatted pages, I wanted something to make a bunch of http requests and give me a 'yes' or 'no' about the response. The trick (for me) was to try to run it on some server in the cluster which was running a really lean installation of Linux. No frills.

I could have probably compiled a jar & dropped it onto the server... but I couldn't edit & recompile a class on the server. I could probably have run a perl script, (geeze why didn't I just write it in perl?) but I think the WWW-Mechanize module wasn't installed. Who knows... anyway, I ended up stumbling upon curl and decided to write a wrapper around it using simple bash scripts.

Guess what? It worked. It was handy. Guess what? I used it at a few jobs since I wrote it. Guess what? It's still (somewhat) handy. So today (or yesterday) I give something back to the internets and interwebs that haz given me so much. I offer:

• http://code.google.com/p/bashwebtest/
• Installation Steps
• Example Tests
• WTF - 'what's that function?'
• FAQ

Tests are pretty simple. I'll toss a few test examples on this blizzog and onto the wiki on code.goog over the next few weeks. If you have any interest at all in using something klunky, and somewhat functional, please contact me and I'll help you get started.

Code.goog doesn't have a way to select it, but I planned on distributing the source under the 'MSL' license.

Anyway, enjoy!