Fickle lets you turn features on and off at will in your rails app using a web interface. It also lets you manage features on a model-by-model basis (maybe users?)