As I've said before, Rolen most-definitely belongs on the WOF. I would not, however, retire his number. His time as a Phillie just doesn't have the requisite "specialness". He never played on any notable Phillies teams (unlike Alexander, Roberts, Ashburn, Schmidt, Carton and Bunning and Allen who were a part of a special team for 24 weeks), he was here only six-plus years (unlike Klein who played here many years) and, let's be honest, he did express disdain for Philadelphia and it's phanbase. I don't agree that he was completely the victim that others here claim he was. Reconciliation is a two-way street. The Phillies and Philadelphia had a messy divorce from Allen. But, both sides were willing to bury the hatchet after just a few years. I've never gotten the sense that Rolen has been similarly interested.
Allen also has the distinction of being the Phillies' first African-American star player and that is significant. In some ways, however, Allen and Rolen were both similar as both were quite talented but were also were quirky guys who drummed to their own beat, clashed with authority figures at times (Rolen also had issues with LaRussa in St. Louis) and also were seen by some teammates as clubhouse killjoys. Allen was probably a little more over the top but that is an interesting parallel.
Halladay was a huge stretch and was probably a hasty decision made as a result of his tragic passing.