The baseball writer voters or the committee voters? I would think the baseball writers are actually younger than the fans (median-wise), if not by much.
They do have some newer rules designed to ease out people who are no longer working. But they could definitely stand to let in more non-traditional people, and let them start voting sooner. I mean, there are former bloggers with high-level front office positions, if they are qualified to do that after just four or five years they are probably qualified to vote for Hall of Famers (had they stayed in journalism).
But that would be another way to improve the committees. Let a Jorge Velandia or Kevin Goldstein vote instead of Pat Gillick and Tony LaRussa. Just a better mix, not eliminating all the old-timers.
In order to be eligible for a Hall of Fame vote, a writer must be an active member of the BBWAA for 10 consecutive years. Once a writer receives a Hall of Fame vote, he or she is eligible to continue voting beyond the time of active membership, provided the voter becomes a lifetime honorary member. In 2015, voting privileges were limited to 10 years beyond active membership.