Thing is college isn't college, that is, there's a huge gap between a major state school, a top college and most of the schools kids end up going to play if they're not top prospects. Junior colleges are glorified HS (which is why they're valuable to kids from the average HS who can use them as the "GCL" of academics, get some cheap credits to transfer while they develop some academic chops), and many 3rd tier colleges aren't much better.
For an 18 year old who doesn't like school, he's better off in the minors, growing up and learning how tough the world is, than partying for two years in college before he finds out he's not pro material. Then if he decides to go to college, he'll be far better prepared to put in the work required.
And going to college at 20-21 with some money in your pocket and a little real world experience isn't going to hurt your social life. Now if you 26-27, yeah, you'll feel like an alien.