I think Haseley was more of a good college pitcher that threw in the 88-90 range so did not profile as well as a pro pitcher. The choice with Brown I think was closer as to whether his best position was pitcher or not.
And Gose was a good defensive CF with a career major league 650+ OPS so it is not like he did not have skills as a position player either. The chance of injury was always more with a pitcher so it was probably the right decision to develop Gose the way the Phillies did. He just was not quite good enough to do it long term so maybe his pitching ceiling would have been higher.