The highest score is really the only one that counts at most schools outside of maybe Yale and the odd t-14 school where they preach a "holistic" approach and literally abide by it.
Yale/Stanford: the extra stuff matters a bit more than any other schools. At least that's the reputation they have.
The other 3 of the top 5 is primarily a numbers game.
I think you're very competitive for Yale. Friend of mine was 3.95 from Princeton, also Fullbright, in at Yale with 170 in 2007 when it was WAY more competitive.