For me, I think I'd first determine the configuration of the cab itself. Then I'd see which speakers I liked best with my head, holding the cab constant. I suspect there are better ways to do this if you're one of the lucky ones free of financial constraints, i.e., like simply buying one of everything ever made and then narrowing it down to what works best for you.
But in the real world, I think it makes sense to first decide what you want: 1x12, 2x10, 2x12, 4x10, 4x12, 1x15, etc..... Then think about application and overall sonic footprint. Open-back design for ambience, blossom, upper harmonic detail -- often compromising some low end response, punch, cutting through, etc. Closed-back design for presence, power, low end, punch -- often compromising some detail and ambience due to the directionality and focus you'll now have. Depending on your playing situation and your personal preference, one design may work better for you than the other.
Once you've decided on your configuration, then you can start swapping speakers, etc.
This is how I would do it, anyway ... as always, YMMV.
Get in where you fit in.