As an engineer, I hate the word "tolerance." It implies slack, space, or play. I want A + B to equal C - not, C plus or minus the amount of slack that is required to add reliability and/or driver comfort.
However, in the case of suspensions, there is no greater place where these compromises must be made.
First of all, the best suspension is one in which the components offer the least amount of resistance to movement as possible. You want the resistance to be in the shocks and springs. On a street car, low durometer rubber is a great choice. It isolates the most NVH while providing modest resistance to movement. In the purview of the amount of control arm movement on a street car, rubber is great.
Poly has advantages in some situations. In center-bore bushing applications, I find them to suck more than Jenna Jameson. Their typical durometer is so stiff that they provide huge resistance to suspension travel. Most of the NVH added with poly is typically due to the torsional rigidity of the bushing, not the lateral transference of impact forces. Put poly bushings on your lower arms, then stand on the ball joint. I'll bet your arms don't deflect more than 1-2". That's just frightening to me. Using poly bushings (IMO) to get improved handling is like using those screw-on spring compressors to lower a car; they are a stab in the dark - an unpredictable po-boy way to add rigidity to a suspension. Add in the fact that they are maintenance-intensive, and the durometer means that under hard use they tend to tear, and its a no brainer for me. Going up from rubber to poly (urethane) adds 20% benefit and subtracts 80% desirability from an engineering standpoint. I've used Poly extensively on a few cars with horrific results. Not for me, man.
Delrin is a nice idea. Its basically removes a HUGE restriction to movement in the suspension, and does a very small amount to reduce NVH. In my engineering opinion (haven't personally done a lot with them on the track) they seem to provide a great benefit; they can be installed with little or no tolerance, provide mostly free motion, and aren't as maintenance-intensive. They do wear out eventually, but on the track the benefits outweigh the wear.
Spherical rod-ends (heim joints) provide absolutely free motion with very little friction, but they accomplish that by using that dreaded word: "tolerance." That drastically increases NVH, but positively locates the components with very little resistance to movement.
Here is my usual recipe for a performance handler: Any single-axis component (like front control arms) have a real need for free movement since their primary purpose is to swing in their arc. They also need to stay in the same place so you don't have unexpected camber/caster changes as lateral forces are applied. Many of my all-out builds incorporate solid bushings on upper control arms and Delrin on the bottom. Spherical (heim) joints are fine, but unnecessary since we are only dealing with rotation on a single axis. The added play in spherical rod ends is a downside, and the multi-axis articulation adds no benefit.
Four-link rears on solid axles (as in drag racing) follow this same basic principle, however as the vehicle twists under its own torque relative to the axle, that adds a second axis of rotation. In that case, the control arms either twist (resistance to movement) or the bushings need to be made of something that will allow it. Poly is abysmally bad in this application. It prevents motion on all axes, meaning most of the torsional load falls to the trailing arms. In these cases I use spherical joints on the car end and rubber or spherical joints on the axle end depending on application and trailing arm angle.
If this is a straight up track car, go solid. Who cares about NVH? Solids offer a bit of tolerance, but its minimal. They are reliable, strong, offer very little resistance to movement, and easy to deal with. I put a set of dirt-track race, solid bushing, upper control arms on a 66 bonneville just to get it on the road. It actually did so well for me, they're still on the car, even though this was a luxury/cruising build project.
Single-axis movement; concentrate on freedom of motion while providing the least slop.
Multi-axis movement, concentrate on freedom of motion on all axes.