We always had Z's when I was growing up, starting with a 240 and ending with an '83 ZX. I even took my driving test in one.
I currently have a '71, and had the '83 my parents bought new for a couple of years until I sold it to a friend. The biggest issue is rust, no doubt. Everything else can be upgraded. They are very very similar to the original cars underneath, and can be modified to drive so much better than they were delivered in stock form. They also have a better cg than the 240 or 280 ever thought of having.
It's why they were so much better as race cars. People tend to forget that the ZX's were much better racers than the Z was, mainly due to more raked windscreen if I remember correctly, and the homologated rear spoiler.
While it may never be as "raw" as the 240, it does have it's own charm, and once you upgrade the suspension, they drive pretty good too.