A bit of backstory, I landed on Corvairs through Ford Falcons, specifically Falcons raced at Monte Carlo...I know, I know....

I really like the concept of an early-60's economy car that handles well, provides a good driver experience (read:3 pedals) and is relatively simple, inconspicuous and easy to maintain. Needless to say, after looking at all the compacts of the generation, I realized that a Corvair was likely my best bet.
Anyway, after reading all the differences between generations, I have decided that the styling of the EM appeals to me so greatly, that I am willing to sacrifice the improved driving experience that the LM possess.
Having said that, I decided that a '64 was the answer to my prayers....however, limiting myself to a single year obviously limits available cars...especially given my budget and demand for a 4 speed.
So, question is: is there really a significant difference in the performance between pre-'64 EM and '64s? How about factoring in the heavy duty suspension package available in '62/'63?
I may be making too big of deal given the limitations of the car in general...the idea is not for a full-out race car, but it is to drive spiritedly through the twisties.....
Thanks!