I think I read an account of this fight in a Bruce Lee biography entitled "Fighting Spirit"...I think the author was Bruce Thomas, but I'm too lazy to walk to my bookshelf to verify.
If I remember correctly, the fight ended with Lee straight punching the guy the length of a racquetball court or something, after deflecting a kick from the karateka.
I don't think the biography specified what system of karate the man represented...maybe it was never actually known by the respective writers. And I think in that time period, karate was just karate to many people.
Cthulhu