Don't laugh... Emco Unimat 3 to cnc?

A while back, our anemic Emco Unimat 3 lathe finally got me
frustrated enough to revamp it. After replacing it's glorified sewing
machine motor with a small treadmill motor and removing the high spot
on it's slide, I ended up with a useful tool. Now I am entertaining
the ridiculous notion of adding cnc capability to it. Has anyone done
such a thing before? There isn't much space to work with and it would
require a lot of modification. It would be great to get some advice
from someone that has already done it, or to be talked out of it by
someone that tried and couldn't.

Hope everone has a wonderful Thanksgiving.

Thanks,
Tom Murray