95 accord hard start when hot

Here is a new one.
A little background, the car has a check engine light for the vehicle speed sensor. I don’t know of the sensor is bad though. The cruise control works and the speedo works, albeit innaccurately. There are no other codes for the CEL.

When the engine is cold and started the car idles around 1200 rpms, then the CEL comes on ant the idle goes to around 1500. After a few seconds of driving the idle holds around 1000 until the engine warms. After warmup the engine idles around 750.
That’s all normal, however if I turn off the engine, then restart it before the engine cools it’s another story. 

When started warm the engine fires then will die unless you bump the throttle. The CEL comes on then the engine will run on its own but very poorly, and idles around 350. Giving it gas the engine runs better. After a few seconds of driving the engine will idle around 500. Then later on goes back to 750 and everything is normal. 

This happens eveytime, cold engine no problems at all. Start it while its warm and runs poorly for a brief period, there is a rare misfire during the time.
After idle returns to normal car runs great with no problems.

The idle is smooth where ever it sits.

What could be causing this?