Does the negative leg of the supercap have good continuity to any ground point (with very low resistance) on the PCB? You can tie in multiple points to shared ground without worry. The fact that it takes a while to work before heating up sounds like its dodgy or it could also be another cap gone...