Shouldn't be. That warmup time is strictly for the oscillator itself to get to proper operating temperature, which is why it doesn't take too long: the oscillator's not that big a circuit, physically speaking. Despite what I said before, if it were getting so underpowered as to take that long under normal circumstances, I don't think it'd be getting enough juice to function at all. Maybe some voltage is bleeding into the CV in control and messing with the pitch that way? Something in the circuitry is definitely faulty, though.