Sounds like a dodgy connection at the back. There is normally a link from the radio to ignition to tell the radio to turn off and this may be faulty. You should be able to get the radio out with a modified coat hanger and just do a visual check first.