The problem was that the batteries only lasted for a few hours. If they were left on for longer they tended to over-heat and, eventually, to blow up, which is reportedly what happened when the diplomat forgot to turn off his calculator.
Source: wiktionary