One of Hideyoshi's former allies, Fukushima Masanori filled Terumoto's place at Hiroshima. After Fukushima was stationed in Hiroshima, it's said that he got nostalgic for his old days under Hideyoshi. Needless to say, this did not sit well with the Tokugawa. In 1617 a great flood caused much damage to Hiroshima-jo. Fukushima petitioned the Tokugawa government for permission to fix it but he never received an answer. According to Tokugawa law, all daimyo needed permission to build, rebuild or renovate any castle. The only reply Fukushima got from the Tokugawa was "under investigation" and permission never came.
Two years later he proceeded on his own and started to fix the flood damage. Fukushima was caught in a Tokugawa trap. Since he defied their laws, they took away his lands around Hiroshima and gave him a smaller, less profitable province in modern day Nagano prefecture.
Hiroshima-jo lasted through the Meiji Restoration and was named a National Treasure in 1931 only to be destroyed by the atomic bomb in WWII.