He wasn't. The federal budget was not a problem compared to what was going on in the banking sector. He focused on the federal budget instead of preventing and fighting the great depression, which is why he eventually lost the elections and why others fought the great depression.
