I've read the transcript too and he does not imply Rafa is at fault for the finances AT ALL.
He's saying if there is no significant progress in footballing terms, then Rafa and the scouting system are to blame.
From his tone you can tell he's hurt by the hate he gets from the fans and is just trying to fight his corner. They are being accused of lying about the money Rafa is meant to have been given, when they havent, it was spent on contract renewals and Rafa overspent on Johnson and didnt get much back for Arbeloa.
Think about it, Portsmouth needed any money they could get. They sold Crouch and Kranjcar for a combined £11m to Spurs, Distin to Everton for £5m, Lassana Diarra for £17m in January, Muntari for £13.5m the summer before, and they still managed to get £18m out of you for Johnson, regardless of whether some of that was offset by the Crouch deal (it's still lost money). That's some strange negotiating considering Rafa wouldnt pay that for Barry last summer which in the end cost him Alonso.