The parliamentary budget officer says if the federal government wants to meet NATO's military spending target by 2032 as promised, it will have to almost double defence spending to $81.9 billion.