Australians are being forced to skip or delay specialist care as fees rise far faster than inflation and cost growth, the Grattan Institute has found.