Former Liberal backbencher Craig Kelly is promising to continue supporting the Federal Government even though he's now quit the party.