More responsibilities for Attorney-General Sonya Kilkenny and a new cost of living portfolio are among major changes in state cabinet.