Christian Porter has been made industry minister while Peter Dutton will replace Linda Reynolds in the defence portfolio.
Prime Minister Scott Morrison on Monday announced a cabinet reshuffle with his government engulfed in scandals stemming from the treatment of women.
Michaelia Cash has been promoted to attorney-general and industrial relations minister to replace Mr Porter, who lost his job as the nation's first law officer after launching defamation action against the ABC.
Karen Andrews will replace Mr Dutton, who is also taking Mr Porter's role as leader of the house, as home affairs minister.
Mr Porter took mental health leave after revealing he was the person accused in media reports of a historic rape in 1988, which he strongly denies.
His new role also includes science and technology.
Senator Reynolds, who is also on medical leave, will become government services minister after coming under heavy fire for her handling of Brittany Higgins' rape allegations in 2019.
The former defence minister was forced to apologise after it emerged she called Ms Higgins a "lying cow".
Senator Reynolds replaces scandal-prone minister Stuart Robert, who will take over the workforce skills, employment and small business portfolios.
"These changes will shake up what needs to be shaken up while maintaining the momentum and the continuity and the stability that Australia needs," Mr Morrison told reporters in Canberra.
Defence Industry Minister Melissa Price has been returned to cabinet.
Social Services Minister Anne Ruston will add women's safety to her responsibilities.
The prime minister also announced a new cabinet task force to focus on women's equality, safety, economic security and health.
The new group will be led by Minister for Women Marise Payne and comprise all female ministers, along with the deputy prime minister, treasurer and finance minister.
In the outer ministry, Jane Hume will add women's economic security minister to her other roles.
Queensland senator Amanda Stoker will become assistant minister for industrial relations and women.
Australian Associated Press
Sign up for our newsletter to stay up to date.