In a submission written to Attorney-General George Brandis (right) on Tuesday, the three co-authors, who have strong links with Australia's indigenous community, argue the act should be strengthened, not weakened.

''Now is not the time for the Commonwealth to be relaxing legal protection for some of the most vulnerable in our society from racial vilification, discrimination or hatred, hostility, serious contempt or severe ridicule,'' the statement read.

Gerry Moore, a director of the National Congress of Australia's first Peoples and one of the authors of the submission, said he had written to the Attorney-General to ''look after his mob'' who face discrimination on a daily basis.

''It is not right to give the ability to racially vilify any human being,'' he said. ''I'm just a pure country man who is worried about his mob.''