Outside the Oslo Cathedral, Kvarme literally extended a hand to protesting gay and lesbian church members, who fear Kvarme's conservative views on homosexuals. He won't, for example, support ordaining them as pastors.

Kvarme took time to speak with the protesters and gave a hug to some openly gay churchgoers. He earlier had said in his sermon that he wanted to promote peace and reconciliation.

"A much-loved bishop (the far more liberal Gunnar Stålsett) has ended his service and I'm beginning mine," Kvarme told the congregation that filled the cathedral to capacity. "The process behind this has engaged many. It has sparked debate and unleashed many emotions.

"I don't want to downplay that, and instead will stress that Jesus today meets us with the same greeting. He comes with a greeting that puts us all on equal footing... he says, 'Peace be with you!'"

Sunday's special services were attended by Queen Sonja, Crown Prince Haakon and Crown Princess Mette-Marit, along with a host of government officials and politicians. Prime Minister Kjell Magne Bondevik, whose Christian Democrats party pushed through Kvarme's appointment, said the sermon obliges Kvarme to follow up his words of reconciliation with actions.

"He's reached out his hand and I expect that those who have disagreed with him will extend a hand back to him," Bondevik said.