Pope Benedict the 16th gave his last public prayer ceremony on Sunday in front of thousands at St. Peter’s Square in Vatican City. Yet his retirement isn’t free of controversy, as talk of a sex scandal has emerged as he gets ready to leave his post.

The pope said “Thank you for your affection” to the crowd as he appeared in the window of his apartment, which overlooks the square. He added, “The Lord is calling me to go on top of the hill, to dedicate myself once more to prayer and meditation. But this does not mean to abandon the church.”

Thursday will be Benedict’s last day as pope. Some members of the Italian media believe that there may be more to his resignation, as allegations of a sex scandal involving gay clergy and male prostitutes has emerged.

The Vatican has denied the allegations with Vatican Secretary of State Tarcisio Bertone calling the reports of the scandal as the election process begins to select a new pope “deplorable” as “often unverified, unverifiable of completely false news stories”  are published.