The four charges filed include criminal attempt of statutory sexual assault and corruption of minors.
"It is really sad to hear it, but we are all human, and as a Christian, we always say, you know, we get tempted by the devil," said Yessoh.
At Most Holy Trinity Parish, parishioners say the priest has been a part of their church family for years.
"The parish is really supportive to the family, and we also have to say the prayer for the priest because no matter what, it's still a human being that went through things," Yessoh said.
"Father Gregory, he's very, very nice. I don't know what's going on, what happened," added Herd.
A couple of mothers who say they've been going to the church for years say this priest is a conscientious and loving person who built their sons' faith up from a young age.
In a statement, the Diocese said, in part:
"Under its longstanding zero-tolerance policy, the Diocese of Scranton immediately removed Father Loughney from active ministry pending the outcome of the investigation."
And at Sunday mass, members say the priest read that statement while delivering the day's sermon.
"That transparency, I would say, give us some type of safe feeling, that nothing is hidden from us and that we are protected no matter what," Yessoh said.
Police have not yet released the details of the charges against Father Loughney.
"Whatever it is, it's in the hand of God, God will be watching everything, will help everybody," Herd said.
Loughney is due back in court on November 4.