The 47-year-old man, who cannot be named, is accused of abusing the girl last week during a walk to local horse paddocks and at his home.

He is accused of inappropriately touching her on multiple occasions.

The man is also accused of sexually assaulting her in his kitchen on Sunday night.

The teenager, who was under the age of 16, was scared and managed to break away, walking quickly out of the kitchen and back to her home.

Police, in documents tendered to the court, say she was shaking uncontrollably in fear, but was unable to open an outside gate.

They allege the defendant came up behind her and opened the gate before grabbing her, making a "pinky swear", and saying: "Don't tell your parents, it can be our little secret."

She reported the incident to her parents almost immediately, police allege, and the neighbour was arrested and appeared before the ACT Magistrates Court on Monday.

The court heard allegations that the man had made threatening remarks about the complainant to police during a forensic procedure, something the alleged offender denied.

Chief Magistrate Lorraine Walker refused the man bail on Monday, citing a significant risk that he may reoffend and may fail to appear in court.

The man's lawyer, Kate Bills, of the Aboriginal Legal Service, said her client was concerned about his two young children, who were reliant on him for their care.

Ms Bills said he would abide by bail conditions to prevent contact with the complainant.

Her client said he was injured by police as they restrained him in front of his children.

Ms Bills said he had asked for medical attention in custody, but had been refused.

The prosecution expressed concern about outstanding interstate warrants and his criminal history, which included charges of stalking, using a carriage service to harass, and inflicting grievous bodily harm.

The matter will return to court on Wednesday, for what is expected to be a second bail application.