Neighbor Daphne Ronning told the Milwaukee Journal Sentinel that Patterson's parents moved to Gordon about 15 years ago.
They went to a nearby house and pounded on the door with Jeanne shouting 'This is Jayme Closs!
Mr Fitzgerald said Jayme had not connected with Mr Patterson on social media, and the suspect had had no contact with anyone else in the family.
Patterson faces two counts of first-degree intentional homicide for the killing of Closs' parents and one count of kidnapping, Fitzgerald said Friday.
However, neighbors noted they rarely saw Patterson and hadn't seen Jayme around.
Fitzgerald said he was not yet aware of any plans for a community gathering to welcome Jayme home.
Closs vanished October 15 after her parents were gunned down inside their home in Barron County, located about 80 miles northeast of Minneapolis.
He has no criminal record, the sheriff said.
Jayme's aunt, Jennifer Smith, posted on Facebook that Jayme was doing well.
Elizabeth Smart - who was abducted aged 14 in 2002 in Utah and held captive for nine months - said in an Instagram post: "No matter what may unfold in her story let's all try to remember that this young woman has SURVIVED". First, to celebrate her homecoming but also realize she will need time and space to adjust to life after what she's been through.
"Call 911!" the dog walker told Kasinskas. He worked for one day in 2016 at the same Jennie-O turkey plant in Barron as Jayme's parents.More news: Federer 'sad and shocked' to learn of Murray retirement
More news: 'Fallout 76': Human NPC and More Found In Secret "Dev Room"
More news: Costco's 27-lb. bucket of mac and cheese is sold out
Barron County Sheriff Chris Fitzgerald said investigators are trying to figure out what happened to Jayme during her captivity and why she was seized, and gave no details on how she escaped except to say Patterson was not home at the time.
Fitzgerald said that amid pressure to find out what happened, investigators are letting Jayme decide when she wants to talk.
Patterson's lawyers Charles Glynn and Richard Jones said in a statement they consider the situation "very tragic" and that they are relying on the court system to treat their client fairly.
Local, state and federal investigators searched for the teen for months.
Finding Jayme alive has brought up a lot of emotions for kidnapping victims and families of missing children.
The girl's name rose to the top of the FBI's missing persons list, and authorities offered a US$50,000 reward for information leading to her recovery.
Residents who knew Patterson described him as quiet. Charles Glynn and Richard Jones said in a statement that they await Patterson's initial court appearance and the filing of charges against him on Monday.
Nutter and Jayme went to the closest house, the home of Kristin and Peter Kasinskas.
"Did he take things with her, did she go with him to the store, did he buy clothes for her, did he buy food", he said.
"The million-dollar question is why", Fitzgerald said Saturday. "She said that this person usually hides her or hides her when others are near, or when he has to leave the household".
Jayme was hospitalized, and later released and reunited with her relatives and dog, Molly, in Barron.
"Jayme had a pretty good night sleep it was great to know she was next to me all night what a great feeling to have her home".