According to James City County Police, 58-year-old Taliaferro left the kids at the Pineapple Inn around midnight on April 11th.
It wasn't until around 9:30 a.m. that someone realized the kids were alone and contacted Child Protective Services.
Even then, police say Taliaferro didn't come back until the next day, more than 24 hours after she had left.
"They could have gone anywhere, done anything," says a neighbor.
Police say they don't know where she went, but that she had reportedly been drinking.
"She showed up about a day and a half later, about 4:00 in the morning and the cops arrested her," says a neighbor
Neighbors say the kids always seemed to be fed well but that it wasn't always easy for Taliaferro to care for them.
It's unclear where their parents are. Police say they are now with a family friend.
A manager at the motel says she saw the kids over the weekend and they seem to be doing okay.