Your mom decided not to show you to her sisters. If she revealed the secret, then they would either try to change you back, or want to play with you themselves. Ann wanted to keep you to herself, either way, and so she kept you trapped in her robe pocket. You tried pounding against the sides and climbing out, but both things failed.

At one point, while Ann was serving breakfast, Addy asked "Mom, where's Davey?"
"He's...out," she said blandly.
"Oh."
Your mom gave you a few pieces of scrambled egg for your own breakfast. It didn't taste that good.

Later, your mom changed out of her sleeping clothes, and changed into her outfit of a white blouse, black skirt, and black knee-highs. She reached into the robe pocket and picked you up in one hand.

"Davey, have you been shrinking again?" You must have shrunken while you were eating, because now you were only 4 inches tall, almost big enough to fit in her one hand. "Well, nevermind. I'm going to see a few friends now. You can stow away..."