Aha!

So I'm not crazy. My mom told me today that we really did eat most of our Sunday dinners at Granny's house. We would all get up and go to church Sunday morning and then go to Granny's for lunch. After lunch my dad would go back to the barn to milk the cows while we stayed at Granny's. Then we'd go back to church for Tranining Union (that's how to tell a real Baptist from a Holman Christian Baptist - ask them if they know what Training Union is....) and church service.

There you go - mystery solved. Thank you Nana.