Why are we called "old people and old folks?

I do not know why we can be referred to rudely as "old people and old folks." If my children had said that to someone when they were young, they would have been sorry. I think anyone who refers to people like that should tell who they really are, but I think I already know who it is.