From reading Town, it seems he is of a different culture, as culture is three generations deep and these generation do not always overlap.
My grandfather remembered those who fought in the war and were family heroes, yet they never considered slavery. It would have been the generation before me which wanted slavery, before my grandfather, yet in his generation, such being his grandfather.
My grandfather's time was one which believed in black inferiority, yet my mother was more perplexed by it and my father avoided it. I grew up believing whites were mentally superior as some IQ tests confirmed, however, I take this less as certain today, while my children do not think so and my grandchildren never believed it.