Gary B. Smith produces this chart and says the fed is not directly responsible for housing over long periods of time.