Understanding, Using & Evaluating
Real Estate Statistics
Real Estate Statistics
By Patrick Carlisle, Chief Market Analyst, Compass
Statistics can be an enormously valuable tool for assessing the conditions and trends in the real estate market. However, they are also among the most misused, misquoted and misunderstood "facts" we are bombarded with. The only honest purpose for market statistics is to provide reasonably unbiased information for those trying to make decisions regarding the purchase, sale or ongoing ownership of real estate - typically one of the largest, most complicated (and most emotional) financial investments of one's life. The problem is that most market analysis is provided by those who want to convince you to do something now (for their own financial benefit, such as commission dollars); or those so fiercely attached to one position or another - the most common being either unrelenting optimism or unrelenting pessimism - that every statistic is twisted to justify that position; and/or those who don’t understand real estate market dynamics and are not qualified to interpret the data in the first place. Whether delivered by real estate agents, so-called pundits, analysts, reporters, bloggers, special algorithms, or the guy who lives next door, all these situations often lead to the improper use of statistics.
RULE 1: Statistics without informed context are generally worthless. One can make virtually any case, positive or negative, by cherry-picking a single statistic derived from a particular data set and a specific period of time, whether that be the median sales price, foreclosure sales or the latest Case-Shiller Index. Small data set statistics can swing wildly without any significance. Computerized algorithms (Case-Shiller, Zillow) are not as flawless as they are presented to be by the media. The overall national trend may misrepresent California’s; the state trend may misrepresent the Bay Area’s; the Bay Area's may misrepresent the city’s; the city’s trend may misrepresent the trend in a specific neighborhood, price segment or property type. Within San Francisco and the Bay Area, distinct neighborhood and community market segments often move in different directions at varying speeds.
One needs to know a specific market inside out, from the ground up, first to carefully vet the data for statistical flaws, outliers, or anomalies, and then, standing back to look at the larger picture, to be able to intelligently interpret what it appears to signify for the present and for the future. Having a sense of the longer-term cycles in financial and real estate markets is also helpful: markets neither go up forever or down forever - it's amazing how often this simple fact is forgotten in the drama of the moment.
RULE 2: Statistics, including median and average stats are gross generalities. They often fluctuate up and down in the short term even in stable markets and price statistics are often affected by other factors besides changes in fair market value, such as seasonality, available inventory, financing conditions, buyer profile and significant changes in the distressed-property, new-construction or luxury home market segments. In San Francisco, every month sees a relatively small number of relatively unique properties sell. Median and average values usually disguise an enormous disparity of values among the underlying individual home sales in the data set, and how they apply to any particular property is impossible to say without a specific comparative market analysis (CMA). To value a specific property, an analysis crafted to its exact location, condition, circumstances and amenities, is required.
To further complicate matters, we know of three different ways to calculate months supply of inventory (MSI), two ways to measure average days on market, and two ways to calculate average dollar per square foot values. Square footage itself can be measured in very different ways by architects, builders, appraisers and floor-plan illustrators. For that matter, average and median prices can sometimes show different trends up or down, or price statistics can go up at the same time average dollar per square foot values are going down, and vice versa. All these variations make it that much easier to cherry-pick one single statistic to substantiate some overarching claim regarding where the market is heading.
Which leads to our next point.
RULE 3: Any definitive trend will be reflected over the longer term and in more than a single statistic, i.e. not just last month's median sales price (as quoted in most media articles), but in a wider array of supply, demand and value measures, such as dollar per square foot, months supply of inventory, sales volume, percentage of listings accepting offers, days on market, and so on. We prefer to look at as many different statistical angles on the market as we can think of, to see how they do or don't line up, and prefer quarterly or longer-term data to ever-fluctuating monthly data. Annual data really allows one to step back and see the larger view, instead of just what is in front of one’s shoe.
RULE 4: No one knows the future. Again: No one knows or can confidently predict the future. Recent studies* suggest that the confident predictions of financial market pundits and experts are wrong 50% of the time - or more. (One business professor compared them to monkeys throwing darts.) Generally speaking, you would do as well or better just flipping a coin: Think of the years of pundit projections prior to the 2008 financial and real estate markets meltdown. Or here's another example: Robert Shiller, the Nobel Prize winning economist, who helped develop the respected S&P Case-Shiller Home Price Index (and the complex algorithm behind its calculations) and is certainly one of the most often quoted financial and real estate markets economists in the country, stated in March 2012 that the U.S. homes market was probably still headed down, and that we may "never in our lifetime see a rebound in these prices." Since then the market has gone through a huge recovery - the market actually started to turn in San Francisco in 2011 - with values up enormously virtually everywhere, according to his own Index. That is, he could not have been more wrong. This is an excellent example of an "expert" who became attached to the anti-optimism position for which he became famous in 2008. We’ve seen hundreds of such examples.
It has been found that the most reliable experts are also the most humble, people who constantly double-check, question and qualify their own conclusions. The more confident (or arrogant) or vehement someone is about what is to come, the more you should distrust their opinions.
Financial and real estate markets are now subject to an astounding number of constantly changing, local, national and international, economic, political and even ecological factors. Changes in the Chinese stock market, interest rates, oil prices, EU elections, tax law, the bond market, or a new ballot proposal, natural disaster, election or conflict in the Mideast - all these are samples of the thousands of events that can have significant ramifications for Bay Area real estate. Even a super computer can’t track all the spinning factors and figure out what the future will look like tomorrow.
At Compass, we are not immune to the failings that afflict other analysts, but we try our best to provide straightforward information regarding market conditions, with as many angles and as much detail and context as possible, so that you can make your own informed decisions. Almost all the data is personally investigated and vetted for anomalies before being charted. We make very few predictions, but when we do make a tentative forecast, with lots of caveats, it is based upon what appears to us to be overwhelming supply-and-demand conditions and decades of experience in San Francisco Bay Area real estate. (But please see Rule 4: We really don’t know the future either.)
Patrick Carlisle, Chief Market Analyst, SF Bay Area, Compass
* "Why Do People Pay for Useless Advice? Implications of Gambler's and Hot-Hand Fallacies in False-Expert Setting" by Nattavudh Powdthavee and Yohanes Riyanto, Institute for the Study of Labour, May 2012: Referenced in The Economist in their June 9, 2012, Buttonwood column titled "Not So Expert." The issue was also addressed in the September 2, 2011 issue of the same magazine in an article titled "The Perils of Prediction: Adventures in Punditry" regarding the Good Judgment Project. These articles can be read on the Economist website (subject to being a subscriber).
Copyright 2019 Compass
Statistics can be an enormously valuable tool for assessing the conditions and trends in the real estate market. However, they are also among the most misused, misquoted and misunderstood "facts" we are bombarded with. The only honest purpose for market statistics is to provide reasonably unbiased information for those trying to make decisions regarding the purchase, sale or ongoing ownership of real estate - typically one of the largest, most complicated (and most emotional) financial investments of one's life. The problem is that most market analysis is provided by those who want to convince you to do something now (for their own financial benefit, such as commission dollars); or those so fiercely attached to one position or another - the most common being either unrelenting optimism or unrelenting pessimism - that every statistic is twisted to justify that position; and/or those who don’t understand real estate market dynamics and are not qualified to interpret the data in the first place. Whether delivered by real estate agents, so-called pundits, analysts, reporters, bloggers, special algorithms, or the guy who lives next door, all these situations often lead to the improper use of statistics.
RULE 1: Statistics without informed context are generally worthless. One can make virtually any case, positive or negative, by cherry-picking a single statistic derived from a particular data set and a specific period of time, whether that be the median sales price, foreclosure sales or the latest Case-Shiller Index. Small data set statistics can swing wildly without any significance. Computerized algorithms (Case-Shiller, Zillow) are not as flawless as they are presented to be by the media. The overall national trend may misrepresent California’s; the state trend may misrepresent the Bay Area’s; the Bay Area's may misrepresent the city’s; the city’s trend may misrepresent the trend in a specific neighborhood, price segment or property type. Within San Francisco and the Bay Area, distinct neighborhood and community market segments often move in different directions at varying speeds.
One needs to know a specific market inside out, from the ground up, first to carefully vet the data for statistical flaws, outliers, or anomalies, and then, standing back to look at the larger picture, to be able to intelligently interpret what it appears to signify for the present and for the future. Having a sense of the longer-term cycles in financial and real estate markets is also helpful: markets neither go up forever or down forever - it's amazing how often this simple fact is forgotten in the drama of the moment.
RULE 2: Statistics, including median and average stats are gross generalities. They often fluctuate up and down in the short term even in stable markets and price statistics are often affected by other factors besides changes in fair market value, such as seasonality, available inventory, financing conditions, buyer profile and significant changes in the distressed-property, new-construction or luxury home market segments. In San Francisco, every month sees a relatively small number of relatively unique properties sell. Median and average values usually disguise an enormous disparity of values among the underlying individual home sales in the data set, and how they apply to any particular property is impossible to say without a specific comparative market analysis (CMA). To value a specific property, an analysis crafted to its exact location, condition, circumstances and amenities, is required.
To further complicate matters, we know of three different ways to calculate months supply of inventory (MSI), two ways to measure average days on market, and two ways to calculate average dollar per square foot values. Square footage itself can be measured in very different ways by architects, builders, appraisers and floor-plan illustrators. For that matter, average and median prices can sometimes show different trends up or down, or price statistics can go up at the same time average dollar per square foot values are going down, and vice versa. All these variations make it that much easier to cherry-pick one single statistic to substantiate some overarching claim regarding where the market is heading.
Which leads to our next point.
RULE 3: Any definitive trend will be reflected over the longer term and in more than a single statistic, i.e. not just last month's median sales price (as quoted in most media articles), but in a wider array of supply, demand and value measures, such as dollar per square foot, months supply of inventory, sales volume, percentage of listings accepting offers, days on market, and so on. We prefer to look at as many different statistical angles on the market as we can think of, to see how they do or don't line up, and prefer quarterly or longer-term data to ever-fluctuating monthly data. Annual data really allows one to step back and see the larger view, instead of just what is in front of one’s shoe.
RULE 4: No one knows the future. Again: No one knows or can confidently predict the future. Recent studies* suggest that the confident predictions of financial market pundits and experts are wrong 50% of the time - or more. (One business professor compared them to monkeys throwing darts.) Generally speaking, you would do as well or better just flipping a coin: Think of the years of pundit projections prior to the 2008 financial and real estate markets meltdown. Or here's another example: Robert Shiller, the Nobel Prize winning economist, who helped develop the respected S&P Case-Shiller Home Price Index (and the complex algorithm behind its calculations) and is certainly one of the most often quoted financial and real estate markets economists in the country, stated in March 2012 that the U.S. homes market was probably still headed down, and that we may "never in our lifetime see a rebound in these prices." Since then the market has gone through a huge recovery - the market actually started to turn in San Francisco in 2011 - with values up enormously virtually everywhere, according to his own Index. That is, he could not have been more wrong. This is an excellent example of an "expert" who became attached to the anti-optimism position for which he became famous in 2008. We’ve seen hundreds of such examples.
It has been found that the most reliable experts are also the most humble, people who constantly double-check, question and qualify their own conclusions. The more confident (or arrogant) or vehement someone is about what is to come, the more you should distrust their opinions.
Financial and real estate markets are now subject to an astounding number of constantly changing, local, national and international, economic, political and even ecological factors. Changes in the Chinese stock market, interest rates, oil prices, EU elections, tax law, the bond market, or a new ballot proposal, natural disaster, election or conflict in the Mideast - all these are samples of the thousands of events that can have significant ramifications for Bay Area real estate. Even a super computer can’t track all the spinning factors and figure out what the future will look like tomorrow.
At Compass, we are not immune to the failings that afflict other analysts, but we try our best to provide straightforward information regarding market conditions, with as many angles and as much detail and context as possible, so that you can make your own informed decisions. Almost all the data is personally investigated and vetted for anomalies before being charted. We make very few predictions, but when we do make a tentative forecast, with lots of caveats, it is based upon what appears to us to be overwhelming supply-and-demand conditions and decades of experience in San Francisco Bay Area real estate. (But please see Rule 4: We really don’t know the future either.)
Patrick Carlisle, Chief Market Analyst, SF Bay Area, Compass
* "Why Do People Pay for Useless Advice? Implications of Gambler's and Hot-Hand Fallacies in False-Expert Setting" by Nattavudh Powdthavee and Yohanes Riyanto, Institute for the Study of Labour, May 2012: Referenced in The Economist in their June 9, 2012, Buttonwood column titled "Not So Expert." The issue was also addressed in the September 2, 2011 issue of the same magazine in an article titled "The Perils of Prediction: Adventures in Punditry" regarding the Good Judgment Project. These articles can be read on the Economist website (subject to being a subscriber).
Copyright 2019 Compass