Monday, 20 April 2015

Real Estate of Mind: Exploring New York City real estate data




What's this all about?

We've recently bought an apartment here in New York, and it got me thinking a bit about the property market. There are lots of websites like http://streeteasy.com/ for finding properties, and there are of course resources like http://www.nytimes.com/pages/realestate/index.html for reading about the market, but you never really get the full picture all at once.

I was interested in seeing what an entire years worth of residential property sales looks like In New York, and so I went in search of a data source. Fortunaltey New York City is actually really good at making data publicly available through the its open data initiative https://data.cityofnewyork.us/. And I specifically found this site http://www1.nyc.gov/site/finance/taxes/property-rolling-sales-data.page which provides data for EVERY SINGLE PROPERTY SALE in New York City for the last 12 months.




I decided to start with just Manhattan and downloaded the Excel. And it looks like this:


Oh no, stupid Excel format - guess I'll have to edit it before loading into Tableau.....




...... nope! Tableau 9 to the rescue:


BOOM! What a cool new feature.



Step one complete (I did add a unique ID field as well). Next up I wanted to be able to map all the addresses. The file includes the address, sometimes with apartment number sometimes without, and zipcode but I'd like to be able to plot each address exactly. This can be done relatively easily. First I had to create a standard format for the addresses:


And then I copied the resulting table of addresses out of Tableau and into a batch geocoder. There area number available on-line, many of them free, but they were taking forever so I tried the one from Texas A&M University. There is a small cost but it is a lot faster and less worrisome than the free versions when doing a large number of addresses. Its also a lot quicker than doing it manually (which is what I used to do......).

The resulting table looks like this, and I will blend this back into the workbook.



Note it includes a field called 'MatchType'. Lets see how it did:



Well not bad overall, but some 300+ building addresses appeared in Brooklyn and Staten Island, which is a bit disappointing when you consider that the zipcode was part of the data set.

Anyhow, I'd say the matching is about 90% correct overall which is pretty decent. This becomes clearer when you colour the buildings by their neighborhood tag.




So what else can we see from the data? Well first up there were some 22,282 sales records in Manhattan in the last 12 months. The next thing I looked at was the sales prices to take a look at the most expensive sales:


Now I know that house prices have been going up, but even in Manhattan $3.3 billion seems a little steep. A bit of googling revealed that 240 1st Ave is in fact the address of Stuyvesant Town, and 3 Peter Cooper Road is Peter Cooper Village. The entire STPCV complex of over 11,000 apartments was bought last year by Fortress Investment Group for $4.7bn.

So its clear I'm not looking at just individual homes here. I investigated further and found that the data set included many types of properties:


So I decided to do two things - exclude any building class that didn't sound like it could be residential, all pure rental buildings and also excluded everything greater than $101m which is the current record for the city or $zero. Another problem with this dataset is that its quite difficult to tell the difference between a whole building sale and an apartment or house sale.  So to be safe I excluded all sales that were in condo's or co-ops but did not include any apartment names or numbers. Like so:


And this is how the most expensive sales look after, clearly 157 West 57th Street is doing quite well at attracting its share of billionaires (many of whom of course won't even move in):



But while these sales get all the media attention, I wanted to take a look at how much of the market was controlled by these oligarchy sales, and how much by the rest of the market. Time for some bucketing. The peak for sales prices is between $400k and $600k.


Interestingly there is a dip around $1m. Looking into this in some more detail, we see a big spike at $990 and a big fall at $1m. The reason? A New York City 'mansion tax' of 1% kicks in at $1m:



Looking back up to some bigger buckets, the distribution of number of sales and proportion of $ sold looks like this:

So whilst homes costing over $15m only represent less than 1% of all sales, they account for 14% of the total dollar value paid.

How about the view by neighborhood? Here's a plot of number of units sold versus average sale value by Manhattan neighborhood:



Apartment sales in SoHo averaged over $5m each in the last year. The most sales were on the Upper East Side. The cheapest areas (not labelled above) were Harlem West, Inwood and Morningside Heights.

And how about condos versus co-ops? When we were looking to buy an apartment we learned that co-ops are usually cheaper than an equivalent condo. This is because purchasers of co-ops have to get board approval and that in most cases rules out people who are buying investment properties or buy-to-rent, and so the potential market is smaller. Condo's on the other hand have very few restrictions and so are more popular with non-resident buyers who want to buy purely for investment purposes. Most of the new luxury buildings coming on the market are condo's.

The chart below shows the split sales and average prices by building category. As you can see the majority of sales in Manhattan are split almost evenly between co-ops and condos in elevator buildings. And as suspected, the average condo sales price is significantly higher than the average co-op.



Of course these comparisons don't account for things like square feet or number of bedroom, but they still provide some interesting insights.







52 comments:

  1. This comment has been removed by a blog administrator.

    ReplyDelete
  2. This comment has been removed by a blog administrator.

    ReplyDelete
  3. Looking for Property? Buy, Sell or Buy Property in Delhi at buysellrentncr.com - Delhi/NCR leading online real estate portal. Find Thousands of Properties from property owners & property dealers and Builders across Delhi/NCR.

    ReplyDelete
  4. Thanks for sharing a great and attractive blog on the information on real estate.

    Really Nice!

    New York Realtor

    ReplyDelete
  5. Thanks for sharing a great and attractive blog on the Luxury Homes.
    I appreciate your work that makes this blog useful in the searching for Long Island Luxury Homes.
    New York Realtor

    ReplyDelete
  6. Find new launch properties from reputed builders in delhi, gurgaon , Noida , Ghaziabad etc Get real estate in delhi/ncr – buy , sell , rent , buy Property in Ghaziabad, buying real estate in delhi Ncr, commercial Property in Ghaziabad , residential property in Ghaziabad .

    ReplyDelete
  7. It's actually a cool and useful piece of info. I am glad that you simply shared this useful info with us. Please keep us up to date like this. Thanks for sharing, You can also check out this (http://www.sqiar.com/services).

    ReplyDelete
  8. Some great real estate brokers are an extraordinary fusion of being delightful, practical gentlemen while being totally proficient, responsive and able all around that one might ever need from the Luxury Real Estate dove mountain manager.

    ReplyDelete
  9. This comment has been removed by a blog administrator.

    ReplyDelete
  10. Thank you very much for sharing the New York City real estate data. It is so impressive and you made me think about investing in this real estate market. Hey do you have any information regarding Dove mountain real estate opportunities?

    ReplyDelete
  11. Just wanted to say I love reading your blog and look forward to all your posts! The Leading Real Estate Agency which helps expatriates and investors to find a right property in Phuket and other parts of Thailand.

    ReplyDelete
  12. Excellent .. Amazing .. I’ll bookmark your blog and take the feeds also…I’m happy to find so many useful info here in the post, we need work out more techniques in this regard, thanks for sharing.
    Puyallup Real estate

    ReplyDelete
  13. I must say, I thought this was a pretty interesting read when it comes to this topic. Liked the material. . . . .
    Puyallup Real estate

    ReplyDelete
  14. Buy or sell properties in Noida , Delhi/ NCR and also get updated yourself about the properties on rent and sell in Delhi / NCR with India’s leading property listing website-Propertybala.com @http://propertybala.com/properties/property-for-sale/

    ReplyDelete
  15. Fantastic articles is post by you in this blog. You give a nice thing. Thank you for such a nice article. Every word og this blog helps me to give detail to me.
    Visit: Fort Lauderdale real estate

    ReplyDelete
  16. Playa del Carmen real estate experts. We are the Premier Playa del Carmen real estate agency with over 10 years of successful and safe investment properties.http://www.buyplaya.com/

    ReplyDelete
  17. Nice Article you posted here, about Real Estate and homes retailer in Long Island. Plainview homes for sale

    ReplyDelete
  18. I have understood everything in this article, and I need more on this to complete my study on the topic, thanks to provide such nice details. www.ακινητα.com

    ReplyDelete
  19. Private purchase to-let properties have made up the heft of these ventures however there is an in number move towards second properties for occasion and transient lets. Business properties have taken after a comparative suit and seem, by all accounts, to be propping up the pack regarding venture yields as of late. aparments for rent dubai marina

    ReplyDelete
  20. Great detailed information, I ll be visiting you more frequently, here is very interesting information.

    Advance Commission & Real Estate Commission Loans

    ReplyDelete
  21. Committed towards offering highly appreciable properties to individual buyers, partners and investors, Mahidhara brings you Plots,villas in Electronic City, Anekal Bangalore.
    Villa Plots near Anekal|Plots in Electronic City Bangalore

    ReplyDelete
  22. Interesting topic. I enjoyed reading, and the knowledge and perspective that my reading gives me has strengthened my teaching skills and presentation abilities.Just letting you know how I feel! You always had great informative, down-to-earth, enjoyable, real-life posts!

    Resume writer @ professional resume writing service


    ReplyDelete
  23. Great blog Amazing I’ll bookmark your blog and take the feeds also…I’m happy to find so many useful info here in the post, we need work out more techniques in this regard, thanks for sharing.Thanks for sharing.......

    Kingsmill Studios | Closest student accommodation to Huddersfield University

    ReplyDelete
  24. Great info shared on the real estate data mind of New York. Pretty informative for the people and would be quite helpful for them. Thanks for sharing this post!

    Also anyone looking for real estate software solutions give a try to the softwares of Realty Redefined.

    ReplyDelete
  25. Really Informative article for Real Estate Business or who want sell or buy houses.

    We buy houses Atlanta

    Thanks

    ReplyDelete
  26. Interesting topic. I enjoyed reading, and the knowledge and perspective that my reading gives me has strengthened my teaching skills and presentation abilities

    ReplyDelete
  27. When I take a look at your website in Safari, it looks fine however when opening in Internet Explorer, it’s got some overlapping issues. I just wanted to provide you with a quick heads up! Apart from that, wonderful blog!
    Flats for Sale in Manikonda

    ReplyDelete
  28. Nice post....Make sure when you become an exclusive sales client with a NYC real estate agent, she devises a more direct, comprehensive marketing plan than the typical boiler plate marketing plan.

    ReplyDelete
  29. This comment has been removed by the author.

    ReplyDelete
  30. This comment has been removed by a blog administrator.

    ReplyDelete
  31. This comment has been removed by the author.

    ReplyDelete
  32. I found out some fresh data. Manhattan still is very much a seller’s market. Real estate here now spends less time on the market with only 82 days between listing and sale, compared to 105 days in 2014 according to https://tranio.com/traniopedia/tips/foreign_buyers_guide_to_residential_property_in_new_york_city/. Brooklyn demonstrated stronger price growth than Manhattan and New York City as a whole over the last fifteen years. Average rental rate in Manhattan is $4,073, in Brooklyn it is $3,189. Or you could rent a flat in Bronx for $1,813.

    ReplyDelete
  33. Ajnara Homes - 2-3-4 BHK @ Rs. 2860 /SQFT‎
    Amenities: Club house, Swimming Pool, Jogging Track., Banquet/Party Hall.

    ReplyDelete
  34. Ajnara presents Ajnara Daffodil at Sector 137 Noida. Ajnara Daffodil offers 2bhk and 3bhk apartments on prime location.

    ReplyDelete
  35. Here we find so many useful information about real estate software

    ReplyDelete
  36. very much impressive presenttion, what an extensive research and effort. appreciate
    New York Long Distance Movers

    ReplyDelete
  37. The article in this post is on the study of real estate study in America from different city. The real estate broom and the reasons are awesome. Your presentation skills and the data analysis are very impressive. In the end i would like to say thanks for sharing the knowledge about the property and sales in American Cities.
    DeveloperHUB

    ReplyDelete
  38. Pretty good I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I'll be subscribing to your feed and I hope you post again soon. Big thanks for the useful info.
    red dingo cat collars

    ReplyDelete
  39. Appreciate it Peter G. You must be a good researcher and you deserve a 5 start :)
    Moving Company NY

    ReplyDelete
  40. Thank you for publishing your blog about Auckland property sales. Its an awesome article because after reading your article I have got some good ideas to sell my apartment.

    ReplyDelete
  41. Hello Everybody,
    My name is Mrs Sharon Sim. I live in Singapore and i am a happy woman today? and i told my self that any lender that rescue my family from our poor situation, i will refer any person that is looking for loan to him, he gave me happiness to me and my family, i was in need of a loan of S$250,000.00 to start my life all over as i am a single mother with 3 kids I met this honest and GOD fearing man loan lender that help me with a loan of S$250,000.00 SG. Dollar, he is a GOD fearing man, if you are in need of loan and you will pay back the loan please contact him tell him that is Mrs Sharon, that refer you to him. contact Dr Purva Pius,via email:(urgentloan22@gmail.com) Thank you.

    BORROWERS APPLICATION DETAILS


    1. Name Of Applicant in Full:……..
    2. Telephone Numbers:……….
    3. Address and Location:…….
    4. Amount in request………..
    5. Repayment Period:………..
    6. Purpose Of Loan………….
    7. country…………………
    8. phone…………………..
    9. occupation………………
    10.age/sex…………………
    11.Monthly Income…………..
    12.Email……………..

    Regards.
    Managements
    Email Kindly Contact: urgentloan22@gmail.com

    ReplyDelete
  42. Wow, great article with the huge explanation. Thanks for the sharing.

    Flats for sale | Apartments for sale

    ReplyDelete
  43. I was interested in seeing what an entire years worth of residential property sales looks like In New York, and so I went in search of a data source.park place

    ReplyDelete
  44. I found this cool post here and enjoyed reading your articles, thank you. This is really a helpful post.
    nyc seo

    ReplyDelete
  45. Great article, nice blog thanks.It will more useful. Please visit our website to know more about real estate Wilmington NC Real Estate

    ReplyDelete
  46. This comment has been removed by the author.

    ReplyDelete
  47. Depict all the information in graph or charts simply shows how likely is Manhattan for buying properties and living over there apartments rent manhattan

    ReplyDelete
  48. Wow that's a wonderfull blog having all details & helpful. Business space for rent

    ReplyDelete
  49. it's good to read this informative post i really like the content of this blog You give very useful points about Property in Kerala.

    apartment in dubai

    ReplyDelete
  50. Blog Căn hộ flora anh đào
    Phân phốiCăn hộ Flora cao cấp,
    BánDự án Flora Anh Đào Quận 9 ,
    BánCăn hộ quận 9 cao cấp,
    Cho thuêDự án quận 9 Nam Long,
    Phân phốiFlora anh đào quận 9 cao cấp,
    BánCăn hộ nam long quận 9 cao cấp,

    Blog Căn hộ the eastern
    Bánchung cu The Eastern Giá gốc,
    ChuyênCho thuê The Eastern Quận 9 HKV ,
    Phân phốichung cư the eastern quận 9 Giá gốc,
    Dự ánthe eastern quận 9 Giá gốc,

    Blog Căn hộ River City
    BánCăn hộ River CityAn Gia,
    ChuyênRiver City Quận 7 Giá tốt ,
    Phân phốichung cư The Art Quận 9,
    Dự ánRiver City quận 7 An Gia,

    Blog Căn hộ The Art
    BánCăn hộ The ArtGia Hoà,
    ChuyênDự án The Art Giá tốt ,
    Phân phốichung cư The Art Quận 9,
    Dự ánThe Art quận 9 Gia Hoà,

    ReplyDelete
  51. Very Nice Blog Its Very Interesting And Useful Post For sell your house fast And Property. thank you For Posting And Sharing With Us.Your Writting Style Is Very nice keep It Up And Please Tell Me How To Sell House Fast.
    best way to sell your house fast.

    ReplyDelete
  52. This is really good information about the real estate business..
    Thanks for sharing..!!

    ReplyDelete

Note: only a member of this blog may post a comment.