Data, data everywhere

This week Planet successfully launched 88 of its doves, taking another massive step forward in mapping the entire planet daily. I have written about the dramatic increase in temporal resolution data several times in the past. It is worth repeating though – I think – that while Remote Sensing is not new, the level of data available is at unprecedented levels.

If you haven’t seen the footage of the doves being released then it is definitely worth watching below

Data Explosion

This pending explosion of data has again made me think of how the cost of data has changed. I have written about this world oil article before here.

“Data prices have decreased. Perhaps the most dramatic price plunge is for Landsat TM data. In the 1990s, the price was $4,400 per scene. Today, it is $600.” (World Oil 2002).

I checked how many acquisitions of Landsat 8 (as of 18th Feb 2017) have been made on Path 201 Row 24 (it so happens to cover London). So far, since the first image (April 12th 2013) there have been 88 acquisitions. Using the 1990s price to purchase all these images would have cost just over $387k; today it is free.

If you want to study the whole of England and Wales using Landsat 8 you need 18 tiles (some have large overlaps)

As of 18th Feb 2017 if you wanted to build a time series of Landsat 8 tiles (not all are cloud free – it is England and Wales remember!) you have 1672 multiband images available.

Almost 4 years of Landsat 8 data, based on 1990s prices, would have cost a bit more than $7.3 million. Thanks to the free and open policy that ESA have also adopted this data is free today and that frankly is incredible and opens up an amazing resource about our planet.

Storage

This brings me finally to storage. Cloud storage is perhaps the only way to manage this vast amount of data. It is not too long ago that satellite data was being delivered on 10s of CDs and, later, DVDs. Today, storing this amount of data on the cloud is perhaps the only option. I wonder if this is going to drive more compressional image formats to help make this data more ‘manageable’.

“The expanded fleet of satellites will send over 3 terabytes of data a day”

http://www.economist.com/news/business/21717110-analysing-images-space-could-be-big-business-planets-satellites-offer-customers-new-world

The cost of storage has fallen with this article graphing the declining costs (written 2014)

http://social.techcrunch.com/2014/08/20/cloud-storage-is-eating-alive-traditional-storage/

I found this an interesting article

“A WORD OF WARNING: storage has never been cheaper with headline storage costs looking ridiculously cheep, but pricing can quickly get complicated and unpredictable especially if you plan to move large volumes of data”

Without these falling storage costs would this new era of Earth Observation even be possible? I’d love to know your thoughts.