Yup - pretty sure that's gonna be small quantities of a $5-10k chip that are going to be reserved for research projects to spend a few years actually developing tools to make use of it before variants get to be more generally available...
Very interesting though, will be a potential powerhouse for the right applications.
Data centers like Google, Amazon, Microsoft Azure and Bing, etc will be the first to benefit in terms of performance/power consumption. They are all already doing this with external FPGA boards for the last two years.
If (not much of an if, but when) they get adopted on those data centers it will bring the cost down, so we do have the Cloud to thank for this to become more mainstream.
Edit: Altera has had OpenCL toolchains available for their high end FPGAs for a couple of years as well.
Edit2: Correction, it has been four and a half years since they announced it:
https://www.altera.com/about/news_room/releases/_2011/products/nr-opencl.tablet.htmlSo my bet is that they are going to hit the floor running.