The big thing with VR is presence, and from what I've seen of Oculus Rift (I have no experience with The Vive) it just doesn't deliver presence. Granted, I've never personally used one, but I've read a lot about them on the internet so I'm basically an expert. You feel like you're kinda there, in the game world, but that's about it. You can't realistically move and traverse the gameworld with natural body movements. You're still limited by the game's engine, and things can start to feel odd and unnatural because of that. Most people think that it's going to be some Star Trek holodeck experience, but it's really not. You get a visual and that's it. It neglects several human senses that would make VR something really special, like touch and smell.
There are a few devices in the works to remedy this movement problem, but they're all cumbersome and will probably be very expensive for the average consumer. The best attempt I've seen at this is some sort of
treadmill that you stand in the middle of with tethers strapped to your body to prevent you from falling over. Do you honestly think most people will want to buy something like this for a more ideal VR experience? It looks like something you'd put a mental patient in, or a test subject in a lab. Not to mention you need a pretty powerful PC to even run VR games, which is another reason it will not take off.
Plus, if we look at the games, most are old games with compatibility built in via drivers or whatever. There are very few games that were built around this technology. This is because developers want a guaranteed payoff; spending potentially millions of dollars developing a VR game and trying to sell it when there is a very small demand and low install base is just a stupid idea.
Also, how can you say VR has already taken off when most VR headsets are being sold as development kits? Is there even one out yet for the basic consumer?? Just because companies are making something doesn't mean it has taken off. The important part is having a successful product, and VR looks like it's just setting itself up for failure.