Smartwatches from tech companies like Apple and Garmin make it easy to see a number that could reflect how old you are more accurately than your age: the VO2max, the maximum amount of oxygen that your body can use during intense exercise.
The higher your VO2max, exercise experts say, the better your cardiovascular fitness. In the past, only serious athletes sought a traditional VO2max test, which involved wearing cumbersome sensors while exercising inside a lab, but now anyone can get an estimate by wearing a smartwatch and moving around.
Is it good to have access to this kind of information? And how accurate could a wearable be? In the last five months, when I fell down a VO2max rabbit hole, I learned some uncomfortable truths about my health and the limits of smartwatches.
First, let me tell you about my fitness journey. In November, while I was out celebrating my birthday, my Apple Watch delivered the most unwanted gift: a notification of a high heart rate. In search of a quick solution, I bought a membership at a high-intensity interval gym. Five months and many kettlebell swings and jump squats later, I felt progress. I burned fat, gained muscle and felt more energetic. The Apple Watch gave me a VO2max estimate of 40, just shy of average, and a Garmin watch that I also wore rated me at 45.
All that was left to do was to take a real VO2max test, so I found one. I got my lab results: 25, a rating of poor, far below the flattering results from the Apple Watch and Garmin. Devastating.
Dr. Ethan Weiss, a cardiologist in San Francisco who has studied wearable technology for many years, said my experiment underscored the pros and cons of using smartwatch data to explore health.
“On the one hand, you can give it credit for kicking you in the butt to tell you to go work out,” he said. “But on the other hand, now you’re sort of burned with this real test and like, ‘What do I do with this number?’”
Fortunately, after studying all the data, learning how the wearable algorithms work and talking with health experts, I arrived at a positive conclusion: Even if the smartwatch numbers were wrong, they were correct in broad strokes, and I was probably better off wearing one than not.
A Deeper Look at the Data
Last month, my gym in Oakland, Calif., called Sweat, announced that it had teamed up with PNOĒ, a metabolic health lab, to offer clinical-grade VO2max testing, so I signed up with gusto.
The purpose of a clinical VO2max test is to measure your maximum oxygen intake at the point that you reach exhaustion. This metric — the ability for a person to breathe in oxygen and produce carbon dioxide during exercise — is a strong indicator of cardiovascular fitness.
The test was very different from the way the wearables estimated my VO2max. The Apple Watch and Garmin study your heart rate and movement while you’re walking or running for at least 10 minutes and tally a score.
Spokespeople for Apple and Garmin referred to documents describing their methods. To inform their algorithms on how to make these estimates, Apple and Garmin ran studies involving people who were doing a real VO2max test as well as other exercises and studied their heart rates and various metrics.
The key word is “estimate.” The watches aren’t actually measuring your oxygen intake and, therefore, aren’t actually measuring your VO2max.
“It’s at best an imputed VO2max,” Dr. Weiss said. “Not only do you not have an oxygen mask, you’re not actually exerting yourself to exhaustion.”
A simple reason that my wearable estimates were so far off from my real VO2max result is that the way my body works doesn’t match the heart-rate and oxygen-intake patterns of participants in the Apple and Garmin studies. Such is the danger of putting too much trust in algorithms.
That left me with no choice but to embrace the hard truth: My VO2max result in the lab test was very low.
Ignore the Numbers; Follow the Trends
In the end, all the health experts I interviewed agreed that even though the wearable data — much of it flawed — had given me anxiety, I had reached a net positive. The Apple Watch nudged me to pay closer attention to my health, and as a result I’m healthier now.
The broad trends shown by the wearables were accurate: Months ago, after the pandemic had taken a toll on my body and mind, I was in my worst shape in years, and the watch numbers were low. Now, even though the watch numbers are too high, I do look and feel better, and that’s all that really matters.
Whether you’re using devices to measure your progress in losing weight, getting more sleep or taking more footsteps, what you need to know is whether the numbers are going up or down. But don’t take them too seriously, because all sorts of factors could be throwing them off — a loose wrist strap, a faulty sensor or, as in my case, imperfect algorithms.
“It’s the trend that’s important, not the absolute number, because this stuff’s not accurate,” Dr. Adams said.
The New York Times
