My New Favorite COVID-19 Dashboard

TL;DR I’m now using this dashboard as a way to make sense of what’s happening with COVID-19. It’s still too soon to draw any conclusions about how well the U.S.’s interventions overall are working.

I started trying to make sense of the COVID-19 growth rate data myself on March 13, 16 days ago. I learned a lot along the way, and my daily ritual of looking up numbers and updating my spreadsheet has been strangely calming. Here’s my latest graph:

Three observations when comparing this to last week’s graph:

  1. Italy’s growth rate seems to be flattening, which is a positive sign
  2. U.S.’s growth curve continues to rise at a steady rate; more on this below
  3. Even though China and Korea’s growth rates have been steady for a while now, it’s not zero. They have this under control (for now), but it’s far from over, and it won’t be until we have a vaccine, which folks keep saying is at least 12-18 months away.

My friend, Scott Foehner, chided me last week for saying that the results are lagging by about a week. He’s right. Based on Tomas Pueyo’s analysis (which I cited in my original blog post), the lag is more like 12 days. This is why the Bay Area shelter-in-place ordinance was for three weeks — that’s how much time you need to see if you’re containing your growth rate.

Shelter-in-place in the Bay Area started on March 17, exactly 12 days ago and four days after I started tracking. California’s order started on March 20. Other states followed after that, but not all.

It’s hard to make sense of all this when aggregated as a country. I’ve been wanting regional data for a while now, but have felt too overwhelmed to parse it out myself. Fortunately, other people have been doing this.

One of the positive outcomes of me doing this for myself for the past few weeks is that it’s given me a better sense of how to interpret other people’s graphs, and it’s helped me separate the wheat from the chaff. It’s also made me realize how poor data literacy seems to be for many media outlets, including major ones. They’re contributing to the problem by overwhelming people with graphs that are either not relevant or are not contextualized.

One media outlet that’s been doing a great job, in my opinion, has been The Financial Times, thanks to John Burn-Murdoch. Inspired by John’s work, Wade Fagen-Ulmschneider has produced this excellent dashboard, which has provided me exactly what I’ve wanted. (Hat tip to Rashmi Sinha.) I may stop updating my spreadsheet as a result, although I might miss the ritual too much.

Wade’s dashboard is pretty configurable overall, although you have limited control over which region’s data you’re showing. Here’s the closest equivalent to what I’ve been tracking:

And here’s what I’ve really wanted to see: the state-by-state data:

What does this tell us about the interventions so far? Again, not much. It’s too soon. Check back in another week.

I’ve seen some articles floating around with graphs comparing California to New York, crowing that sheltering-in-place is already working here. That may be the case, but it’s still too early for us to know that, and it’s irresponsible to point to a chart and suggest that this is the case. There are lots of reasons why New York might be doing so poorly compared to California that have nothing to do with interventions, density being the obvious one. Regardless, history has proven that even a few days can make a huge difference when it comes to containing epidemics, and I feel incredibly grateful that our local leaders acted as quickly as they did.

I think there are two questions that are on people’s minds. One is about hospital capacity. I’ve seen various attempts to model this, including the Covid Act Now site I mentioned last week. The one I find easiest to browse is this dashboard from the Institute for Health Metrics and Evaluation. They publish their model, which I haven’t even attempted to parse yet. (I doubt that I have the expertise to evaluate it anyway.) It suggests that, even if our current measures have flattened the curve in California, we’ll still exceed our capacity of ICU beds needed in about two weeks, although we should be okay in terms of general hospital capacity.

The second question is how much longer we’ll need to shelter-in-place (or worse). Even if we flatten the curve, lifting shelter-in-place will just get that curve going again unless we have an alternative way of managing it (e.g. test-and-trace). I haven’t seen any indications of when that will happen, so we’ll just have to continue to be patient. I feel like every day is a grind, and I’m one of the lucky ones. I can’t imagine how folks on the frontlines and those far less fortunate than me are dealing right now.

Updated COVID-19 Numbers (March 20, 2020) and Thoughts

Update: A new iteration is now available:

My morning ritual for the past week has been to update my COVID-19 spreadsheet and ponder my chart. Here’s the latest:

On the one hand, if you compare it to last week’s chart, it’s not a happy result for those of us in the U.S. (Italy’s curve might be flattening. We’ll see next week.) On the other hand, remember that this is a lagging indicator. This past week’s line was essentially pre-determined by what happened the previous week. Earlier this week, the Bay Area instituted shelter-in-place. Shortly thereafter, California made it state-wide, and New York and Illinois followed suit after that. We’ll see if this has any noticeable impact next week.

I made one slight tweak to the graph (adding labels to the axes; thanks to Kate Wing for the gentle scolding). I’d like to change the gridlines on the x-axis to every seven days, but can’t do that in Google Sheets. Not a huge deal. I’d also like to experiment with a log 2 graph (versus log 10) on the y-axis to more easily show how many days it takes for new cases to double, but again, can’t do that from Google Sheets. Again, not a big deal. I’d also like to do a region-by-region analysis, as suggested by many others and made possible by David Janes’ data, but haven’t gotten around to that yet.

I started doing all of this as an exercise in self-care. I wanted to understand what was happening, and I found what I was reading to be not just largely unhelpful, but actually debilitating. This has helped a lot. There is something very calming about looking up numbers, plugging them into a spreadsheet, and pondering the results, even if the results aren’t very good. (Come to think of it, this also played a huge role in helping me achieve better work-life balance, so it might be a pattern.) I haven’t been able to avoid the media as much as I hoped, but it’s helped me make sense of what I’m seeing and ignore articles and missives that are generally unhelpful or worse. It’s also validating when folks who understand this stuff far better than me are coming to similar conclusions.

I’ve loved seeing friends and others play with the data as well. One of the best websites I’ve seen is Covid Act Now, which shows state-by-state projections based on hospital capacity and what we understand about different interventions. They’ve also shared their model openly, and they’re posting the right disclaimers. (Good rule of thumb: Be skeptical of anyone who claims certainty about their conclusions unless they’re an epidemiologist, and even then, take everything with a grain of salt.)

I’m also inspired by everyone working on the front lines — from health care workers to domestic workers — and to those who are doing their part to support those who are. (Hat tip to Jon Stahl for sharing the amazing work that Carl Coryell-Martin instigated, for example.) Stay safe everyone, stay at home if you can, and be well.

How Are We Doing with COVID-19 in the U.S. Right Now?

Update: More recent iterations are available:

Thanks to those of you who commented on my post last night on my attempts to better understand what’s happening with Coronavirus and how we’re currently doing here in the U.S. My friend, Raj, suggested I do a cleaner version, so I put the data in this Google Spreadsheet and let technology do its thing:

A reminder: These lines represent normalized (by population) daily new cases in the U.S. (blue), China (red), South Korea (yellow), and Italy (green). I haven’t seen anyone else normalize by population, which helps make more of an apples-by-apples comparison. The closest thing I’ve seen is Our World In Data’s sparklines, which are wonderful. (Hat tip to Phoebe Ayers for the pointer.)

I also made two improvements from my previous version:

  1. The graphs are generated from precise data points rather than my back-of-envelope calculations and sketches. I also made the spreadsheet I used public so that others can double-check or re-use.
  2. I picked a more precise “Day 0” for each country — the first day with zero new cases followed by a bunch of non-zero days. This worked out to February 27 for the U.S., January 22 for China, February 18 for South Korea, and February 20 for Italy.

Unlike my previous version, I’m showing the full Italy curve. (Wow.) Here’s a zoomed-in version that gives us a better sense of what’s happening in the U.S. (and is also pretty close to last night’s rough sketch, which makes me happy):

The graph suggests that we’ve been able to “flatten the curve” so far, and that aggressive measures by local government and businesses are probably working. However, seeing the curve jump like Italy’s is still not out-of-the-question. We still don’t have widespread testing in this country (although there are positive signs), and — as my friend Sheldon Chang observed — we’re unlikely to be able to implement the aggressive, targeted, digital surveillance that they’re able to do in Asia. More aggressive containment is still a possibility, but for now, I feel like I’m able to breathe a bit easier. Stay vigilant, everyone! Keep your physical distance, wash your hands, and take care!

Making Sense of COVID-19 (and Trying to Stay Calm)

Update: More recent iterations are available:

Like most folks I know, I’ve been feeling increasingly stressed about the Coronavirus pandemic. I had done my best to educate myself and prepare, but I’ve been surprised by how scared and anxious I’ve been this past week.

Early on, my social media feed was invaluable at helping me understand what was happening. Now, it’s just causing me stress. Yesterday, I decided to try to limit my social media (and media) exposure. Instead, I would check the daily new cases graph once-ish a day, then just live my life. I’ve been primarily using worldometer, but I switch to The New York Times (which is updated more frequently and comes with news summaries) when I get antsy.

My reasoning was simple. Coronavirus is here in the U.S., and it’s spreading. (Because of lack of testing, we likely have many more cases than currently reported.) We missed our opportunity for containment, so now it’s all about mitigation. Most of the commentary doesn’t offer any real insight into how we’re actually doing in that regard, so I’m better off mostly ignoring it. The curve gives me real data on how we’re doing.

The problem is that it’s hard for me to gauge anything from this data other than that we’re on the growth-side of the curve, which I already know. I decided to map some additional data onto the curve to see if that helped. I looked at three other countries: China, South Korea, and Italy. China and South Korea have, by all accounts, handled things well. I’m not sure if Italy is handling things poorly, but — by all accounts — things are going poorly there. I figured that comparing these three data sets with the U.S. curve would give me a better sense of how we’re doing and what to possibly expect.

I looked at roughly a month of data for all four countries. Cases in South Korea, Italy, and the U.S. all started coming up around the same time, so I could actually use data from the same time period. Thing started blowing up in China roughly a month earlier, so I took the earlier data and mapped it onto the current time period. The key step I took that I haven’t seen in any other charts so far was to normalize the data by population (South Korea = 0.15; Italy = 0.19; U.S. = 1; China = 4.35).

Here’s what I came up with:

The orange curve is the U.S. data. The dotted line is a worst-case projection based on where we actually are based on death rate. (See Mona Chalabi’s excellent Instagram post, which uses analysis from Tomas Pueyo, for more on this.) I did not do a worst-case projection for South Korea (which could also be about 10 times off), Italy (which could be as much as 100 times off), or China (Mona didn’t include China in her graphic). I also didn’t represent the spike in China’s data that arose when they changed how they were testing, as it’s accounted for in the peak and subsequent data.

Here’s how I read this: China did an amazing job of managing the situation. South Korea had an awful spike, and somehow managed to turn it around. Italy — wow. Things are not good in Italy. Right now, we in the U.S. are doing okay, but it’s still very early, and it remains to be seen what our curve will look like. However, at least now I have some points of comparison.

Doing this exercise made me feel much better. Feedback (especially critiques and corrections) encouraged! Stay diligent, keep your (physical) distance, wash your hands, and take care of yourselves!