Digital COVID-19 “Symptom Checkers” Failed to Pick Up Severe COVID-19, Bacterial Pneumonia, and Sepsis

COVID-19 Symptoms Graphic

Digital COVID-19 “Symptom Checkers” May Delay Treatment for Serious Illness

Digital COVID-19 ‘symptom checkers’ may stop some patients from getting prompt treatment for serious illness, suggests an international case simulation study, published in the online journal BMJ Health & Care Informatics.

Both the US and UK symptom checkers consistently failed to identify the symptoms of severe COVID-19, bacterial pneumonia, and sepsis, frequently advising these cases to stay home, the findings indicate.

The availability and use of symptom checkers is on the rise, and they are currently being used at a national level to pick up COVID-19 infection.

Identifying which patients with COVID-19 require treatment is difficult, because the infection can mimic common conditions that rarely require medical attention and because there are no clinical signs or symptoms that reliably predict who will progress to severe disease, note the researchers.

Digital symptom checkers combine a series of set questions and pre-determined responses to advise a person on the most appropriate course of action.

But as yet, there is hardly any evidence for the effectiveness or safety of symptom checkers for prioritizing treatment (triaging) during a pandemic, say the researchers.

They, therefore, looked at the ability of national government-sponsored digital symptom checkers in use in Singapore, Japan, the US, and the UK, to correctly triage people in need of a medical assessment and/or treatment.

The symptom trackers included: the Singapore COVID-19 Symptom Checker; Stop COVID-19 Symptom Checker (Japan); CDC Coronavirus Symptom Checker (US); and 111 COVID-19 Symptom Checker (UK).

COVID-19 death rates in Singapore and Japan are comparatively low; in the US and the UK they are comparatively high.

The researchers wanted to see if the symptom checkers were able to differentiate mild from severe COVID-19, and how well they picked up COVID-19 ‘mimickers’ such as bacterial pneumonia and sepsis in 52 standardized case scenarios.

The cases simulated common COVID-19 related signs/symptoms of varying severity and risk factors. These included: cough and fever; a co-existing condition (high blood pressure) plus cough and fever; suppressed immunity as a result of drug treatment plus cough and fever; and shortness of breath and fever.

These four distinct presentations were then varied in relation to one or more of the following: how long since symptoms had started; the patient’s age; and symptom severity.

The symptom checkers in Singapore and Japan triaged twice as many cases for direct clinical assessment as the symptom checkers in the US and UK.

Singapore had the highest overall referral rate at 88%; the US had the lowest at 38%. Among the simulated cases not referred, the USA and UK triaged a significant number that would typically have required early clinical assessment to ‘stay home’.

The US symptom checker frequently triaged simulated cases with possible severe COVID-19, bacterial pneumonia, and sepsis to stay home and possible neutropenic (low white cell count after chemotherapy) sepsis to seek medical attention within 24 hours.

The UK’s symptom checker frequently triaged possible severe COVID-19 and bacterial pneumonia to stay home with no follow-up and is likely to have delayed treatment for sepsis, severe COVID-19, and severe sepsis, point out the researchers.

While Japan’s symptom checker generally performed well, the simulation revealed a potential delay to treatment for very severe sepsis. And none of the symptom checkers triaged simulated neutropenic sepsis to emergency care.

The researchers single out the UK’s symptom checker for its complex algorithm, and for attempting to quantify symptoms such as shortness of breath and the overall severity of illness by asking subjective, qualitative questions with multiple choice answers.

The questions used to discriminate between degrees of severity aren’t up to the task, they suggest.

Both the US and UK symptom checkers “are likely to delay presentations of serious medical conditions to appropriate care, and as such, are likely to confer an increased risk of morbidity and mortality,” they warn.

“Both symptom checkers maintain a high threshold for referring onward to clinical contact, triaging the majority of patients to stay home with no clinical contact.”

The researchers acknowledge that by reducing physical contacts, symptom checkers can potentially save valuable resources and reduce viral spread, and they require fewer resources than phone and telemedicine triaging services.

But their findings suggest that “whilst ‘symptom checkers’ may be of use to the healthcare COVID-19 response, there is the potential for such patient-led assessment tools to worsen outcomes by delaying appropriate clinical assessment,” particularly if they are used as the only source of medical advice, they conclude.

“Our results support the recommendation that symptom checkers should be subjected to the same level of evidenced-based quality assurance as other diagnostic tests prior to implementation,” they add.

Reference: “Performance of national COVID-19 ‘symptom checkers’: a comparative case simulation study” 9 March 2021, BMJ Health & Care Informatics.
DOI: 10.1136/bmjhci-2020-100187

2 Comments on "Digital COVID-19 “Symptom Checkers” Failed to Pick Up Severe COVID-19, Bacterial Pneumonia, and Sepsis"

  1. FRANK OLE ROLAND | April 2, 2021 at 12:56 pm | Reply

    I suffered deeply with stage four sarcoidosis which progressed to idiopathic pulmonary fibrosis (IPF). I was hospitalized eighteen times in three years, mostly with flare ups and pneumonia. For me, the chronic widespread pain takes my breath away more than the disease itself. At times the pain is so severe I find it difficult to do anything. My life was gradually coming to an end, until I saw World Herbs Clinic on google during my research for alternative help for IPF.. I knew health is wealth thus I decided to give it a try, thank God I did. I got the Lungs disease formula four working days after placing an order. OMG I started noticing change in my breath after one month of taking the herbs formula, My IPF was completely reversed after THREE months of usage. Now i’m happy and free from this deadly disease. I recommend World Herbs Clinic for Lungs disease patients..

  2. Frank Roland | April 2, 2021 at 12:57 pm | Reply

    READ PLEASE

    I suffered deeply with stage four sarcoidosis which progressed to idiopathic pulmonary fibrosis (IPF). I was hospitalized eighteen times in three years, mostly with flare ups and pneumonia. For me, the chronic widespread pain takes my breath away more than the disease itself. At times the pain is so severe I find it difficult to do anything. My life was gradually coming to an end, until I saw World Herbs Clinic on google during my research for alternative help for IPF.. I knew health is wealth thus I decided to give it a try, thank God I did. I got the Lungs disease formula four working days after placing an order. OMG I started noticing change in my breath after one month of taking the herbs formula, My IPF was completely reversed after THREE months of usage. Now i’m happy and free from this deadly disease. I recommend World Herbs Clinic for Lungs disease patients..

Leave a comment

Email address is optional. If provided, your email will not be published or shared.