New App Uses AI To Classify Skin Conditions With the Snap of a Picture

Piction Health App Skin Conditions

Piction Health’s app can help doctors classify a range of skin conditions. Credit: MIT News, with images courtesy of Piction Health

Piction Health, founded by Susan Conover SM ’15, uses machine learning to help physicians identify and manage skin disease.

When Susan Conover wanted to get a strange-looking mole checked out at the age of 22, she was told it would take three months to see a dermatologist. When the mole was finally removed and biopsied, doctors determined it was cancerous. At the time, no one could be sure the cancer hadn’t spread to other parts of her body — the critical difference between stage 2 and stage 3 or 4 melanoma.

Thankfully, it turned out that the mole ended up being confined to one spot. However, the experience launched Conover into the world of skin diseases and dermatology. After exploring those topics and possible technological solutions in MIT’s System Design and Management graduate program, Conover founded the startup company Piction Health.

Piction Health began as a mobile app that used artificial intelligence to recognize melanoma from images. However, over time, Conover realized that other skin conditions make up the vast majority of cases physicians and dermatologists see. Today, Conover and her co-founder Pranav Kuber focus on helping doctors identify and manage the most common skin conditions — including rashes like eczema, acne, and shingles — and plan to partner with a company to help diagnose skin cancers down the line.

Piction Health AI Powered App

Piction Health, founded by MIT alumna Susan Conover, offers an artificial intelligence-powered mobile app to help primary care physicians identify skin diseases. Credit: Christine Daniloff, MIT; stock images

“All these other conditions are the ones that are often referred to dermatology, and dermatologists become frustrated because they’d prefer to be spending time on skin cancer cases or other conditions that need their help,” Conover says. “We realized we needed to pivot away from skin cancer in order to help skin cancer patients see the dermatologist faster.”

After primary care physicians take a photo of a patient’s skin condition, Piction’s app displays images of similar skin presentations. Piction also helps doctors differentiate between the conditions they most suspect to make better care decisions for the patient.

According to Conover, Piction can reduce the time it takes physicians to evaluate a case by around 30 percent. It can also help physicians refer a patient to a dermatologist more quickly for special cases they’re not confident in managing. More broadly, Conover is focused on helping health organizations reduce costs related to unnecessary referrals, ineffective prescriptions, and unnecessary revisits.

Thus far, more than 50 physicians have used Piction’s product, and the company has established partnerships with several organizations. One of these is a well-known defense organization that had two employees diagnosed with late-stage melanoma recently after they couldn’t see a dermatologist right away.

“A lot of people don’t realize that it’s really hard to see a dermatologist — it can take three to six months — and with the pandemic, it’s never been a worse time to try to see a dermatologist,” Conover says.

Shocked into action

At the time of Conover’s melanoma diagnosis, she had recently earned a bachelor’s degree in mechanical engineering from the University of Texas at Austin. But she didn’t do a deep dive into dermatology until she needed a thesis topic for her master’s at MIT.

“It was just a really scary experience,” Conover says of her melanoma. “I consider myself very lucky because I learned at MIT that there’s a huge number of people with skin problems every year, two-thirds of those people go into primary care to get help, and about half of those cases are misdiagnosed because these providers don’t have as much training in dermatology.”

Conover first began exploring the idea of starting a company to diagnose melanoma during the Nuts and Bolts of Founding New Ventures course offered over MIT’s Independent Activities Period in 2015. She also went through the IDEAS Social Innovation Challenge and the MIT $100K Entrepreneurship Competition while building her system. After graduation, she spent a year at MIT as a Catalyst Fellow in the MIT linQ program, where she worked in the lab of Martha Gray, the J.W. Kieckhefer Professor of Health Sciences and Technology and a member of MIT’s Institute for Medical Engineering and Science (IMES).

Through MIT’s Venture Mentoring Service, Conover also went through the I-Corps program, where she continued to speak with stakeholders. Through those conversations, she learned that skin rashes like psoriasis, eczema, and rosacea account for the vast majority of skin problems seen by primary care physicians.

Meanwhile, while public health campaigns have focused on the importance of protection from the sun, public knowledge around conditions like shingles, which affects up to 1 percent of Americans each year, is severely lacking.

Although training a machine-learning model to recognize a myriad of diverse conditions would be more difficult than training a model to recognize melanoma, Conover’s small team decided that was the best path forward.

“We decided it’s better to just jump to making the full product, even though it sounded scary and huge: a product that identifies all different rashes across multiple body parts and skin tones and age groups,” Conover says.

The leap required Piction to establish data partnerships with hundreds of dermatologists in countries around the world during the pandemic. Conover says Piction now has the world’s largest dataset of rashes, containing over 1 million photos taken by dermatologists in 18 countries.

“We focused on getting photos of different skin tones, as many skin tones are underrepresented even in medical literature and teaching,” Conover says. “Providers don’t always learn how all the different skin tones can present conditions, so our representative database is a substantial statement about our commitment to health equity.”

Conover says Piction’s image database helps physicians evaluate conditions more accurately in primary care. After a provider has determined the most likely condition, Piction presents physicians with information on treatment options for each condition.

“This front-line primary care environment is the ideal place for our innovation because they care for patients with skin conditions every day,” Conover says.

Helping doctors at scale

Conover is constantly reminded of the need for her system by family and friends, who have taken to sending her pictures of their skin condition for advice. A recent example was when Conover’s friend developed shingles, a disease that can advance quickly and can cause blindness if it spreads to certain locations on the body. A doctor misdiagnosed the shingles on her forehead as a spider bite and prescribed the wrong medication. The shingles got worse and caused ear and scalp pain before the friend went to the emergency room and received the proper treatment.

“It was one of those moments where we thought, ‘If only physicians had the right tools,’” Conover says. “The PCP jumped to what she thought the problem was but didn’t build the full list of potential conditions and narrow from there.”

Piction plans to launch several additional pilots this year. Further down the line, Conover wants to add capabilities to identify and evaluate wounds and infectious diseases that are more common in other parts of the world, like leprosy. The company also hopes to bring its solution to doctors in low-resource settings by partnering with nonprofit groups.

“This has potential to become a full diagnostic tool in the future,” Conover says. “I just don’t want anyone to feel the way I felt when I had my first diagnosis, and I want other people like me to be able to get the care they need at the right time and move on with their lives.”

3 Comments on "New App Uses AI To Classify Skin Conditions With the Snap of a Picture"

  1. Aside from the financial aspect of it….why not make it available to the public?

    Currently, if you find a suspicious mole you make an appt with your PCP. Even regular doctors are backed up, so you could be waiting weeks. You go to the doctor, they inspect the mole, and then either tell you it’s a chocolate chip crumb that melted from the bag or cookies you ate earlier, or refer you to a dermatologist.

    With the app: you find a mole, make an appt weeks out with your PCP, they take a pic of it with this app, then tell you it’s nothing or refer you to a Dermatologist….seems at least partially redundant.

    Plus, people may have spots in places they’d rather not have others looking at unnecessarily.

    I don’t know, I think it would result in more people being proactive about skin cancer if they had access to an app they could use in the privacy of their own home, vs paying a copay for a doctor to do the same thing, then refer them to a specialist with another copay.

    Unless the spot is truly alarming, most people just make a mental note to mention it to their doc at their next physical.

  2. If it is faster to create a skin cancer app first do that and continue with the full app. People wanting to know if they have cancer would be a reason dermatologists are backed up.

  3. ethan james leflar | September 2, 2022 at 7:17 am | Reply

    cancer is a disease

Leave a comment

Email address is optional. If provided, your email will not be published or shared.