App recognizes suspected mpox rashes using artificial intelligence

Open Government License 3.0. Credit: Nature Medicine (2023). DOI: 10.1038/s41591-023-02225-7″>

App recognizes suspected mpox rashes using artificial intelligence
SHAP analysis of the MPXV-CNN. Photographic images of MPXV skin lesions (top) are shown with the corresponding SHAP analysis (bottom) overlaid on the original image to highlight the discriminative image regions used for detection (ag). The MPXV lesions shown represent different stages as follows: early-stage vesicle (a), small pustule (b), umbilicated pustule (c), papule with central necrosis (d), hand with one ulcerated skin lesion (e), pubic region with multiple ulcerated skin lesions (f) and late-stage crusted plaques (g). Positive SHAP values, shown in red, indicated areas of the image that contributed to the prediction of MPXV skin lesion, whereas negative SHAP values, shown in blue, indicated areas that detracted from the prediction. All MPXV lesions shown in ag were part of the testing dataset and were classified correctly by the MPXV-CNN. Photo credit (ag): UK Health Security Agency, licensed under the Open Government License 3.0. Credit: Nature Medicine (2023). DOI: 10.1038/s41591-023-02225-7

A new app developed by scientists at Stanford Medicine and other institutions can detect skin lesions caused by mpox, previously known as monkeypox, in images with an accuracy of 90%, the researchers found in a study. To analyze images, the app uses a type of artificial intelligence that was trained and evaluated on a large data set of about 130,000 images of various skin conditions.

The free, open-source app, called PoxApp, allows users to take pictures of skin lesions using their smartphones, answer a few questions and receive a with recommendations, such as mpox testing or post-exposure vaccination, in less than five minutes.

“It’s a quick, easy and anonymous way to get a first assessment,” said Alexander Thieme, MD, the lead developer of the app and a visiting scholar in the Department of Medicine from Charité—Universitätsmedizin Berlin and Berlin Institute of Health. “We are hoping to increase the likelihood that someone sees a doctor due to their rather than ignore it.”

Although the app has a high accuracy, it can give false negatives. It’s not a substitute for a physician, Thieme stressed. But the app could reach communities with less access to care and encourage people to visit a doctor.

“Many people seek out on the internet, and much of that may be inaccurate,” Thieme said. “With this app, developed with guidance from the Centers for Disease Control and Prevention and the World Health Organization, we hope to encourage people to seek out care.”

The artificial intelligence methods and the findings of the app were published online in Nature Medicine March 2. The project is a joint effort of the labs of Olivier Gevaert, Ph.D., Tina Hernandez-Boussard, Ph.D., and Pascal Geldsetzer, MD, Ph.D., at Stanford Medicine as well as collaborators at Charité—Universitätsmedizin Berlin and Toronto University Hospital. Thieme is the lead author.

App recognizes suspected mpox rashes using artificial intelligence
PoxApp analyzes photos of suspected mpox lesions and, in less than 5 minutes, gives a risk score with recommendations. Credit: Marina Demidiuk/Shutterstock

Optimizing results

To calculate your risk score, the app considers whether you have a skin lesion, are experiencing symptoms or had close contact with someone who may have been exposed.

Thieme said the app is anonymous: All the data is analyzed on your device and not sent to an external server. The app gives advice on how to take the best photo to reduce the likelihood of a false negative.

Researchers have found that the app can detect mpox at various stages of the disease. There are four stages of lesions, progressing from flat without fluid, to raised with clear fluid, to deep rashes filled with white fluid, before the lesion scabs over, usually in two to three weeks.

The app offers five different levels of advice, ranging from no action to seeing a doctor immediately. Thieme said that if someone has had contact and symptoms, they should see a doctor.

Users have the option to submit results for research data. Using this data, scientists like Thieme hope to predict future surges in mpox infection and employ an early warning system.

The researchers plan to publish updated versions of the app as users upload more photos. With more data, they anticipate the accuracy of the photo recognition will improve. Because the app is and free, Thieme hopes it will be used around the world, particularly in Africa, where mpox was first identified in the 1970s.

More information: Alexander H. Thieme et al, A deep-learning algorithm to classify skin lesions from mpox virus infection, Nature Medicine (2023). DOI: 10.1038/s41591-023-02225-7

Citation: App recognizes suspected mpox rashes using artificial intelligence (2023, March 3) retrieved 6 April 2023 from

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Note: This article have been indexed to our site. We do not claim legitimacy, ownership or copyright of any of the content above. To see the article at original source Click Here

Related Posts
AI윤석열 "尹 MBTI는 ENFJ…버락 오바마와 같다" thumbnail

AI윤석열 “尹 MBTI는 ENFJ…버락 오바마와 같다”

국민의힘 윤석열 대통령 후보의 MBTI(성격유형검사)는 ENFJ(외향+직관+감정+판단)라고 인공지능(AI) 윤석열이 밝혔다. AI윤석열은 '윤석열 공약위키' 홈페이지에 게시된 동영상을 통해 이같이 답한 것으로 1일 파악됐다. AI윤석열은 "(ENFJ 유형이) 정의로운 사회운동가"라며 "카리스마와 충만한 열정을 타고난 리더형이다. 또 사회정의 구현을 위해 어려움에 맞서 싸운다고도 한다"고 소개했다. 이어 "역시 타고난 대통령 감인가요? 같은 MBTI에 버락 오바마님도 있다"고 덧붙였다. MBTI는 외향(E)-내향(I), 감각(S)-직관(N), 사고(T)-감정(F),…
Read More
Industry Payments Linked With Rheumatologists' Prescribing thumbnail

Industry Payments Linked With Rheumatologists’ Prescribing

UPDATED FEBRUARY 28, 2022 // Editor's note: This article, which originally attributed comments to Dr Karen Onel personally, has been updated to further emphasize that these comments were not on behalf of the committee that she leads. Payments to rheumatologists by pharmaceutical companies, whether through food and beverages or consulting fees, are linked with a…
Read More
Index Of News
Consider making some contribution to keep us going. We are donation based team who works to bring the best content to the readers. Every donation matters.
Donate Now

Subscription Form

Liking our Index Of News so far? Would you like to subscribe to receive news updates daily?