Developing an Artificial Intelligence (A.I)-based descriptor of facial appearance that fits with the assessments of makeup experts.
artificial intelligence
automatic descriptor
ethnicities
facial appearance
inclusivity
makeup
Journal
Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging (ISSI)
ISSN: 1600-0846
Titre abrégé: Skin Res Technol
Pays: England
ID NLM: 9504453
Informations de publication
Date de publication:
Nov 2021
Nov 2021
Historique:
received:
19
01
2021
accepted:
20
04
2021
pubmed:
18
5
2021
medline:
1
12
2021
entrez:
17
5
2021
Statut:
ppublish
Résumé
To develop an A.I-based automatic descriptor that detects and grades, from selfie pictures, 23 facial signs, hairs included, as a help to making-up procedures. The selfie images taken in very different conditions by 3326 women and men were used to create (90% of dataset) and validate (10% of dataset) a new algorithm architecture to appraise and grade 23 different facial signs such as lips, nose, eye color, eyebrows, eyelashes, and hair color as defined by makeup artists. Each selfie image was annotated by 12 experts and defined references to train Artificial Intelligence (A.I)-based algorithm. As some the 23 signs present a continuous or discontinuous feature, these were analyzed by two different statistical approaches. The results provided by the automatic descriptor system were not only in good agreement with the expert's assessments but were even found of a better precision and reproducibility. This automatic descriptor system has proven a good and robust accuracy despite the very variable conditions in the acquisition of selfie pictures. Such automatic descriptor system seems providing a valuable help in making-up procedures and may extend to other activities such as Skincare or Haircare. As such it should allow large investigations to better evaluate the consumers' needs of esthetical improvements.
Types de publication
Journal Article
Langues
eng
Sous-ensembles de citation
IM
Pagination
1081-1091Informations de copyright
© 2021 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.
Références
Porcheron A, Mauger E, Russell R. Aspects of facial contrast decrease with age and are cues for age perception. PLoS ONE. 2013;8(3):e57985.
Porcheron A, Mauger E, Soppelsa F, et al. Facial Contrast Is a Cross-Cultural Cue for Perceiving Age. Front Psychol. 2017;8:1208.
Flament F, Abric A, Adam AS. Evaluating the respective weights of some facial signs on perceived ages in differently-aged women of five ethnic origins. J Cosmet Dermatol. 2021;20: 842-853.
Batres C, Porcheron A, Latreille J, Roche M, Morizot F, Russell R. Cosmetics increase skin evenness: evidence from perceptual and physical measures. Skin Res Technol. 2019;25(5):672-676.
Jiang R, Kezele I, Flament F, et al. A new procedure, free from human assessment, that automatically grades some facial skin structural signs. Comparison with assessments by experts, using referential atlases of skin ageing. Int J Cosmet Sci. 2019;41(1):67-78.
Zhang Y, Jiang R, Flament F, et al. A new procedure, free from human assessment, that automatically grades some facial skin signs in men from selfies pictures. Application to changes induced by a severe aerial chronic urban pollution. Int J Cosmet Sci. 2020;42(2):185-197.
Flament F, Hoffman M, Roo E, et al. A new procedure, free from human assessment, that automatically grades some facial skin structural signs. A validation step through clinical assessments by dermatologists. Int J Cosmet Sci. 2019;41(5):472-478.
Flament F, Lee YW, Lee DH, et al. The continuous development of a complete and objective automatic grading system of facial signs from selfie pictures: Asian validation study and application to women of three ethnic origins, differently aged. Skin Res Technol. 2021; 27: 183-190.
Shaiek A, Francois G, Flament F, et al. Morphological criteria of feminine upper eyelashes, quantified by a new semi-automatized image analysis: Application to the objective assessment of mascaras. Skin Res Technol. 2018;24:135-144.
Flament F, Seyrek I, François G, Zhu T, Ye C, Saint-Leger D. Morphometric characteristics of feminine eyebrows: variations with ethnicities and age. Int J Cosmet Sci. 2018;41:443-449.
Flament F, François G, Seyrek I, Saint-Leger D. Age-related changes to characteristics of the human eyes in women from six different ethnicities. Skin Res Technol. 2020;26:520-528.
de Rigal J, Des Mazis I, Diridollou S, et al. The effect of age on skin color and color heterogeneity in four ethnic groups. Skin Res Technol. 2010;16(2):168-178.
Russell R, Porcheron A, Sweda JR, Jones AL, Mauger E, Morizot F. Facial contrast is a cue for perceiving health from the face. J Exp Psychol Hum Percept Perform. 2016;42(9):1354-1362.
Russell R, Batres C, Courrèges S, Kaminski G, SoppelsaF MF, Porcheron A. Differential effects of makeup on perceived age. Br J Psychol. 2019;110(1):87-100.
Caisey L, Grangeat F, Lemasson A, Talabot J, Voirin A. Skin color and makeup strategies of women from different ethnic groups. Int J Cosmet Sci. 2006;28(6):427-437.
Colomb L, Flament F, Wagle A, Agrawal D. In vivo evaluation of some biophysical parameters of the facial skin of Indian women. Part I: variability with age and geographical locations. Int J Cosmet Sci. 2018;40(1):50-57.
Flament F, Coubard O, Cruz R, Fabian F. Changes in facial signs due to age and their respective weights on the perception of age, on a tired-look or a healthy glow among differently aged Chinese men. Int J Cosmet Sci. 2020;42:452-461.
Han HU, et al. Heterogeneous face attribute estimation: A deep multi-task learning approach. IEEE Trans Pattern Anal Mach Intell. 2017;40(11), 2597-2609.
Rothe R, Timofte R, Van Gool L. Deep expectation of real and apparent age from a single image without facial landmarks. Int J Comput Vision. 2018;126(2-4):144-157.
Wang F, et al. Deep multi-task learning for joint prediction of heterogeneous face attributes. Proceedings of the 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017). IEEE, 2017.
He K, et al. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition. IEEE, 2016.
Shorten C, Khoshgoftaar TM. A survey on image data augmentation for deep learning. J Big Data. 2019;6(1):60.
Li TianXing, et al. Lightweight real-time makeup try-on in mobile browsers with tiny CNN models for facial tracking. 2019. arXiv preprint.t arXiv;1906.02260
Connor CW. Artificial Intelligence and machine learning in anesthesiology. Anesthesiology. 2020;131(6):1346-1359.
Goyal M, Knackstedt T, Yan S, et al. Artificial Intelligence-based image classification methods foe diagnosis of skin cancer. Challenges and opportunities. Comput Biol Med. 2020;2020:104065. https://doi.org/10.1016/.compbiomed
Du-Harpur X, Watt FM, Luscombe NM, et al. What is A.I? Applications of artificial intelligence to dermatology. Br J Dermatol. 2020;183(3):423-430.
Monisha M, Suresh A, Rashmi MR. Artificial intelligence-based skin classification using GMM. J Med Syst. 2018;43(1):3.
Sengupta S, Mittal N, Modi M. Improved skin lesions detection using color space and artificial intelligence techniques. J Dermatolog Treat. 2020;31(5):511-518.
Ngoo A, Finanne A, McMeniman E, et al. Efficacy of smartphone applications in high-risk pigmented lesions. Australas J Dermatol. 2018;59(3):175-182.
Chuchu N, Takwoingi Y, Dinnes J, et al. Smartphones applications for triaging adults with skin lesions that are suspicious for melanoma. Cochrane Database Syst Rev. 2018;12(12):CD013192.
Abbot LM, Smith SD. Smartphone apps for skin cancer diagnosis: Implications for patients and practitioners. Australas J Dermatol. 2018;59(3):168-170.
Hillebrand GG, Liang Z, Yan X, Yoshii T. New wrinkles on wrinkling: an 8-year longitudinal study on the progression of expression lines into persistent wrinkles. Br J Dermatol. 2010;162(6):1233-1241.
Hess U, Adams RB Jr, Simard A, Stevenson MT, Kleck RE. Smiling and sad wrinkles: age-related changes in the face and the perception of emotions and intentions. J Exp Soc Psychol. 2012;48(6):1377-1380.
Uchida K, Fujisaki T, Hachiya Y, et al. Fatigue estimation of visual display terminal (VDT) workers by physiological data-preliminary study of a new computer program for VDT work analysis. J UOEH. 2004;26(3):315-325.
Shahid A, Shen J, Shapiro CM. Measurements of sleepiness and fatigue. Psychosom Res. 2010;69(1):81-89.
Sundelin T, et al. Cues of fatigue: effects of sleep deprivation on facial appearance. Sleep. 2013;36(9):1355-1360.
Nguyen HT, Isaacowitz DM, Rubin PA. Age-and fatigue related markers of human faces: an eye-tracking study. Ophthalmology. 2009;116(2):355-360.
Flament F, Ye C, Mercurio DG, et al. Evaluating the respective weights of some facial signs on the perceived radiance/glow in differently aged women of six ethnic origins. Skin Res Technol. In Press.