Fit Moi: Online Virtual Fitting Room With Texture Identification And Recommendation System

AbdElminaam, Diaa S; Mohamed, Yasmin; Osama, Salma; Michelle, Rogina; Karam, Youssef; Hassan, Mennat Allah

doi:10.21608/jocc.2023.307055

Fit Moi: Online Virtual Fitting Room With Texture Identification And Recommendation System

Document Type : Original Article

Authors

¹ Department of Data Science , Faculty of Computer Science , Misr International University , Cairo , Egypt

² Faculty of computer science ; Misr International University

³ Faculty of Computer Science, Misr International University.

10.21608/jocc.2023.307055

Abstract

Virtual fitting rooms have attracted the sights of the market need in the past two years; The world faced a colossal pandemic that led everything to be online.
This proposed framework aims to solve the online shopping problem using deep learning algorithms and techniques.
Users face significant issues, whether finding the perfect fit, recognizing the fabric, or styling their outfits. As a result, merchants' profit is impacted, resulting in a high percentage of returns.
This proposed model aims to generate a 3D human model. Based on the measurements extracted from the user's images and the user's weight and height for more accurate results. The user can see how simulated 3D clothes will look on his 3D body model, and Then he will know the exact size that fits him and can view the texture. Finally, the user will have styling tips recommended according to his chosen outfit.

Keywords

References

[1] Souza, J., Holanda, G., Ivo, R., Alves, S., Silva, S., Nunes, V., Loureiro, L., Dias-Silva, C., & Rebouças Filho, P. (2020). Predicting body measures from 2D images using Convolutional Neural Networks. In 2020 International Joint Conference on Neural Networks (ĲCNN) (pp. 1–6). Othman, A., & Jemni, M. (2017, December). An XML-gloss annotation system for sign language processing. In 2017 6th International Conference on Information and Communication Technology and Accessibility (ICTA) (pp. 1-7). IEEE.

[2] Ma, Q., Yang, J., Ranjan, A., Pujades, S., Pons-Moll, G., Tang, S., & Black, M. (2020). Learning to dress 3d people in generative clothing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 6469–6478

[3] Bertiche, H., Madadi, M., & Escalera, S. (2020). CLOTH3D: clothed 3d humans. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XX 16 (pp. 344–359).

[4] Zhu, H., Zuo, X., Yang, H., Wang, S., Cao, X., & Yang, R. (2021). Detailed avatar recovery from single image. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(11), 7363-7379.

[5] Ji Z, Qi X, Wang Y, Xu G, Du P, Wu X, Wu Q. Human body shape reconstruction from binary silhouette images. Computer Aided Geometric Design. 2019 May 1;71:231-43. Stokoe Jr, W. C. (2005). Sign language structure: An outline of the visual communication systems of the American deaf. Journal of deaf studies and deaf education, 10(1), 3-37.

[6] Santesteban, I., Thuerey, N., Otaduy, M. A., & Casas, D. (2021). Self-supervised collision handling via generative 3d garment models for virtual try-on. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 11763-11773).

[7] Cui, A., McKee, D., & Lazebnik, S. (2021). Dressing in order: Recurrent person image generation for pose transfer, virtual try-on and outfit editing. In Proceedings of the IEEE/CVF international conference on computer vision (pp. 14638-14647). Hanke, T. (2004, May). HamNoSys-representing sign language data in language resources and language processing contexts. In LREC (Vol. 4, pp. 1-6).

[8] Mir, A., Alldieck, T., & Pons-Moll, G. (2020). Learning to transfer texture from clothing images to 3d humans. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 7023-7034).

[9] Alldieck, T., Pons-Moll, G., Theobalt, C., & Magnor, M. (2019). Tex2shape: Detailed full human body geometry from a single image. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 2293-2303).

[10] Kulkarni, N., Gupta, A., & Tulsiani, S. (2019). Canonical surface mapping via geometric cycle consistency. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 2202-2211).

[11] Hsiao, W. L., Katsman, I., Wu, C. Y., Parikh, D., & Grauman, K. (2019). Fashion++: Minimal edits for outfit improvement. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 5047-5056).

[12] Ge, Y., Zhang, R., Wang, X., Tang, X., & Luo, P. (2019). Deepfashion2: A versatile benchmark for detection, pose estimation, segmentation and re-identification of clothing images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 5337-5345).

[13] Wu, Z., Lin, G., Tao, Q., & Cai, J. (2019, October). M2e-try on net: Fashion from model to everyone. In Proceedings of the 27th ACM international conference on multimedia (pp. 293-301).

[14] Minar, M. R., Tuan, T. T., Ahn, H., Rosin, P., & Lai, Y. K. (2020, June). Cp-vton+: Clothing shape and texture preserving image-based virtual try-on. In CVPR Workshops (Vol. 3, pp. 10-14).

[15] Majithia, S., Parameswaran, S. N., Babar, S., Garg, V., Srivastava, A., & Sharma, A. (2022). Robust 3D Garment Digitization from Monocular 2D Images for 3D Virtual Try-On Systems. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (pp. 3428-3438).

[16] Shen, Y., Liang, J., & Lin, M. C. (2020). Gan-based garment generation using sewing pattern images. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XVIII 16 (pp. 225-247). Springer International Publishing

[17] Lahner, Z., Cremers, D., & Tung, T. (2018). Deepwrinkles: Accurate and realistic clothing modeling. In Proceedings of the European conference on computer vision (ECCV) (pp. 667-684).

[18] Jandial, S., Chopra, A., Ayush, K., Hemani, M., Krishnamurthy, B., & Halwai, A. (2020). Sievenet: A unified framework for robust image-based virtual try-on. In Proceedings of the IEEE/CVF winter conference on applications of computer vision (pp. 2182-2190).

[19] Ren, B., Tang, H., Meng, F., Ding, R., Shao, L., Torr, P. H., & Sebe, N. (2021). Cloth interactive transformer for virtual try-on. arXiv preprint arXiv:2104.05519.

[20] Wang, X., Wu, B., & Zhong, Y. (2019, October). Outfit compatibility prediction and diagnosis with multi-layered comparison network. In Proceedings of the 27th ACM International Conference on Multimedia (pp. 329-337).

[21] Abd Elminaam, D.S., El Tanany, A., Salam, M.A. and Abd El Fattah, M., 2022, May. CPSMP_ML: Closing price Prediction of Stock Market using Machine Learning Models. In 2022 2nd International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC) (pp. 251-255). IEEE.

[22] Ai, Mona AS, Anitha Shanmugam, Suresh Muthusamy, Chandrasekaran Viswanathan, Hitesh Panchal, Mahendran Krishnamoorthy, Diaa Salama Abd Elminaam, and Rasha Orban. "Real-time facemask detection for preventing COVID-19 spread using transfer learning based deep neural network." Electronics 11, no. 14 (2022): 2250.

[23] Neggaz, N. and AbdElminaam, D.S., 2021, May. Automatic sport video mining using a novel fusion of handcrafted descriptors. In 2021 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC) (pp. 387-394). IEEE.

[24] Salam, M.A., Ibrahim, L. and Abdelminaam, D.S., 2021. Earthquake Prediction using Hybrid Machine Learning Techniques. International Journal of Advanced Computer Science and Applications, 12(5), pp.654-6652021.

[25] Mahmoud, E., Kader, H.A. and Minaam, D.A., 2019, October. Fuzzy knowledge base system for floating car data on SUMO. In 2019 29th International Conference on Computer Theory and Applications (ICCTA) (pp. 38-42). IEEE.

[26] AbdElminaam, D.S., ElMasry, N., Talaat, Y., Adel, M., Hisham, A., Atef, K., Mohamed, A. and Akram, M., 2021, May. HR-chat bot: Designing and building effective interview chat-bots for fake CV detection. In 2021 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC) (pp. 403-408). IEEE.

[27] AbdElminaam, D.S., Fahmy, A.G., Ali, Y.M., El-Din, O.A.D. and Heidar, M., 2022, May. DeepECG: Building an Efficient Framework for Automatic Arrhythmia classification model. In 2022 2nd International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC) (pp. 203-209). IEEE.

[28] AbdElminaam, D.S., Fahmy, A.G., Ali, Y.M., El-Din, O.A.D., Aly, A.R. and Heidar, M., 2022, May. ESEEG: An Efficient Epileptic Seizure Detection using EEG signals based on Machine Learning Algorithms. In 2022 2nd International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC) (pp. 210-215). IEEE.

[29] AbdElminaam, D.S., Ahmed, N., Yasser, M., Ahmed, R., George, P. and Sahhar, M., 2022, May. DeepCorrect: Building an Efficient Framework for Auto Correction for Subjective Questions Using GRU_LSTM Deep Learning. In 2022 2nd International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC) (pp. 33-40). IEEE.

[30] Ali, M.A., Orban, R., Rajammal Ramasamy, R., Muthusamy, S., Subramani, S., Sekar, K., Rajeena PP, F., Gomaa, I.A.E., Abulaigh, L. and Elminaam, D.S.A., 2022. A Novel Method for Survival Prediction of Hepatocellular Carcinoma Using Feature-Selection Techniques. Applied Sciences, 12(13), p.6427.

[31] AbdElminaam, D. S., El-Aal, A., & Abdellatif, A. (2023). Nowcasting Egypt GDP Using machine learning Algorithms. Journal of Computing and Communication, 2(1), 1-8.

[32] Radwan, M., Mohamed Abdelrahman, N., Wael Kamal, H., Khaled Abdelmonem Elewa, A., & Moataz Mohamed, A. (2023). MLHeartDisPrediction: Heart Disease Prediction using Machine Learning. Journal of Computing and Communication, 2(1), 50-65.

[33] Tamer Ghareeb, B., Tarek, F., & Said, H. (2023). FER_ML: Facial Emotion Recognition using Machine Learning. Journal of Computing and Communication, 2(1), 40-49.

[34] Essam, F., Samy, H., & Wagdy, J. (2023). MLHandwrittenRecognition: Handwritten Digit Recognition using Machine Learning Algorithms. Journal of Computing and Communication, 2(1), 9-19.