Treatment Recommendation using BERT Personalization
Article Sidebar
Main Article Content
Abstract
This research work develops a new framework that combines patient feedback with evidence-based best practices across disease states to improve drug recommendations. It employs BERT as its free-text processing engine to deal with sentiment judgment and classification. The functionality of the system, named `PharmaBERT`, includes acceptance of drug review data as a comprehensive input, drug categorization when dealing with a wide range of treatments and fine-tuning the BERT-based model for gaining positive or negative sentiment towards specific medications. PharmaBERT categorizes various drugs and fine-tunes the BERT structure to perceive lots of possible sentiments for specific medications. Consequently, PharmaBERT brings all its training and optimization capabilities together and through this, the system reaches a higher accuracy of up to 91% thus showcasing the potency of the model in capturing patient sentiments. While being a BERT spin-off, PharmaBERT utilizes its own set of experienced techniques to comprehend and sense the health-related text input given by the patient, doctor, or pharmacist. It uses transfer learning, that is, it learns from language representations to adapt quickly to the intricacies of drug reviewing. Through PharmaBERT, healthcare professionals may expand their diagnoses with insights from patient feedback to constitute more neutral decisions.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
All articles published in JIWE are licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) License. Readers are allowed to
- Share — copy and redistribute the material in any medium or format under the following conditions:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use;
- NonCommercial — You may not use the material for commercial purposes;
- NoDerivatives — If you remix, transform, or build upon the material, you may not distribute the modified material.
References
H. Ng, A. Alias bin Mohd Azha, T. T. V. Yap, V. T. Goh, “A Machine Learning Approach to Predictive Modelling of Student Performance,” F1000Research, vol. 10, no. 1144, pp. 1-10, 2022, doi: 10.12688/f1000research.73180.2.
W. K. Chong, H. Ng, T. T. V. Yap, W. K. Soo, “Objectivity and Subjectivity Classification with BERT for Bahasa Melayu,” International Conference on Computer, Information Technology and Intelligent Computing (CITIC 2022), pp. 246-257, Dec. 2022, doi: 10.2991/978-94-6463-094-7_20.
Y. Wang, Z. Jiang, C. Zheng, F. Yang, Y. Zhou, E. Cho, X. Fan, X. Huang, Y. P. Lu, Y. Yang, “RecMind: Large Language Model Powered Agent for Recommendation,”, pp. 4351-4364, 2024.
J. Zhang, K. Bao, Y. Zhang, W. Wang, F. Feng, X. He, “Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendation,” ACM Conference on Recommender Systems, pp. 993-999, 2023, doi: 10.1145/3604915.3608860.
L. Wang, E. Lim, “Zero-Shot Next-Item Recommendation using Large Pretrained Language Models,” arXiv preprint arXiv:2304.03153, 2023.
K. Bao, J. Zhang, Y. Zhang, W. Wang, F. Feng, X. He, “TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation,” in ACM Conference on Recommender Systems, pp. 1007-1014, 2023, doi:10.1145/3604915.360885.
Z. Yue, S. Rabhi, G. de Souza Pereira Moreira, D. Wang, E. Oldridge, “LlamaRec: Two-Stage Recommendation using Large Language Models for Ranking,” arXiv preprint arXiv:2311.02089, 2023, doi:10.48550/arXiv.2311.02089.
J. Ji, Z. Li, S. Xu, W. Hua, Y. Ge, J. Tan, Y. Zhang, “GenRec: Large Language Model for Generative Recommendation,” Lecture notes in computer science, pp. 494–502, 2024, doi: https://doi.org/10.1007/978-3-031-56063-7_42.
Z. Liu, P. Wang, Y. Li, J. D. Holmes, P. Shu, L. Zhang, C. Liu, N. Liu, D. Zhu, X. Li, Q. Li, S. H. Patel, T. T. Sio, T. Liu, W. Liu, “RadOnc-GPT: A Large Language Model for Radiation Oncology,” arXiv preprint arXiv:2309.10160, pp.1-15,2023.
I. Singh, V. Blukis, A. Mousavian, A. Goyal, D. Xu, J. Tremblay, D. Fox, J. Thomason, A. Garg, “ProgPrompt: Generating Situated Robot Task Plans using Large Language Models,” IEEE International Conference on Robotics and Automation, Vol. 47, pp. 999-1012, 2023, doi: 10.1007/s10514-023-10135-3.
R. Li, W. Deng, Y. Cheng, Y. Zheng, J. Zhang, F. Yuan, “Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insights,” arXiv preprint arXiv:2305.11700, 2023.
J. Zhang, R. Xie, Y. Hou, W. X. Zhao, L. Lin, and J.-R. Wen, “Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach,” arXiv preprint arXiv:2305.07001, 2023, doi: 10.48550/arXiv.2305.07001.
A. Lahat, E. Shachar, B. Avidan, B. S. Glicksberg, E. Klang, “Evaluating the Utility of a Large Language Model in Answering Common Patients’ Gastrointestinal Health-Related Questions: Are We There Yet?,” Diagnostics,vol. 13, No.11,2023, doi: 10.3390/diagnostics13111950.
J. Liu, L. Li, T. Xiang, B. Wang, Y. Qian, “TCRA-LLM: Token Compression Retrieval Augmented Large Language Model for Inference Cost Reduction,” in Conference on Empirical Methods in Natural Language Processing, pp. 9796-9810,2023, doi: 10.48550/arXiv.2310.15556.
Y. Wang, Z. Chu, X. Ouyang, S. Wang, H. Huang, Y. Shen, J. Gu, S. Xue, J. Y. Zhang, Q. Chen, L. Li, J. Zhou, S. Li, “Enhancing Recommender Systems with Large Language Model Reasoning Graphs”, Information Retrieval, 2023, doi: 10.48550/arXiv.2308.10835.
S. Mysore, A. McCallum, H. Zamani, “Large Language Model Augmented Narrative Driven Recommendations,” ACM Conference on Recommender Systems, pp. 777-783, 2023, doi: 10.1145/3604915.3608829.
J. Zhou, X. Gao, “SkinGPT-4: An Interactive Dermatology Diagnostic System with Visual Large Language Model,” 2023, doi: 10.48550/arXiv.2304.10691.
P. Murali, I. Steenstra, H. S. Yun, A. Shamekhi, T. Bickmore, “Improving Multiparty Interactions with a Robot Using Large Language Models,” CHI Extended Abstracts, pp. 1-8, 2023, doi: 10.1145/3544549.3585602.
A. H. Sweidan, N. El-Bendary, H. Al-Feel, “Aspect-based sentiment analysis in drug reviews based on hybrid feature learning,” in 16th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2021), pp. 78–87, Springer International Publishing, 2022, doi:10.1007/978-3-030-87869-6_8.
N. Bensalah, H. Ayad, A. Adib, A. I. el Farouk, “Sentiment analysis in drug reviews based on improved pre-trained word embeddings,” in Innovations in Smart Cities Applications Vo. 6, pp. 87–96, Springer International Publishing, 2023, doi: 10.1007/978-3-031-26852-6_8.
Y. Kalakoti, S. Yadav, D. Sundar, “Deep neural network-assisted drug recommendation systems for identifying potential drug–target interactions,” ACS Omega, vol. 7, no. 14, pp. 12138–12146, 2022, doi: 10.1021/acsomega.2c00424.