Institute of Fundamental Technological Research

Background: Chatbots using the Large Language Model (LLM) generate human responses to questions from all
categories. Due to staff shortages in healthcare systems, patients waiting for an appointment increasingly use
chatbots to get information about their condition. Given the number of chatbots currently available, assessing the
responses they generate is essential.
Methods: Five chatbots with free access were selected (Gemini, Microsoft Copilot, PiAI, ChatGPT, ChatSpot) and
blinded using letters (A, B, C, D, E). Each chatbot was asked questions about cardiology, oncology, and psoriasis.
Responses were compared to guidelines from the European Society of Cardiology, American Academy of
Dermatology and American Society of Clinical Oncology. All answers were assessed using readability scales
(Flesch Reading Scale, Gunning Fog Scale Level, Flesch-Kincaid Grade Level and Dale-Chall Score). Using a 3-
point Likert scale, two independent medical professionals assessed the compliance of the responses with the
guidelines.
Results: A total of 45 questions were asked of all chatbots. Chatbot C gave the shortest answers, 7.0 (6.0 – 8.0), and Chatbot A the longest 17.5 (13.0 – 24.5). The Flesch Reading Ease Scale ranged from 16.3 (12.2 – 21.9)
(Chatbot D) to 39.8 (29.0 – 50.4) (Chatbot A). Flesch-Kincaid Grade Level ranged from 12.5 (10.6 – 14.6) (Chatbot A) to 15.9 (15.1 – 17.1) (Chatbot D). Gunning Fog Scale Level ranged from 15.77 (Chatbot A) to 19.73 (Chatbot D). Dale-Chall Score ranged from 10.3 (9.3 – 11.3) (Chatbot A) to 11.9 (11.5 – 12.4) (Chatbot D).
Conclusion: This study indicates that chatbots vary in length, quality, and readability. They answer each question
in their own way, based on the data they have pulled from the web. Reliability of the responses generated by
chatbots is high. This suggests that people who want information from a chatbot need to be careful and verify the answers they receive, particularly when they ask about medical and health aspects.

Chatbots,Readability,Cardiovascular health,Oncology

Abstract: BackgroundDiet-related diseases remain leading causes of death in most developed countries around the world. The aim of the study was to compare opinions of patients and family physicians on receiving and providing recommendations about physical activity, diet and use of medication. Methods: The questionnaire study was conducted among patients of 36 primary health care clinics in Poland between September 2018 and February 2019. Patients and physicians were interviewed separately by trained researchers. Data from 509 patients and 167 family doctors were analyzed. Results: The median age of patients was 44 years (interquartile range: 29–55) and 70% were women. The majority of physicians were women (59%) and the median age was 37 years (IQR: 31–50). There was a significant difference between physicians’ declarations on providing recommendations on diet (92% vs. 39%) and activity (90% vs. 37%) versus patients’ declarations on receiving them. Conclusions: The results indicate that there is significant room for improvement in providing patients with proper recommendations on diet and physical activity by their family physicians. Primary care physicians should put more emphasis on clear communication of recommendations on diet and physical activity.

diet

Introduction. To investigate the public interest in cancer screening before, during and after one year of the COVID-19 pandemic, in relation to the number of cases and deaths caused by the coronavirus. Material and methods. Google Trends (GT) was used to obtain data on online interest in screening for the most common cancer types during COVID-19 pandemic. Results. It was found that although online interest in screening collapsed during the early stages of the pandemic, it managed to gradually return to its pre-pandemic levels six months later despite a growing number of COVID-19 related deaths. Nevertheless, some data and reports suggest that this unprecedented crisis may result in increased mortality and incidence rates. Conclusions. The study raises the importance of continuous and active actions aimed at raising cancer awareness which appears to be crucially important during a public health crisis such as the COVID-19 pandemic.

cancer screening

The aim of this study was to analyse knowledge on colon cancer prevention among patients of primary care and identify their sources of information. The questionnaire study was conducted among patients of 36 primary healthcare clinics in Poland between September 2018 and February 2019. Patients were interviewed separately by trained researchers. Over 39% of the primary health patients declared that their knowledge about colon cancer prevention is unsatisfactory. Information about colon cancer prevention varied according to sex, age and BMI. Men declared lower level of knowledge than women: 46% of men thought it was unsatisfactory compared with 36%of women (p = 0.003). Preventive recommendations weremore often provided to patients over 60 years old (p < 0.01). Overweight and obese patients were more likely to receive recommendations on diet (p < 0.001) and physical activity (p < 0.001) than patients with normal weight. Themost common source of information on colon cancer prevention was Internet (68%) and medical doctors (60%). There is a need for developing colon cancer prevention policy. Crucial aspect includes educational programs aimed at improving patient’s knowledge and involving medical staff. The policymakers should pay greater attention to cancer prevention policies and medical staff involved in prevention to quality of communication to make sure patients thoroughly understand information they are provided.

colon cancer, prevention, primary healthcare, education, communication