The event was especially meaningful because David Seung U Lee and Yu Jin Kim delivered oral presentations there.
The theme of this year’s conference was "From Vision to Value: AI's Role in Shaping Modern Healthcare." It focused on how artificial intelligence (AI) is reshaping the future of healthcare and transforming itself from a mere vision into tangible value. The discussions delved deeply into AI's roles in this transformative process. The conference provided a platform to share the latest research achievements and explored how AI contributes to patient care and system improvement in real-world medical settings.
As for the oral presentations by our members, David Seung U Lee presented the study entitled “Improving Few-shot Performance of Large Language Models to Extract Clinical Information from Real World Clinical Notes.” His research addressed the challenges of extracting information from unstructured and noisy clinical notes using large language models (LLMs). The study proposed a cost-effective strategy to enhance LLM performance by optimizing factors such as model size, example selection, and arrangement strategies. Using 2,110 annotated clinical notes from Seoul National University Hospital, the study demonstrated the trade-offs between prompt design and performance, with optimal results achieved using 15 examples and BM25-based example selection. Additionally, the research explored the impact of data drift on LLM robustness, offering insights into devising better prompting strategies for real-world applications.
Aligned with the focus of the conference, Yu Jin Kim also presented the study entitled “Adverse Event Extraction from EMR-Based Real-World Data in Pediatric Acute Lymphoblastic Leukemia Patients Receiving Chemotherapy.” The study introduced a sequential strategy for efficiently extracting adverse events (AEs) from electronic medical records (EMR), combining structured data analysis with minimal manual review. The method effectively captured clinically relevant AEs with reasonable accuracy, demonstrating its potential to enhance real-world data utilization for evaluating treatment safety in pediatric patients with acute lymphoblastic leukemia.
CCADD members attended the 2024 Spring Conference of the Korean Society of Medical Informatics (KoSMI), held from June 19th to 21st at the Catholic University of Korea. The conference, aimed at advancing information-oriented societies, brought together experts from diverse sectors, including medicine, nursing, pharmacy, and engineering.
The conference featured several noteworthy sessions. Discussions on drug adverse reactions focused on improving patient safety through better detection and reporting mechanisms. The DUR platform sessions explored advancements in drug utilization review systems that help prevent medication errors. Presentations on natural language processing (NLP) showcased its application in extracting meaningful data from unstructured clinical notes, enhancing decision-making in clinical settings. Meanwhile, sessions on the limitations of multi-center Common Data Model (CDM) research highlighted challenges such as data standardization and integration across different institutions.
Lively discussions ensued on these topics, with various studies showcasing the innovative use of medical data to improve healthcare outcomes. The conference emphasized the dynamic and evolving nature of medical informatics, driven by continuous advancements in technology. A key theme throughout the conference was the importance of collaboration. Speakers and participants highlighted how interdisciplinary teamwork and partnerships between medical institutions, academic bodies, and industry are crucial for overcoming challenges and driving innovation in medical informatics.
This achievement stems from a collaborative effort involving CCADD, the Medical Informatics Lab of the College of Medicine at The Catholic University of Korea, led by Prof. In Young Choi, and hemato-oncologists from both hospitals. Dr. Choi's presentation provided an in-depth evaluation of the algorithm developed to extract information automatically from CDWs into the registry, highlighting its practical applications and significant implications for pediatric ALL research.
The session chair lauded Dr. Choi’s presentation, commending its excellence and the potential impact of this innovative work on future medical research and patient care.
CCADD attended the 2023 Fall Conference of the Korean Society of Medical Informatics (KoSMI) held at HIP(Healthcare Innovation Park) of Seoul National University Bundang Hospital, South Korea. The conference spanned three days from November 29th to December 1st, both online and offline. Aligned with the theme "Beyond Data: Actionable Health AI", the conference featured 27 symposiums covering various topics, from artificial intelligence in the healthcare to standardization of medical data and digital health.
The first day was conducted online. Particularly, ”Symposium 6: Development of Predictive Models for Cardiovascular Diseases Using Medical Big Data” was noteworthy, where Prof. Howard Lee served as the session chair and speaker, attracting significant attention from the audience with the presentation on ”Improving the Performance of Machine Learning Models for Predicting Acute Coronary Syndrome in Type 2 Diabetes Patients through Substitution of Propensity Scores for Binary Variables”. Also, throughout the conference, the poster presentation was led by David Seung U Lee.
On the second day, each symposium delved into topics of medical data and artificial intelligence applications to the healthcare domain. Themes included "Strategies for the Activation and Commercialization of AI-Based Drug Development" and "Smart Curation of Medical Data: Approaches for Preparing for the Utilization of Medical AI." This encompassed insights into the industry's latest strategies for drug target exploration. In Symposium 9, Dr. Siun Kim delivered a presentation on ”Addressing the challenges of data scarcity and bias of AI-based drug development”. The discourse extensively covered specific manifestations of data scarcity and proposed strategies for mitigation within drug development.
During the final day, the symposiums provided an opportunity to approach the trends in the utilization and data processing methods of developing LLM. Participants delved into the practical approaches for utilizing Real-World Data (RWD) in regulatory decision-making, replicating Randomized Controlled Trials (RCT), and employing common data models. CCADD members exchanged ideas with fellow researchers studying similar research topics, offering a valuable opportunity to comprehend ongoing research trends. It was an insightful symposium for healthcare information researchers to share and discuss the latest trends in research.
Prof. Howard Lee gave a talk at an invited symposium in association with the Annual Conference of the Korean Society of Medical Informatics (KoSMI), held both online and offline on November 29, 2023. The title of his presentation was ‘Performance Increase of the Machine Learning Model to Predict Acute Coronary Syndrome in Patients with Type 2 Diabetes Mellitus by Replacing Binary Variables with Propesnsity Score’. This presentation was a culmination of a research project with the same title supported by the Seokcheon Foundation, 2023, where the current and former CCADD graduate students, namely David Seung U Lee, Jung-Hyun Won, and YeSol Hong collectively contributed by proposing a new novel way to address the falseness of binary feature in the electronic medical records. Prof. Lee's speech was well received by the audience evidenced by 6 follow-up questions! The more detailed methodological aspect of Prof. Lee' talk was presented in an accepted poster led by David Seung U Lee.
Under the theme of "Revolution and
Innovation in Smart Healthcare," the event delved into an array of
captivating topics. Attendees had the privilege of exploring groundbreaking
subjects, including the "Application of Large Language Models in Healthcare"
and the "Utilization of ChatGPT and Natural Language Processing Models in
Medical Research."
Throughout the conference, CCADD seized
every moment to absorb valuable lessons. The gathering also served as a
catalyst for expanding perspectives and engaging in constructive discussions at
this pivotal juncture in the realm of medicine and healthcare. With powerful
technologies like ChatGPT emerging, the field is undoubtedly experiencing a
wind of change, and KOSMI's conference provided a unique platform to address
the challenges and opportunities presented by these advancements.
YeSol had the honor to deliver oral presentation and won the Excellent Research Award at 2022 fall conference hosted by the Korean Society of Medical Informatics(KOSMI). YeSol has presented her work entitled "Effectiveness and safety of sodium-glucose cotransporter-2 inhibitors(SGLT2i) added to mono, dual or triple treatment in patients with type 2 diabetes mellitus(T2DM)". She discussed the additive efficacy in glycemic control and the tolerability of SGLT2i in T2DM patients when combined with other antihyperglycemic agents, such as metformin, sulfonylureas, and dipeptidyl peptidase-4 inhibitors using real-world data. Yoona Choi, TaeKyu Chung, and Yoomin Jeon also contributed to this study as co-researchers, with Professor Howard Lee serving as the principle investigator.
Jung-hyun Won and David Seung U Lee had the honor to deliver oral presentations at 2022 Spring Conference hosted by the Korean Society of Medical Informatics (KOSMI). The conference was a two-day event (from June 23rd, 2022 to June 24th, 2022) and was held at Wonju Severance Christian Hospital, Wonju, Gangwon, South Korea. This year, the host (KOSMI) organized the event around the theme, “Digital transformation in the post-COVID era.” The event was full of enlightening speeches and presentations that duly reflected the progress made in the field of medical informatics.
In line with the conference’s theme, Jung-Hyun Won has presented her work entitled “An analysis of trends in anticancer drug preions and use of radiotherapy by cancer types.” Jung-Hyun Won presented the latest trends of two major treatment modalities (i.e., chemotherapy and radiotherapy) in patients with breast, colon, gastric, liver, lung, and prostate cancers. Her presentation discussed the increase in the use of targeted agents and intensity-modulated radiotherapy (IMRT) in all cancer types from 2014 to 2019. Moreover, she emphasized the need for more efficient medical resource distribution as an effort to address the rising cost of targeted therapies and IMRT.
On the other hand, David Seung U Lee has delivered a presentation on his work entitled “Dulaglutide in the real world: a retrospective analysis on adherence and persistence of dulaglutide and its patient characteristics.” He discussed his findings on the current compliance rate of dulaglutide (an antidiabetic medication of GLP1-RA class). He also presented the result of his study that analyzed the clinical characteristics strongly associated with adherence and persistence to the treatment with dulaglutide.
Full presentations can be watched at the following YouTube links:
Yoomin Jeon and Siun Kim have conducted their tutorials at the 2021 Korean Society of Medical Informatics (KOSMI) fall conference. At this conference, a total of four tutorials has been delivered and two of them were presented by the members of CCADD. In a tutorial titled “Data application in real-world and clinical trial settings for clinical information extraction”, Yoomin Jeon aimed to introduce the features of clinical data warehouse (CDW) and data collected through clinical trials and cover the general principles of utilizing those clinical data to extract critical clinical information, covering topics such as preprocessing, formulating clinical problems, and patients mapping. On the other hand, Siun Kim has presented a tutorial entitled “Building a manually annotated corpus for extracting clinical information from free-texts.” In this tutorial, Siun Kim has presented the dominant frameworks of natural language processing AI at the time of 2021, including a data-centric approach and transformer-based language models, and shared his experience in manually annotating a corpus for clinical information extraction. Also, Prof. Howard Lee has lectured at these two tutorials to share his expertise and know-how as a project manager. The tutorials were attended by approximately 200 people, and well received.
The 2021 Korean Society of Medical Informatics (KOSMI) fall conference was held on November 4-5 with presenters attending at the Yongin Severance Hospital, Yongin, Gyeonggido, while other participants joining the meeting on-line. The KOSMIacademically reviewed various pending issues related to medical data and also cooperated with the Ministry of Health and Welfare and its affiliated organizations (Korea Health Information Service, Korea Social Security Information Service) for policy endeavors.
In the conference, Siun Kim and Tae Kyu Chung gave oral presentations in Big Data and AI & CDSS (Artificial Intelligence & Clinical Decision Support System) sessions, respectively. Siun Kim presented his research topic entitled "An Annotated Corpus and Natural Language Processing Model for Drug Safety Information Extraction from Free-texts Reporting Adverse Events". Here, Siun Kim introduced an annotated corpus for extracted Korean adverse events using free-texts from the KAERS (Korean Adverse Event Reporting System) database. To this end, Siun Kim developed deep learning models that automatically extract medication and adverse event information, cooperating with MILAB in Seoul National University. Additionally, Tae Kyu Chung presented his research topic entitled "Treatment pathways of anti-hypertensive (anti-HTN) medications and factors affecting treatment changes". Tae Kyu Chung introduced the ordered sequence of anti-HTN medications that a patient is prescribed and identified factors associated with the change in anti-HTN medications using Observational Medical Outcomes Partnership Common Data Model. Both oral presentations were well received from the researchers in industries and educational institutions and Siun Kim was awarded the Best Research Presentation.
When Prof. Lee decided to attend the AMIA 2019, the annual symposium sponsored by the American Medical Informatics Association, which was held on November 16-20, in Washington DC, USA, he had two objectives in mind. First, Prof. Lee wanted to get an overview of the impending issues and emerging research topics in the field. Second, he wanted to get some insights how those issues and research topics could meld with those at CCADD such that it may adjust, refine, expand, or even cross the border of what it used to day to day in the form of research and project.
Did Prof. Lee successfully achieve his objectives? Pretty much. Carefully, but rather passively watching and observing what’s happening now in the medical informatics field, which is rather unusual for him, who used to be quite vocal and involving, Prof. Lee realized again that technology may come and go, but the domain doesn’t. It was a pleasant reaffirmation of his longstanding belief. The speakers and audience always emphasized why, rather than how, they did this or that although they were not shy at all of delving into technical complexities when necessary. This AMIA’s ‘put-patients-first’ philosophy was also highlighted by Dr. Tetteh‘s opening keynote speech, who stressed ‘human care’. Wasn’t this the least likely talk that one could expect to hear at an informatics conference? Oh, by the way, Dr. Tetteh is the Chief Medical Information Officer for the US Navy. The audience wholeheartedly responded to Dr. Tetteh’s speech by standing ovation.
This was very much enlightening to Prof. Lee, given that KOSMI 2019 he had joined just a couple weeks before in Korea was too much packed with technical dudes, who boasted how skillful and advanced they were while failing to or faintly paying due attention to patients, medicine, and the domain. For example, the electronic medical records (EMR) is a great way and tool. But, do we have any evidence that EMR has improved patient outcomes? Has EMR enabled physicians for analyzing patient data more efficiently, assisting them to make better decisions? Not quite so.
But, don’t get Prof. Lee wrong! Technology is important. “The more we care about the domain, the more we should be fully cognizant of and conversant in the technology”, Prof. Lee spoke up. “What matters, however, is not to lose our perspectives and reasons why we are doing this in the maze of technological overloads”, he added. This understanding led Prof. Lee to his next question. “Have we arrived at a point that encourages CCADD to rethink about its direction?” “Is the timing right?”
Not sure yet, frankly speaking. However, one thing is clear. CCADD should not postpone asking themselves those questions!
The conference presented 19 symposia, 6 oral presentation sessions of pre-selected paper submissions, and 3 tutorials in healthcare information, pharmaceutical and big data research which focused on analysis, application and standardization of data based on artificial intelligence (AI) and machine learning. Sharing research ideas and analysis techniques, the attendees had an in-depth discussion on emerging issues and utilization in the fields of medical informatics.
On the second day, Prof. Lee chaired one of the oral presentation sessions entitled "New Drug and Pharmacovigilance", where he stressed full understanding of the research domain by communicating with experts in each research field. On the other hand, Yoomin presented two posters titled 'A Dimensionality Reduction Model to Increase the Efficiency and Accuracy of Clinical Trial Feasibility Assessment Using Electronic Medical Records' and 'A CDM-based Clinical Trial to Evaluate the Efficacy and Safety of SGLT2 Inhibitors as Add-on Treatment in Patients with Type 2 Diabetes Mellitus on Metformin, Sulfonylurea and/or DPP-4 Inhibitors'. Yoomin's poster presentations were well received.
Through the conference, the three members of CCADD were delighted to get introduced to the leading academicians and industry experts in the field of medical informatics. Furthermore, Prof. Lee and two CCADD members had a fun discussion that helped them look deeply into their current activities and direction of future research. Their collected insights out of the conference will be further discussed at the upcoming year-end workshop in early December.
Five CCADD members (Prof. Howard Lee, Dr. Soohyun Kim, Yoomin Jeon, Tae Chung, Serin Lee) have attended the Fall conference of The Korean Society of Medical Informatics (KOSMI) held at Chonbuk National University on November 22-23, 2018. The theme of the conference was 'Real World Data to optimize clinical trials', which reflects a growing role and value of big data and artificial intelligence for clinical trials. Over 700 people from academia, public institutions, and the pharmaceutical industry gathered to share their experiences, practices, insights, and perspectives on the more active use of data and information sciences in clinical trials.
Prof. Howard Lee spoke about AI-based patient recruitment in clinical trial in an invited session, entitled 'A Dimensionality Reduction Model to increase the Efficiency and Accuracy of Clinical Trial Feasibility Assessment using Electronic Medical Records(EMR)'. Prof. Lee emphasized the application of AI technology to clinical trial feasibility such as feature selection algorithms in machine learning to identify common sensitive eligibility features (cSEFs).
Yoomin Jeon and Tae Chung presented a poster at the conference too. Yoomin's poster was about the actual application of what Prof. Lee introduced in his talk. Tae examined the extent of mapping of ICD-10 to MeSH to crosswalk and synchronize different terms collected from different data sources. (Analysis of agreement status between the diagnostic code of MeSH and ICD-10).
Meanwhile, Dr. Soohyun Kim led a tutorial session, where she taught several essential statistical methods for biomedical informatics research using R.