{"id":1160,"date":"2023-03-22T15:50:41","date_gmt":"2023-03-22T15:50:41","guid":{"rendered":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/"},"modified":"2025-09-18T13:51:48","modified_gmt":"2025-09-18T12:51:48","slug":"guide-for-reviewing-ai-papers","status":"publish","type":"page","link":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/","title":{"rendered":"Guide for reviewing AI papers"},"content":{"rendered":"<p>[et_pb_section fb_built=&#8221;1&#8243; fullwidth=&#8221;on&#8221; custom_padding_last_edited=&#8221;on|desktop&#8221; _builder_version=&#8221;4.21.0&#8243; background_enable_image=&#8221;off&#8221; custom_padding_tablet=&#8221;50px|0|50px|0&#8243; custom_padding_phone=&#8221;&#8221; transparent_background=&#8221;off&#8221; padding_mobile=&#8221;off&#8221; make_fullwidth=&#8221;off&#8221; use_custom_width=&#8221;off&#8221; width_unit=&#8221;on&#8221; locked=&#8221;off&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_fullwidth_header title=&#8221;For reviewers&#8221; content_max_width=&#8221;none&#8221; admin_label=&#8221;Fullwidth Header&#8221; _builder_version=&#8221;4.21.0&#8243; background_color=&#8221;rgba(255, 255, 255, 0)&#8221; button_one_letter_spacing_hover=&#8221;0&#8243; button_two_letter_spacing_hover=&#8221;0&#8243; global_colors_info=&#8221;{}&#8221; button_one_text_size__hover_enabled=&#8221;off&#8221; button_two_text_size__hover_enabled=&#8221;off&#8221; button_one_text_color__hover_enabled=&#8221;off&#8221; button_two_text_color__hover_enabled=&#8221;off&#8221; button_one_border_width__hover_enabled=&#8221;off&#8221; button_two_border_width__hover_enabled=&#8221;off&#8221; button_one_border_color__hover_enabled=&#8221;off&#8221; button_two_border_color__hover_enabled=&#8221;off&#8221; button_one_border_radius__hover_enabled=&#8221;off&#8221; button_two_border_radius__hover_enabled=&#8221;off&#8221; button_one_letter_spacing__hover_enabled=&#8221;on&#8221; button_one_letter_spacing__hover=&#8221;0&#8243; button_two_letter_spacing__hover_enabled=&#8221;on&#8221; button_two_letter_spacing__hover=&#8221;0&#8243; button_one_bg_color__hover_enabled=&#8221;off&#8221; button_two_bg_color__hover_enabled=&#8221;off&#8221;][\/et_pb_fullwidth_header][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.16&#8243; global_colors_info=&#8221;{}&#8221;][et_pb_row _builder_version=&#8221;4.16&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.16&#8243; custom_padding=&#8221;|||&#8221; global_colors_info=&#8221;{}&#8221; custom_padding__hover=&#8221;|||&#8221;][et_pb_text module_class=&#8221;push-column&#8221; _builder_version=&#8221;4.21.0&#8243; background_size=&#8221;initial&#8221; background_position=&#8221;top_left&#8221; background_repeat=&#8221;repeat&#8221; z_index_tablet=&#8221;500&#8243; text_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; text_text_shadow_vertical_length_tablet=&#8221;0px&#8221; text_text_shadow_blur_strength_tablet=&#8221;1px&#8221; link_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; link_text_shadow_vertical_length_tablet=&#8221;0px&#8221; link_text_shadow_blur_strength_tablet=&#8221;1px&#8221; ul_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; ul_text_shadow_vertical_length_tablet=&#8221;0px&#8221; ul_text_shadow_blur_strength_tablet=&#8221;1px&#8221; ol_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; ol_text_shadow_vertical_length_tablet=&#8221;0px&#8221; ol_text_shadow_blur_strength_tablet=&#8221;1px&#8221; quote_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; quote_text_shadow_vertical_length_tablet=&#8221;0px&#8221; quote_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_2_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_2_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_2_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_3_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_3_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_3_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_4_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_4_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_4_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_5_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_5_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_5_text_shadow_blur_strength_tablet=&#8221;1px&#8221; header_6_text_shadow_horizontal_length_tablet=&#8221;0px&#8221; header_6_text_shadow_vertical_length_tablet=&#8221;0px&#8221; header_6_text_shadow_blur_strength_tablet=&#8221;1px&#8221; box_shadow_horizontal_tablet=&#8221;0px&#8221; box_shadow_vertical_tablet=&#8221;0px&#8221; box_shadow_blur_tablet=&#8221;40px&#8221; box_shadow_spread_tablet=&#8221;0px&#8221; use_border_color=&#8221;off&#8221; border_color=&#8221;#ffffff&#8221; border_style=&#8221;solid&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<h3>Does the manuscript report on AI\/Radiomics?<\/h3>\n<p>Please let us know if the manuscript\u2019s main focus is on AI \/ radiomics, for example:<br \/>\n&#8211; Development of AI models<br \/>\n&#8211; Application of self-developed AI models or commercially available AI-powered products<br \/>\n&#8211; Development and validation of radiomics models<\/p>\n<p><strong>Keep in mind:<\/strong><\/p>\n<ul>\n<li>Radiomics here refers to the extraction of complex mathematical features describing gray value distributions like GLRLM, GLSZM, etc. as described here for example.<\/li>\n<li>More simple imaging biomarkers like ADC values or simple morphological measurements should not be referred to as radiomics to avoid confusion.<\/li>\n<li>Basic machine learning models such as linear regression are not considered artificial intelligence here, whereas more complex methods such as Support Vector Machines, Random Forests, etc. would fall under this category for the purpose of the review.<\/li>\n<\/ul>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; module_class=&#8221;dark&#8221; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row _builder_version=&#8221;4.20.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.20.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text admin_label=&#8221;Q2&#8243; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<h3>Is the presented AI\/Radiomics approach relevant for clinical practice?<\/h3>\n<p>[\/et_pb_text][et_pb_text admin_label=&#8221;Text&#8221; module_class=&#8221;push-column&#8221; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;]In some cases, proofs of concept might be interesting for our readership. However, as a clinical radiological journal, we would like to encourage authors to discuss the impact of the proposed AI \/ radiomics model in detail.<\/p>\n<p>&#8211; How would patient management be affected by the proposed model? Are different treatment options available?<br \/>\n&#8211; Is the model sufficiently accurate and reliable so that alternative methods could be safely omitted (for example, could biopsy\/surgery be avoided)?<\/p>\n<p><strong>Keep in mind:<\/strong><\/p>\n<ul>\n<li>Models that, for example, predict a specific gene mutation in non-small-cell lung cancer might not affect clinical routine much as histopathological confirmation of NSCLC would be required for the model to be applicable at which point a specimen would be available for genetic testing.<\/li>\n<li>Similarly, models with limited capabilities (for example, differentiation of HCC vs. liver hemangioma) might not be useful as important differential diagnoses are not assessed (CCC, liver adenoma, etc.).<\/li>\n<li>Statements like \u201ccould be used to guide more personalized treatment\u201d may not be helpful to our readership if no options for individualized care are presented \/ discussed.<\/li>\n<\/ul>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; _builder_version=&#8221;4.20.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row _builder_version=&#8221;4.20.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.20.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text admin_label=&#8221;Q3&#8243; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<h3>Is the reference standard used to train\/validate the AI\/radiomics reliable?<\/h3>\n<p>[\/et_pb_text][et_pb_text admin_label=&#8221;Text&#8221; module_class=&#8221;push-column&#8221; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;]The reference standard for training \/ validating AI (or radiomics) models should be as reliable as possible. Good reference standards are obtained by independent objective tests with structured results like:<br \/>\n&#8211; Laboratory tests<br \/>\n&#8211; Histopathology<br \/>\n&#8211; Outcome data<\/p>\n<p><strong>Keep in mind:<\/strong><\/p>\n<ul>\n<li>In some cases, such objective tests might not be available or feasible. However, the reference standard needs to be clearly defined and reported.<\/li>\n<li>Automatically extracted labels from unstructured data (for example using NLP to extract data from radiological reports) might introduce relevant errors due to imperfections of the NLP algorithm used.<\/li>\n<li>Single reader visual assessment is not a reliable reference standard, while consensus of multiple readers might be valid. Ideally a consensus of multiple readers in a different modality would be even more valid (for example if an AI is to detect subtle fractures on X-ray, consensus reading of CT scans of the same cases can be a valid reference standard).<\/li>\n<\/ul>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=&#8221;1&#8243; module_class=&#8221;dark&#8221; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_row _builder_version=&#8221;4.20.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_column type=&#8221;4_4&#8243; _builder_version=&#8221;4.20.1&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;][et_pb_text admin_label=&#8221;Q4&#8243; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;]<\/p>\n<h3>Was AI\/Radiomics performance compared to a human reader or clinical model?<\/h3>\n<p>[\/et_pb_text][et_pb_text admin_label=&#8221;Text&#8221; module_class=&#8221;push-column&#8221; _builder_version=&#8221;4.21.0&#8243; _module_preset=&#8221;default&#8221; global_colors_info=&#8221;{}&#8221;]To be clinically relevant, any AI \/ radiomics approach should be compared to either a human reader\u2019s performance, a model based on clinical information alone or any other clinically meaningful comparison, for example:<\/p>\n<ul>\n<li>A model predicting survival based on imaging features could be compared to a model including clinical data like age, pTNM, etc.<\/li>\n<li>A model differentiating HCC from liver hemangioma in MRI could be compared to a human reader\u2019s assessment.<\/li>\n<li>The comparison of the AI \/ radiomics performance with an alternative should be carried out using appropriate statistical tests.<\/li>\n<\/ul>\n<p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Does the manuscript report on AI\/Radiomics? Please let us know if the manuscript\u2019s main focus is on AI \/ radiomics, for example: &#8211; Development of AI models &#8211; Application of self-developed AI models or commercially available AI-powered products &#8211; Development and validation of radiomics models Keep in mind: Radiomics here refers to the extraction of [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"open","template":"","meta":{"_acf_changed":false,"_et_pb_use_builder":"on","_et_pb_old_content":"<p>[et_pb_section fb_built=\"1\" fullwidth=\"on\" custom_padding_last_edited=\"on|desktop\" _builder_version=\"4.21.0\" background_enable_image=\"off\" custom_padding_tablet=\"50px|0|50px|0\" custom_padding_phone=\"\" transparent_background=\"off\" padding_mobile=\"off\" make_fullwidth=\"off\" use_custom_width=\"off\" width_unit=\"on\" locked=\"off\" global_colors_info=\"{}\"][et_pb_fullwidth_header title=\"For reviewers\" content_max_width=\"none\" admin_label=\"Fullwidth Header\" _builder_version=\"4.21.0\" background_color=\"rgba(255, 255, 255, 0)\" hover_enabled=\"0\" button_one_letter_spacing_hover=\"0\" button_two_letter_spacing_hover=\"0\" global_colors_info=\"{}\" button_one_text_size__hover_enabled=\"off\" button_two_text_size__hover_enabled=\"off\" button_one_text_color__hover_enabled=\"off\" button_two_text_color__hover_enabled=\"off\" button_one_border_width__hover_enabled=\"off\" button_two_border_width__hover_enabled=\"off\" button_one_border_color__hover_enabled=\"off\" button_two_border_color__hover_enabled=\"off\" button_one_border_radius__hover_enabled=\"off\" button_two_border_radius__hover_enabled=\"off\" button_one_letter_spacing__hover_enabled=\"on\" button_one_letter_spacing__hover=\"0\" button_two_letter_spacing__hover_enabled=\"on\" button_two_letter_spacing__hover=\"0\" button_one_bg_color__hover_enabled=\"off\" button_two_bg_color__hover_enabled=\"off\" sticky_enabled=\"0\"][\/et_pb_fullwidth_header][\/et_pb_section][et_pb_section fb_built=\"1\" _builder_version=\"4.16\" global_colors_info=\"{}\"][et_pb_row _builder_version=\"4.16\" background_size=\"initial\" background_position=\"top_left\" background_repeat=\"repeat\" global_colors_info=\"{}\"][et_pb_column type=\"4_4\" _builder_version=\"4.16\" custom_padding=\"|||\" global_colors_info=\"{}\" custom_padding__hover=\"|||\"][et_pb_text module_class=\"push-column\" _builder_version=\"4.21.0\" background_size=\"initial\" background_position=\"top_left\" background_repeat=\"repeat\" z_index_tablet=\"500\" text_text_shadow_horizontal_length_tablet=\"0px\" text_text_shadow_vertical_length_tablet=\"0px\" text_text_shadow_blur_strength_tablet=\"1px\" link_text_shadow_horizontal_length_tablet=\"0px\" link_text_shadow_vertical_length_tablet=\"0px\" link_text_shadow_blur_strength_tablet=\"1px\" ul_text_shadow_horizontal_length_tablet=\"0px\" ul_text_shadow_vertical_length_tablet=\"0px\" ul_text_shadow_blur_strength_tablet=\"1px\" ol_text_shadow_horizontal_length_tablet=\"0px\" ol_text_shadow_vertical_length_tablet=\"0px\" ol_text_shadow_blur_strength_tablet=\"1px\" quote_text_shadow_horizontal_length_tablet=\"0px\" quote_text_shadow_vertical_length_tablet=\"0px\" quote_text_shadow_blur_strength_tablet=\"1px\" header_text_shadow_horizontal_length_tablet=\"0px\" header_text_shadow_vertical_length_tablet=\"0px\" header_text_shadow_blur_strength_tablet=\"1px\" header_2_text_shadow_horizontal_length_tablet=\"0px\" header_2_text_shadow_vertical_length_tablet=\"0px\" header_2_text_shadow_blur_strength_tablet=\"1px\" header_3_text_shadow_horizontal_length_tablet=\"0px\" header_3_text_shadow_vertical_length_tablet=\"0px\" header_3_text_shadow_blur_strength_tablet=\"1px\" header_4_text_shadow_horizontal_length_tablet=\"0px\" header_4_text_shadow_vertical_length_tablet=\"0px\" header_4_text_shadow_blur_strength_tablet=\"1px\" header_5_text_shadow_horizontal_length_tablet=\"0px\" header_5_text_shadow_vertical_length_tablet=\"0px\" header_5_text_shadow_blur_strength_tablet=\"1px\" header_6_text_shadow_horizontal_length_tablet=\"0px\" header_6_text_shadow_vertical_length_tablet=\"0px\" header_6_text_shadow_blur_strength_tablet=\"1px\" box_shadow_horizontal_tablet=\"0px\" box_shadow_vertical_tablet=\"0px\" box_shadow_blur_tablet=\"40px\" box_shadow_spread_tablet=\"0px\" use_border_color=\"off\" border_color=\"#ffffff\" border_style=\"solid\" global_colors_info=\"{}\"]<\/p><h3>Does the manuscript report on AI\/Radiomics?<\/h3><p>Please let us know if the manuscript\u2019s main focus is on AI \/ radiomics, for example:<br \/>- Development of AI models<br \/>- Application of self-developed AI models or commercially available AI-powered products<br \/>- Development and validation of radiomics models<\/p><p><strong>Keep in mind:<\/strong><\/p><ul><li>Radiomics here refers to the extraction of complex mathematical features describing gray value distributions like GLRLM, GLSZM, etc. as described here for example.<\/li><li>More simple imaging biomarkers like ADC values or simple morphological measurements should not be referred to as radiomics to avoid confusion.<\/li><li>Basic machine learning models such as linear regression are not considered artificial intelligence here, whereas more complex methods such as Support Vector Machines, Random Forests, etc. would fall under this category for the purpose of the review.<\/li><\/ul><p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=\"1\" module_class=\"dark\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_row _builder_version=\"4.20.1\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_column type=\"4_4\" _builder_version=\"4.20.1\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_text admin_label=\"Q2\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"]<\/p><h3>Is the presented AI\/Radiomics approach relevant for clinical practice?<\/h3><p>[\/et_pb_text][et_pb_text admin_label=\"Text\" module_class=\"push-column\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"]<\/p><p>In some cases, proofs of concept might be interesting for our readership. However, as a clinical radiological journal, we would like to encourage authors to discuss the impact of the proposed AI \/ radiomics model in detail.<\/p><p>- How would patient management be affected by the proposed model? Are different treatment options available?<br \/>- Is the model sufficiently accurate and reliable so that alternative methods could be safely omitted (for example, could biopsy\/surgery be avoided)?<\/p><p><strong>Keep in mind:<\/strong><\/p><ul><li>Models that, for example, predict a specific gene mutation in non-small-cell lung cancer might not affect clinical routine much as histopathological confirmation of NSCLC would be required for the model to be applicable at which point a specimen would be available for genetic testing.<\/li><li>Similarly, models with limited capabilities (for example, differentiation of HCC vs. liver hemangioma) might not be useful as important differential diagnoses are not assessed (CCC, liver adenoma, etc.).<\/li><li>Statements like \u201ccould be used to guide more personalized treatment\u201d may not be helpful to our readership if no options for individualized care are presented \/ discussed.<\/li><\/ul><p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=\"1\" _builder_version=\"4.20.1\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_row _builder_version=\"4.20.1\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_column type=\"4_4\" _builder_version=\"4.20.1\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_text admin_label=\"Q3\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"]<\/p><h3>Is the reference standard used to train\/validate the AI\/radiomics reliable?<\/h3><p>[\/et_pb_text][et_pb_text admin_label=\"Text\" module_class=\"push-column\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"]<\/p><p>The reference standard for training \/ validating AI (or radiomics) models should be as reliable as possible. Good reference standards are obtained by independent objective tests with structured results like:<br \/>- Laboratory tests<br \/>- Histopathology<br \/>- Outcome data<\/p><p><strong>Keep in mind:<\/strong><\/p><ul><li>In some cases, such objective tests might not be available or feasible. However, the reference standard needs to be clearly defined and reported.<\/li><li>Automatically extracted labels from unstructured data (for example using NLP to extract data from radiological reports) might introduce relevant errors due to imperfections of the NLP algorithm used.<\/li><li>Single reader visual assessment is not a reliable reference standard, while consensus of multiple readers might be valid. Ideally a consensus of multiple readers in a different modality would be even more valid (for example if an AI is to detect subtle fractures on X-ray, consensus reading of CT scans of the same cases can be a valid reference standard).<\/li><\/ul><p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=\"1\" module_class=\"dark\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_row _builder_version=\"4.20.1\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_column type=\"4_4\" _builder_version=\"4.20.1\" _module_preset=\"default\" global_colors_info=\"{}\"][et_pb_text admin_label=\"Q4\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"]<\/p><h3>Was AI\/Radiomics performance compared to a human reader or clinical model?<\/h3><p>[\/et_pb_text][et_pb_text admin_label=\"Text\" module_class=\"push-column\" _builder_version=\"4.21.0\" _module_preset=\"default\" global_colors_info=\"{}\"]<\/p><p>To be clinically relevant, any AI \/ radiomics approach should be compared to either a human reader\u2019s performance, a model based on clinical information alone or any other clinically meaningful comparison, for example:<\/p><ul><li>A model predicting survival based on imaging features could be compared to a model including clinical data like age, pTNM, etc.<\/li><li>A model differentiating HCC from liver hemangioma in MRI could be compared to a human reader\u2019s assessment.<\/li><li>The comparison of the AI \/ radiomics performance with an alternative should be carried out using appropriate statistical tests.<\/li><\/ul><p>[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section]<\/p>","_et_gb_content_width":"","inline_featured_image":false,"footnotes":""},"class_list":["post-1160","page","type-page","status-publish","hentry"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Guide for reviewing AI papers - European Radiology<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Guide for reviewing AI papers - European Radiology\" \/>\n<meta property=\"og:description\" content=\"Does the manuscript report on AI\/Radiomics? Please let us know if the manuscript\u2019s main focus is on AI \/ radiomics, for example: - Development of AI models - Application of self-developed AI models or commercially available AI-powered products - Development and validation of radiomics models Keep in mind: Radiomics here refers to the extraction of [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/\" \/>\n<meta property=\"og:site_name\" content=\"European Radiology\" \/>\n<meta property=\"article:modified_time\" content=\"2025-09-18T12:51:48+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/guide-for-reviewing-ai-papers\\\/\",\"url\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/guide-for-reviewing-ai-papers\\\/\",\"name\":\"Guide for reviewing AI papers - European Radiology\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/#website\"},\"datePublished\":\"2023-03-22T15:50:41+00:00\",\"dateModified\":\"2025-09-18T12:51:48+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/guide-for-reviewing-ai-papers\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/guide-for-reviewing-ai-papers\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/guide-for-reviewing-ai-papers\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Guide for reviewing AI papers\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/#website\",\"url\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/\",\"name\":\"European Radiology\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/journals.myesr.org\\\/eur-radiol\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Guide for reviewing AI papers - European Radiology","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/","og_locale":"en_GB","og_type":"article","og_title":"Guide for reviewing AI papers - European Radiology","og_description":"Does the manuscript report on AI\/Radiomics? Please let us know if the manuscript\u2019s main focus is on AI \/ radiomics, for example: - Development of AI models - Application of self-developed AI models or commercially available AI-powered products - Development and validation of radiomics models Keep in mind: Radiomics here refers to the extraction of [&hellip;]","og_url":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/","og_site_name":"European Radiology","article_modified_time":"2025-09-18T12:51:48+00:00","twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/","url":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/","name":"Guide for reviewing AI papers - European Radiology","isPartOf":{"@id":"https:\/\/journals.myesr.org\/eur-radiol\/#website"},"datePublished":"2023-03-22T15:50:41+00:00","dateModified":"2025-09-18T12:51:48+00:00","breadcrumb":{"@id":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/journals.myesr.org\/eur-radiol\/guide-for-reviewing-ai-papers\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/journals.myesr.org\/eur-radiol\/"},{"@type":"ListItem","position":2,"name":"Guide for reviewing AI papers"}]},{"@type":"WebSite","@id":"https:\/\/journals.myesr.org\/eur-radiol\/#website","url":"https:\/\/journals.myesr.org\/eur-radiol\/","name":"European Radiology","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/journals.myesr.org\/eur-radiol\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"}]}},"_links":{"self":[{"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/pages\/1160","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/comments?post=1160"}],"version-history":[{"count":2,"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/pages\/1160\/revisions"}],"predecessor-version":[{"id":1418,"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/pages\/1160\/revisions\/1418"}],"wp:attachment":[{"href":"https:\/\/journals.myesr.org\/eur-radiol\/wp-json\/wp\/v2\/media?parent=1160"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}