OR 2.0 Shenzhen'19 Overview

OR 2.0 Context-Aware Operating Theaters Shenzhen MICCAI'19 Satellite Event

Overview

Surgical robotic tools and digitally enhanced operating theaters have been giving surgeons a helping hand for years. While they provide great control, precision and flexibility to the surgeons, they don’t yet address the cognitive assistance needs in the operating theater. We are on the verge of a new wave of innovations of artificial intelligence powered, context-aware operating theaters. We envision future operating theaters that are holistic and seamlessly integrated in the surgery process. They will monitor their environment by gathering multi-modal data from sources such as cameras, sensors, monitoring devices, patient profile and history, and they will respond accordingly. Although this could be realized by following pre-established rules, a better and more holistic way would be to develop context-aware systems that are able to perceive and reason; make sense of ongoing processes, project outcomes of a number of possible actions that could be taken within this context, provide quantitative support to aid the decision making process, evaluate the outcomes of the action taken and use this information for the next steps. Advances in context-awareness can answer these needs and complement the surgical team by assisting the surgical procedures, providing real-time guidance during complex tasks and unexpected events.

This workshop aims to highlight the potential use of, with a particular focus but not limited to, machine vision and perception, robotics, surgical simulation and modeling, multi-modal data fusion and visualization, image analysis, advanced imaging, advanced display technologies, human-computer interfaces, sensors, wearable and implantable electronics and robots, visual attention models, cognitive models, decision support networks to enhance surgical procedural assistance, context-awareness and team communication in the operating theater, human-robot collaborative systems, and surgical training and assessment.

OR 2.0 Shenzhen 2019 will be held in conjunction with the Medical Image Computing and Computer Assisted Intervention (MICCAI) conference, and will take place in Shenzhen, China. The first International OR 2.0 Context-Aware Operating Theaters Workshop was held in 16 September 2018, in Granada, Spain in conjunction with MICCAI 2018 (See OR 2.0 Granada 2018 for details).  This year, we will expand our board with an industrial board from various companies that work on related topics. We also introduce bench to OR award, which will be given to works that have potential to be easily translated into clinical applications. We will emphasize the progress of the domain towards multidisciplinary approaches and teams with a focus on translation and clinical applications. Historically, OR 2.0 has its roots from, and is a new direction to the previously organized M2CAI (Modeling and Monitoring of Computer Assisted Interventions) workshop series which started in 2009 in London (UK) and has been organized every year until 2016 in Athens.

The workshop will feature clinicians, engineers and industry partners. All students and researchers interested in the future technologies that will define the next generation operating theatres, regardless of experience, are invited. Accepted papers will be published jointly with MICCAI 2018 in a Springer Lecture Notes in Computer Science (LNCS) Proceedings Volume. 

Program

Opening

Chairs: Stefanie Speidel, Pierre Jannin

8:30 – 8:40

Opening

8:40 – 9:00

Keynote: ‘Surgical Visual Perception towards AI-powered Context-Aware Operating Theaters’ by Dr. Qi Dou

Session I

Chairs: Nicolas Padoy, Caroline Essert

9:00 – 9:15

Oral Presentation: ‘Feature Aggregation Decoder for Segmenting Laparoscopic Scenes’

Abdolrahim Kadkhodamohammadi, Imanol Luengo, Santiago Barbarisi, Hinde Taleb, Evangello Flouty, Danail Stoyanov

9:15 – 9:30

Oral Presentation: ‘Preoperative Planning for Guidewires employing Shape-Regularized Segmentation and Optimized Trajectories’

Johannes L Fauser, Moritz Fuchs, Ahmed Ghazy, Bernhard Dorweiler, Anirban Mukhopadhyay

9:30-10:00

Coffe Break

10:00 – 10:20

Keynote: ‘A versatile solution for robot-aided surgery in constrained workspaces: SmartArm and related technologies’ by Dr. Murilo M. Marinho

Session II

Chairs: Pierre Jannin, Qi Dou

10:00 -10:15

Oral Presentation: ‘Live monitoring of hemodynamic changes with multispectral image analysis’

Leonardo Ayala, Sebastian Wirkert, Janek Groehl, Mildred Herrera, Adrian Hernandez, Anant Vermuri, Edgar Santos, Lena Maier-Hein

10:15 – 10:30

Oral Presentation: ‘Towards a Cyber-Physical Systems Based Operating Room of the Future’

Chin Boon Chng, Pooi Mun Wong, Nicholas Ho, Xiaoyu Tan, Chee-Kong Chui

10:30-10:50

Keynote: ‘Neurosurgical Robot in the Unstructured Operating Room Environment: Perception and Modeling’ Prof. Guangzhi WANG

Session III

Chairs: Caroline Essert

10:50 – 11:05

Oral Presentation: ‘Unsupervised Temporal Video Segmentation as an Auxiliary Task for Predicting the Remaining Surgery Duration’

Dominik Rivoir, Sebastian Bodenstedt, Felix von Bechtolsheim, Marius Distler, Jürgen Weitz, Stefanie Speidel

11:05 – 11:20

Oral Presentation: ‘Guided unsupervised desmoking of laparoscopic images using Cycle-Desmoke’

Vishal V, Munendra Singh, Neeraj Sharma

Session IV

Chairs: Omid Mohareri, Imanol Luengo

11:20 -11:50

Industrial Session & Awards

Closing

Chairs: Duygu Sarikaya and Stefanie Speidel

11:50-12:00

Closing

 

Submissions

Submissions

Call for Papers

Full paper submissions of 6-8 pages will be featured. Oral and poster papers will be accepted. Eligible oral paper authors will present their work as part of the workshop program, while both oral and poster papers will be featured at poster session during coffee break. The distinction between oral and posters will be made by the board according to reviews and relevance to the theme of the workshop. The number of accepted papers will be based on quality of the submissions, number of submissions and time constraints of the program. Best paper/posters will be awarded. This year, we will also be giving a bench to OR award for works that have potential to be easily translated into clinical applications. We would like to thank our sponsor Intuitive for sponsoring a total of 2000$ in prizes for awards. All participants will have a chance to actively participate in open forum discussions. 

The featured topics of the OR 2.0 Context-Aware Operating Theatres are, but not limited to, as below:

  • Machine vision and perception
  • Robotics
  • Surgical simulation and modeling
  • Cognitive models
  • Multi-modal data fusion and visualization
  • Image analysis
  • Advanced imaging
  • Advanced display technologies
  • Human-computer interfaces
  • Sensors
  • Wearable and implantable electronics and robots
  • Visual attention models
  • Decision support networks to enhance surgical procedural assistance
  • Context-awareness and team communication in the operating theater
  • Human-robot collaborative systems
  • Surgical training and assessment

Author Submissions

  • *NEW* The deadline is extended to 04/08/2019 Pacific Time (PT) 11:59PM. If you have already submitted, you can still edit until this date. We are looking forward to your submissions.
  • The deadline is extended to 19/07/2019 Pacific Time (PT) 11:59PM. If you have already submitted, you can still edit until this date.
  • Deadline is 14/07/2019 Pacific Time (PT) 11:59PM
  • Please submit your submissions to us as a pdf file, supplementary files are optional(Submissions will be done via CMT Microsoft at https://cmt3.research.microsoft.com/OR2019)
  • The review process is double blind and submissions should conform to the MICCAI anonymity guidelines. Please do not forget to anonymize the file names of your submissions. If you wish to upload your paper on Arxiv, you may do so. However your paper should stand alone without any supplementary material and/or reference to an ArXiv post.
  • LNCS templates will be used for paper submissions. You can find author guidelines for this format here: LNCS Author Guidelines
  • You can download the templates following the links:  Latex (preferred) or Word 
  • Please keep your original latex or word files with supporting materials (images, tables, references etc.), we will need them for camera-ready submissions for the joint proceedings.
  • Papers should present original scientific material in English text, featuring overview/motivation, material and methods, experiments, results and conclusions.

Keynote Speakers

Keynote Speakers

Dr. Qi DOU
Dr. Murilo M. MARINHO
Prof. Guangzhi WANG
Biography

Dr. Qi DOU is currently a postdoctoral research associate at the Department of Computing at Imperial College London. Before that, she has received her Ph.D. degree in Computer Science and Engineering at The Chinese University of Hong Kong in July 2018. Her research interests are in the development of advanced machine learning methods for medical image computing and surgical robotics perception, with expertise in deep learning. Dr. Dou has published 40+ papers in top conferences and journals on AI for healthcare, with Google Scholar h-index of 20. She has won the Best Paper Award of Medical Image Analysis-MICCAI in 2017, the Best Paper Award of Medical Imaging and Augmented Reality in 2016, and MICCAI Young Scientist Award Runner-up in 2016. She has also won the HKIS Young Scientist Award 2018 and the CUHK Faculty Outstanding Thesis Award 2018. She serves as Area Chair of MIDL’19, PC of IJCAI’18-19, AAAI’19, Reviewer of MICCAI’17-19, IROS’19, journals including TPAMI, TMI, Medical Image Analysis, IJCV, TBME, JBHI, Pattern Recognition, Neurocomputing, etc.

Title: "Surgical Visual Perception towards AI-powered Context-Aware Operating Theaters"

Abstract: With advancements in medicine and information technologies, the operating room has undergone tremendous transformations evolving into a highly complicated environment. These achievements furthers innovate the surgery procedure and have great promise to enhance the patient safety. Within the new generation of operating theatre, the computer-assisted system plays an important role to provide surgeons with reliable contextual support. In this talk, I will present a series of deep learning methods towards interdisciplinary researches at artificial intelligence for surgical robotic perception, for automated surgical workflow analysis, instrument presence detection, surgical tool segmentation, surgical scene perception, etc. The proposed methods cover a wide range of deep learning topics including design of network architectures, novel learning strategies such as attention mechanism, multi-task learning, transfer learning, adversarial training, etc. The challenges, up-to-date progresses and promising future directions of AI-powered context-aware operating theaters will also be discussed.

 

 

 

 

 

 

.

 

 

Biography

Dr. Murilo M. MARINHO received his B.Sc. in Mechatronics Engineering in 2012 and his M.Sc. in Electronics and Automation Engineering in 2014, both from the University of Brasilia, Brasilia, Brazil. He received his Ph.D. degree in Mechanical Engineering in 2018 from the University of Tokyo, Tokyo, Japan. In 2019, he was a visiting researcher with the Johns Hopkins University. He is currently an assistant professor at the University of Tokyo, Tokyo, Japan. His research interests include robotics applied to medicine, robot control theory, and image processing. Recently, his team won the 'Best Innovation Award' and the 'Overall Winner Award' in the Surgical Robot Challenge 2019. 
 

Title: "A versatile solution for robot-aided surgery in constrained workspaces: SmartArm and related technologies"
 

Abstract: Surgical robots have received much attention from the robotics community and are seen by many as an integral part of the operating room of the future. Some surgical procedures, in special those in constrained workspaces, are beyond what can be achieved with current commercial systems. In the context of the ambitious research project “Bionic Humanoids Propelling New Industrial Revolution” led by Prof. Kanako Harada, our group developed the SmartArm versatile robotic system.
In this talk, after a brief contextualization, I will present the SmartArm robotic system, including the system integration, the hardware design, and the control algorithms. I will show relevant use cases of our system in pediatric surgery and endonasal surgery using realistic anatomical models. After, I will present some of the related technologies being developed by our group, namely AI-enabled systems for the recognition of the surgical environment and instruments, and photorealistic virtual-reality simulations. With this, I will share our vision for the operating theaters of the future.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Biography

Prof. Guangzhi WANG, received his B.E. and M.S. Degrees in mechanical engineering in 1984 and1987 respectively,and received his Ph.D. degree in Biomedical Engineering in 2003, all from Tsinghua University, Beijing, China. Since 1987, he has been with the Biomedical Engineering division of Tsinghua University. Since 2004, He is a tenured full Professor of Biomedical Engineering Department, Tsinghua University, Beijing, China. Since 2015 Dr. Guangzhi Wang was elected as the vice president of Chinese Society of Biomedical Engineering, and since 2018, he was elected as vice president of Chinese Association of Medical Imaging Technology. His research interest includes biomedical image processing, image based surgical planning and computer aided surgery.

Title: "Neurosurgical Robot in the Unstructured Operating Room Environment: Perception and Modeling"

Abstract: Stereotactic neurosurgical robots have been used for many years in clinic. However, to prioritize the basic requirements of stereotactic neurosurgery, most robots are hypothesized to work in a static, simplified and fully accessible surgical environment, which in practice could be unstructured and dynamic. The surgery task varies with different surgical plans and relates to patents’ anatomy and postures during the surgery. Many obstacles exist around the patient’s head, such as head frame, breathing tube and so on. Moreover, unexpected body movements and other environment changes may occur during the operation. Therefore, the perception and modeling of the operation object and surrounding obstacles are essential for neurosurgical robots for a context-aware operating theater.

We have developed a neurosurgical stereotactic robot to perform the minimally invasive SEEG electrode implantation in the operating room. Multimodal image-based planning and registration were used for the robot-guided operation. To enhance the robot’s context-aware ability during operations, we have been focusing on further improving surgical robots’ perception and real-time modeling ability to adapt to the unstructured operation room environment better, which could make neurosurgical robots not only more precision and safer, but also more efficient, more intelligent.In this lecture, we will share our previous research experience in this field, and then discuss the future automatic and active stereotactic robots from the perspective of context-aware. We divide the development of stereotactic robots into four levels according to their perceptual abilities: internal anatomy and primary environment perception, local environment perception, global environment perception, and multimodal environment perception. Our research and some attempts to environment perception and modeling will be introduced under this framework. In addition, the mature technologies and the technologies yet to be developed will also be discussed for the future automatic and active stereotactic robot.

 

 

Important Dates

Important Dates

Important Dates

*All deadlines are at 11:59PM Pacific Daylight Time [PDT]

  • *NEW* [22nd July 2019] The deadline is extended to 04/08/2019 Pacific Time (PT) 11:59PM. If you have already submitted, you can still edit until this date. We are looking forward to your submissions.
  • [14th July 2019] The deadline is extended to 19/07/2019 Pacific Time (PT) 11:59PM. If you have already submitted, you can still edit until this date.
  • [2nd July 2019] Dr. Qi DOU will be one of our keynote speakers, her talk will focus on endoscopy surgical video analysis.
  • [23rd June 2019] Paper submission​ deadline is 14/07/2019 11:59PM (PDT)
  • [3rd June 2019] Paper submission is now open on https://cmt3.research.microsoft.com/OR2019
  • OR 2.0 Context-Aware Operating Theaters Call for Papers (tentative deadline: 07/07/2019 11:59PM (PDT))
  • [17th May 2019] OR 2.0 Context-Aware Operating Theaters Call for Papers (deadline TBA: to be announced soon)
  • [12th April 2019] OR 2.0 Context-Aware Operating Theaters Shenzhen MICCAI'19 Website Live
  • [31th March 2019] OR 2.0 Context-Aware Operating Theaters Shenzhen MICCAI'19 Satellite Workshop Event Accepted

Meet the Team

Meet the Team

 
Organizing Board
 

Duygu Sarikaya
Anand Malpani
Daniel Hashimoto
Stefanie Speidel

 
 
Industrial Board (alphabetical)
 

 
Imanol Luengo
Omid Mohareri
Lars Mündermann
 
Cyrill von Tiesenhausen
 

 

Advisory Board (alphabetical)
 

 
Chee Kong Chui
Paolo Fiorini
Pheng-Ann Heng
Pierre Jannin
Ken Masamune
Thomas Neumuth
Nicolas Padoy
Sandrine de Ribaupierre
Marco Zenati
 
Guoyan Zheng
 

We are looking to extend our board with representatives from various companies, and with local community of young academics and researchers (all boards, particularly industrial board). If you are interested in joining our board, please contact us.

Awards & Sponsors

Awards & Sponsors

 

We would like to thank our sponsor Intuitive Surgical for sponsoring a total of 2000$ in prizes for awards.

 

If you would like to sponsor our satellite workshop event, please contact us.

Event Details

Contact

Contact

We are looking for Sponsors. If you would like to sponsor our event for vouchers for students and keynote speakers, please contact us.
For inquiries about the event, please contact us via or20miccai@gmail.com
For submissions, please follow the page: Submissions
 

OR 2.0 Granada (2018)

OR 2.0 Granada MICCAI'18

Best oral presentation awardees - Best oral presentation awardees :) We had not only one but two 1st places! Congratulations to Isabel Funke, Juliane Neumann and Mónica García-Sevilla. Thanks to our sponsor Intuitive for sponsoring 2000$ total in prizes.

“Temporal coherence-based self-supervised learning for laparoscopic workflow analysis”, Isabel Funke
“Perioperative workflow simulation and optimization in orthopedic surgery”, Juliane Neumann
“Performance Evaluation to Improve Training in Forceps-Assisted Delivery”, Mónica García-Sevilla

Best Poster Awardees - Our keynote speaker Marco A. Zenati, Prof of Surgery at Harvard Medical School, also presented two of his team's works at the poster session and took both poster awards home! A moment from his amazing and relatable presentations.

“Intelligent Interruption Management System to Enhance Safety and Performance in Complex Surgical and Robotic Procedures”,
“A Novel Interoperable Safety System for Improved Coordination and Communication in Cardiac Surgery”

OR 2.0 Granada MICCAI 2018 Keynote peakers
"Surgical Activities with Artificial Intelligence" , Nicolas Padoy - Dr. Nicolas Padoy, Associate Professor at University of Strasbourg, delivered a keynote on "Surgical Activities with Artificial Intelligence"
"Modeling of Team Performance in Complex and Robotic Surgery", Marco A.Zenati - Marco A. Zenati, Professor of Surgery at Harvard Medical School, delivered a keynote on "Modeling of Team Performance in Complex and Robotic Surgery"
OR 2.0 Granada MICCAI 2018 Presenters
Juliane Neumann
Evangello Flouty
Isabel Funke
Alexander Chang
Johannes L Fauser
Stefan Franke
Kaori Kusuda
Mónica García-Sevilla

OR 2.0 Granada MICCAI 2018 Program

The 2018 workshop took place in the afternoon of Sunday, 16th September 2018 at the "Press Room" at the Conference Center venue. For more details, please check http://www.miccai2018.org/en/16-SEPTEMBER-SATELLITE-EVENTS.html

3:00 Opening

3:05 Keynote Talk by Dr. Nicolas Padoy titled "Monitoring Surgical Activities with Artificial Intelligence"

3:35 Oral Presentation “FaceOff: Anonymizing Videos in the Operating Rooms”, Evangello Flouty (Digital Surgery)*; Odysseas Zisimopoulos (Digital Surgery); Danail Stoyanov (Touch Surgery)” 

3:50 Oral Presentation “Temporal coherence-based self-supervised learning for laparoscopic workflow analysis”, Isabel Funke (National Center for Tumor Diseases (NCT) Dresden)*; Alexander Jenke (National Center for Tumor Diseases (NCT) Dresden); Sören Torge Mees (University Hospital of Dresden); Jürgen Weitz (University Hospital of Dresden); Stefanie Speidel (National Center for Tumor Diseases (NCT) Dresden); Sebastian Bodenstedt (National Center for Tumor Diseases (NCT) Dresden)”  

4:05 Poster Teasers

Intelligent Interruption Management System to Enhance Safety and Performance in Complex Surgical and Robotic Procedures”, Roger Daglius Dias (Stratus Center for Medical Simulation, Brigham and Women's Hospital, Harvard Medical School)*; Heather Conboy (University of Massachusetts); Jennifer Gabany (Division of Cardiac Surgery, VA Healthcare System, Boston); Lori Clarke (University of Massachusetts); Leon Osterweil (University of Massachusetts); George Avrunin (University of Massachusetts); David Arney (MGH); Julian Goldman (MGH); Giuseppe Riccardi (University of Trento); Steven Yule (STRATUS Center for Simulation, Brigham & Women's Hospital); Marco A Zenati (Harvard Medical School)

Interactive Training and Operation Ecosystem for Surgical Tasks in Mixed Reality”, Ehsan Azimi (Johns Hopkins University)*; Camilo Molina (Johns Hopkins University); Alexander Chang (Johns Hopkins University); Judy Huang (Johns Hopkins University); Chien-Ming Huang (Johns Hopkins University); Peter Kazanzides (Johns Hopkins University)

A Novel Interoperable Safety System for Improved Coordination and Communication in Cardiac Surgery”, David Arney (MGH)*; Geoffrey Rance (VA); Marco A Zenati (Harvard Medical School); Julian Goldman (MGH); Srey Rithy (VA)

Automatic Cochlear Length and Volume Size Estimation”, Ibraheem Al-Dhamari (University of Koblenz and Landau)*; Sabine Bauer (University of Koblenz and Landau); Dietrich Paulus (n/a); Rania Helal (ASU); Friedrich Lisseck (BWZK Koblenz); Roland Jacob (BWZK Koblenz)

Generalized planning of nonlinear interventions”, Johannes L Fauser (TU Darmstadt)*; Igor Stenin (Universitätsklinikum Düsseldorf); Julia Kristin (Universitätsklinikum Düsseldorf); Thomas Klenzner (Universitätsklinikum Düsseldorf); Jörg Schipper (Universitätsklinikum Düsseldorf); Dieter Fellner (Technische Universität Darmstadt); Anirban Mukhopadhyay (TU Darmstadt)

4:30 – 5:00 Coffee Break & Poster Session

5:00 Keynote Talk by Marco A. Zenati, Professor of Surgery at Harvard Medical School titled "Modeling of Team Performance in Complex and Robotic Surgery"

5:30 Oral Presentation A method for the context-aware assignment of medical device functions to input devices in integrated operating rooms”, Stefan Franke (Universität Leipzig)*; Max Rockstroh (Universität Leipzig); Martin Kasparick (Universität Rostock); Thomas Neumuth (Universität Leipzig)”

5:45 Oral Presentation Perioperative workflow simulation and optimization in orthopedic surgery”, Juliane Neumann (Innovation Center Computer Assisted Surgery (ICCAS), Leipzig University)*

6:00 Oral Presentation “Performance Evaluation to Improve Training in Forceps-Assisted Delivery”,Mónica García-Sevilla (Department of Bioengineering and Aerospace Engineering, Universidad Carlos III de Madrid; Instituto de Investigación Sanitaria Gregorio Marañón )*; Juan De Leon (Hospital General Universitario Gregorio Marañon); Rafael Moreta-Martinez (Department of Bioengineering and Aerospace Engineering, Universidad Carlos III de Madrid; Instituto de Investigación Sanitaria Gregorio Marañón); David García-Mato (Department of Bioengineering and Aerospace Engineering, Universidad Carlos III de Madrid; Instituto de Investigación Sanitaria Gregorio Marañón); Rubén Pérez Mañanes (Hospital General Universitario Gregorio Marañón); Jose Antonio Calvo Haro (Hospital General Universitario Gregorio Marañón); Javier Pascau (Department of Bioengineering and Aerospace Engineering, Universidad Carlos III de Madrid; Instituto de Investigación Sanitaria Gregorio Marañón)”

6:15  Oral Presentation Clinical trial of information acquisition system for surgical instruments in digital operation room”, Kaori Kusuda (Tokyo Women's Medical University)*; Kazuhiko Yamashita (Osaka University); Yoshitomo Ito (Saiseikai Kurihashi Hospital); Kiyohito Tanaka (Kyoto Second Red Cross Hospital); Ken Masamune (Tokyo Women's Medical University); Yoshihiro Muragaki (Tokyo Women's Medical University)

6:30 – 7:00 Closing Remarks, Discussion and Awards

OR 2.0 Granada MICCAI 2018 Organizing Board

Duygu Sarikaya
Anand Malpani
Marco Zenati
Sandrine de Ribaupierre

OR 2.0 Granada MICCAI 2018 Advisory Board

Paolo Fiorini
Kanako Harada
Pierre Jannin
Ken Masamune
Thomas Neumuth

Nicolas Padoy
Russell H. Taylor