THE METHODOLOGY OF THE INTERACTIVE TEACHING FORMS BASED ON 3D – MODELING BY APPLICATION OF MOTION CAPTURE AND HAND CAPTURE TECHNOLOGIES

Pantus A. V.

MEDICAL EDUCATION

Scentific article

The possibilities of computer graphics, imitation of physical properties of various materials, realistic skeleton animation, complementary systems and virtual reality, combined with sensors for real-time motion tracking, make it possible to create medical simulators with simulation of a wide range of surgical pathologies and integrate into the virtual environment of the operator. The basis of this development is the task of creating a new mode of interactive training with the use of Motion Capture and Hand Capture technologies (real-time motion tracking technology). The aim of the study was formation and development of manual skills for increasing the efficiency and automation of students’ independent learning activities. Object and methods. The basis of the development is the creation of a virtual library of interactive three-dimensional anatomical «head-neck» models, as a template version of the pathology, import into an interactive threedimensional scene of computed tomography (CT) data and import into the virtual environment of operator movements. One of the main training elements is the students’ clinical projects. Results and discussion. The method is aimed at developing automation for surgical manipulations, the creation in the subconscious of the operator stereoscopic representation of the topography of organs and systems without a tactile component. The further development of such approaches will allow the broadcast in the interactive environment of a three-dimensional record or duplicate of the surgeon’s hands movements directly from the operating room and combine with the movements of the hands of the learner. Conclusion. Using the interactive environment allows you to simulate virtually all surgical pathologies, and the use of medical scanner data will allow you to move away from the template version of the pathology. Integration into the virtual environment of the Motion Capture and Hand Capture system will allow you to develop manual skills practically with any type of surgical pathology without significant economic costs.

3D simulation, virtual learning method, professional training, surgical stomatology.

1. Ayache N, Delingette H. International Symposium on Surgery Simulation and Soft Tissue Modeling, LNCS 2673, Juan-Les-Pins, France, June 12-13; 2003. Proceedings. Springer-Verlag. 386 p.
2. Bielser D, Gross MH. Interactive simulation of surgical cuts. Proceedings of Pacific Graphics; October 2000; Hong-Kong. IEEE Computer Society Press; 2000. p. 116-25.
3. Cavusoglu MC, Goktekin TG, Tendick F. GiPSi: A framework for open source/open architecture software development for organ-level surgical simulation. IEEE Transactions on Information Technology in Biomedicine. 2006;10(2):312-22.
4. Conti F. Chai 3D: An open-source framework for hapticsand dynamics simulation. In James Det al (eds). Medicine Meets Virtual Reality 15 – in vivo, in vitro, in silico: Designing the Next in Medicine. Amsterdam/Berlin/Oxford/Tokyo/Washington DC: IOS Press; 2007. 528 p.
5.  Faletti G, Vezzadini L. Neuro VR: An open source virtual reality platform for clinical psychology and behavioral neurosciences. Medicine Meets Virtual Reality 15. J. D. Westwood. Newport Beach, CA: IOS Press; 2007. 394 p.
6. Picinbono G, Delingette H, Ayache N. Non-Linear Anisotropic Elasticity for Real-Time Surgery Simulation. Graphical Models. 2003;65(5): 305-21.

«Bulletin of problems biology and medicine» Issue 2 Part 1 (150), 2019 year, 226-229 pages, index UDK 378.091.3:004.92

10.29254/2077-4214-2019-2-1-150-226-229