Robotic 3D scanner as an alternative to standard modalities of medical imaging
© Chromy and Zalud; licensee Springer. 2014
Received: 12 November 2013
Accepted: 20 December 2013
Published: 6 January 2014
There are special medical cases, where standard medical imaging modalities are able to offer sufficient results, but not in the optimal way. It means, that desired results are produced with unnecessarily high expenses, with redundant informations or with needless demands on patient. This paper deals with one special case, where information useful for examination is the body surface only, inner sight into the body is needless. New specialized medical imaging device is developed for this situation.
In the Introduction section, analysis of presently used medical imaging modalities is presented, which declares, that no available imaging device is best fitting for mentioned purposes. In the next section, development of the new specialized medical imaging device is presented, and its principles and functions are described. Then, the parameters of new device are compared with present ones. It brings significant advantages comparing to present imaging systems.
In order to understand all the processes inside the human body, or in order to detect its defects, we want to be able to look into the body in non-invasive way, without its damaging – and that is what we achieve using medical imaging. This important tool has ever played an important role in public health care since the first medical imaging technique was presented at 1985 by Wilhelm Rontgen (Novelline1997) and has been developed a lot since this time. Nowadays, we have plenty of devices using different techniques, when most of them are focused on seeing the interior objects inside the body and some of them are able to build 3D model of part of human body (Singh and Jones1993).
But there are many specific cases, where information about inner structures is useless for our purpose and just 3D model of surface is sufficient. As an representative example, monitoring of rehabilitation process after serious injury can be mentioned: The monitored value is volume of musculature and the shape of recovering muscle. The gain in muscle volume is too small to be measureable by common techniques and changes in shape are also tiny. As a result of this, the only solution is to compare detailed 3D models of damaged part of patients body acquired in different time moments (Konecny et al.2013). Because the monitored values can be measured from body surface, the required model for this case is a 3D model of surface, inner structures are not necessary.
Actually, common imaging modalities capable of building 3D models of surface are Computed Tomography (CT), Magnetic Resonance Imaging (MRI) and partially Ultrasonography (Udupa and Herman2000: Webb2002). Each imaging technique has its advantages and disadvantages:
Medical ultrasonography is a modality, which is primarily intended to watch internal constitution of inner tissues, not to capture the body surface (Robertson and Baker2001). Although ultrasonography in a broader sense, on account of its physical principle, is capable of capturing surface, this technique is not sufficient because of its poor resolution, which is caused by sound-beam divergence (Musil et al.2008). In order to analyze volume and tissue shape, resolution higher than provided by ultrasound is required.
Computed Tomography reaches up to 0.2 mm spatial resolution in output 3D model (MCCollough and Zink1999), what is value, which is fully sufficient for our purposes. It works on principle, that high number of 2D scans is produced using X-ray source and these slices are merged together into one 3D model (Herman and Gabor2010). Ionizing radiation absorbed by patient during one scan is up to 15 mSv, what is one third of allowed exposition for workers with ionizing source per year and for common people exceeds allowed hygiene limits even 15 times (Statni urad pro jadernou bezpecnost2002). For this reason, use of this modality is allowed as rare as possible and repeated scanning is completely out of the question.
Magnetic resonance imaging
Compared to technologies mentioned above, Magnetic Resonance Imaging is the best fitting modality for purposes of capturing 3D models of surface periodically. It doesn’t work with X-rays, so there is no limitation on number of models scanned. Its resolution is also high enough (approximately 1 mm) (Novelline1997) and this technique produces 3D model containing both surface and inner structures (Seidl and Vaneckova2007). But because of its complexity, acquisition costs of MRI scanner begins at 750 000 EUR, and price per one model reaches from 230 to 350 EUR (Magnetic Resonance Imaging2010).
As summarized above, none of these technologies are intended to provide 3D model of patient’s body surface only. All of them provides image of inner structures, what influences device’s costs and also brings another disadvantages. There is no imaging device intended specially for medical cases, which requires model of body surface as a tool for examination.
To develop such specialized device, which will be free of disadvantages mentioned above, it is aim of project described in this paper. In the following section, the constitution and main operating principles of this new proposed medical imaging device are described, then comparison with present devices is made.
Robotic 3D scanner
In case of scanning surface of human body, high resolution is required, so we use precise laser scanner based on triangulation principle. These scanners are very accurate, but disposes with small measuring range. Such scanner should also use laser emitter compatible with Class 1 or Class 1M in order to avoid damage of patient eyes in case of scanning his face, what is realizable with some scanners presently available.
If we want to make 3D model of any large structure, like a building etc., it is also possible, we can only change the scanner to one with wider measuring range, for example laser scanner based on TOF principle can be used (Shan and Toth2008). So this device is not just for scanning body – it is flexible multi-purpose 3D scanner.
Both devices are connected to the controlling computer using Ethernet. At this computer, there is a software acquiring measured data from scanner and information about actual position from robotic end-point. These data are then processed to form of point-cloud using Homogeneous transformation.
Robotic manipulator’s end-point is moved from point to point over the predefined scanning trajectory and when desired point is reached, the measuring is performed and data are processed. Each positioning command is validated by driver when desired position is reached, what ensures, that scanning is performed from exact point of view. Communication between manipulator and control computer is performed via driver communicating with program in the control unit of robot, which receives commands sent over Ethernet and moves with manipulator (Chromy2013). This empowers real-time control of robotic manipulator. Scanning trajectory is defined as a list of points to measure from and can be easily defined and managed using graphical interface.
Measured point coordinates computation
Transformation L → S
If data from laser scanner are produced in Cartesian coordinate system form, this transformation is not performed. On output of this transformation, linear block of points (2D line) is placed in coordinate system S.
Transformation S → E
where c(x) = cos(x), s(x) = sin(x), x t , y t and z t is translation of system S in system E along appropriate axis, u t is roll, v t is pitch and w t is yaw of system S in coordinate system E. This transformation is time-invariant and belongs to each scanner. Describes, how scanner is rotated and translated according to the robotic end-point.
Transformation E → M
where c(x) = cos(x) and s(x) = sin(x), x, y and z is actual position of manipulator’s end-point in own manipulator’s coordinate system M, u is its roll, v is pitch and w is yaw. Parameters used in this transformation are time-variant and could be acquired from manipulators driver.
Transformation M → 0
Describes relation between coordinate system of manipulator and coordinate system, in which we want to publish results of our 3D scanning. In our case, system 0 is identical with system M. If it is not, the homogeneous transformation from system 0 to M would be described by matrix H0M similar to H ME .
Each point measured by laser scanner is transformed using equation 1. Result of these transformations is cloud of points in three-dimensional Cartesian space. These points are then further processed.
Generation of 3D models
Pure point-cloud visualized in 3D space is not illustrative enough, so our software package of Robotic 3D Scanner contains module, which produces shaded, surface-covered 3D model. This module uses Delaunay Triangulation (Chen2011) method in order to find three closest points to be connected into the triangle used for rendering image by graphic device (Grootjans2009).
Controlling robotic 3D scanner
Robotic 3D scanner accuracy
where Δ M is placing accuracy of manipulator’s end-point, Δ S is measuring accuracy of laser scanner and Δ H is error in coordinate computation caused by precision of mounting holder.
Note, that this error estimation is very pessimistic and defines the worst case (3σ). In real operation, overall accuracy is usually better.
In our research, we use robotic manipulator Epson C3 with accuracy of end-point placing ±0.02 m m (Epson C3 Compact 6-Axis Robot Manual2011), laser scanner MicroEpsilon ScanCONTROL2750-100 with accuracy ±0.04 m m (Instruction Manual scanCONTROL2008) and laser scanner SICK LMS with accuracy ±4 m m (LMS 400 Laser Measurement System Operating Instructions2006). For capturing human body, we use MicroEpsilon scanner and according to equation 7, overall accuracy in this case is ±0.18 m m.
The aim of calibration procedure is to compensate deviations of real dimensions of mounting holder compare to dimensions stated in its documentation. If these deviations are compensated, then equation for overall accuracy (eq. 6) is valid. In fact, it is looking for 6 calibration constants determining translation and rotation of scanner in 6-DOF caused by imprecision of mounting holder.
Proposed method is based on principle, that if some scene is firstly captured from one direction, and then the same scene is captured from another direction, deviations in mounting holder dimensions causes shifting and deforming of scene, but in both cases differently. From differences among these two images of the same scene, we can compute desired calibration constants. This approach would work in case of any scene, but for the simplification of image processing, we use scene of cuboid laying on the flat ground (Chromy2013).
Significant advantage of this method is, that it is based on general object, without any requirements on its precision. If we use common calibration method based on reference object with known dimensions, it will be very difficult to manufacture reference object with enough precision.
Detailed description of computing of each calibration parameter can be found at (Chromy2013), here it is not presented in order to be concise.
Residual error after calibration
Each uncertainty of Δ C is composed from uncertainty type A and type B (Palencar et al.2001). When number of measurements increases, the uncertainty type A is being minimized and measured value converges in direction to true value. Because calibration procedure uses several thousands of points, also residual error Δ C after calibration will be smaller than at equation 8.
As a result of this, the overall accuracy will be usually better than maximal guaranteed error defined in equation 7, what is a limit value of error.
Evaluating benefits of calibration
where I1 and I2 are scans which correlation we are looking for and ∥x y∥ is a distance between points x and y. The task of calibration procedure is to compute such combination of calibration constants, which provides the smallest value of f err .
Illustrating influence of calibration
Criterion function f err [–]
Average-absolute error Δ abs [mm]
Root-mean-square error Δ RMS [mm]
Comparison with standard modalities
Comparison of various medical imaging modalities
(Musil et al.2008),
(MCCollough and Zink1999),
(Compare Ultrasound Cost2012),
(Herman and Gabor2010),
(Magnetic Resonance Imaging2010)
(Physics of Ultrasound Imaging2009)
(Statni urad pro jadernou bezpecnost2002)
(Compare CAT Scan Cost2012)
120 000 EUR
775 000 EUR
38 000 EUR
Price per scan
< 1 EUR
< 1 EUR
< 1 min.
up to 0.2 mm
Up to 0.5 mm
< 0.18 mm
Must be use rarely
No metal objects
Sonographs are fast and relatively cheap devices, but do not meet required minimal resolution. Also commonly used device are intended to watch just inner structures and devices capable of scanning surface of body are very rare (Physics of Ultrasound Imaging2009).
Computed tomography reaches desired resolution, but it also cannot be used because of high expositions of ionizing radiation (Statni urad pro jadernou bezpecnost2002). Repeated measurements cannot be performed because of this reason. CT devices are also very expensive at acquisition and also at operation.
The only device, which is useful for our purposes is MRI. It disposes with sufficient resolution and does not produce harmful radiation, so it can be used repeatedly. But its acquisition costs are extremely high, as well as its operational costs (Magnetic Resonance Imaging2010). It is one of the most expensive medical imaging, so as a result of this, not enough devices are available. It leads to long waiting times for examination, what makes problems when periodical scanning is required. Problems are also with people afflicted with claustrophobia, with pacemakers, endoprostheses or with metal piercing.
All these disadvantages are not present at Robotic 3D Scanner. Its clear, that it cannot supply MRI completely – MRI is designed mainly for models of interior of body. But in many cases, where look into the body is not necessary, MRI can be successfully replaced by Robotic 3D Scanner. In such cases, its use saves considerable amounts of money, scanning is faster and we don’t block patients, that must be captured by MRI and cannot be scanned with other device. Also the comfort of patient is high, because of no special requirements on him/her.
This paper describes Robotic 3D Scanner as an alternative to Magnetic Resonance Imaging in special cases, where information required for examination is not the whole 3D model of afflicted part of body, but only its surface. In these cases, Robotic 3D Scanner, a device specially developed for these situations, can provide at least the same quality of resulting 3D scan in faster time and with lower expenses. In most cases, the result reaches the higher resolution than MRI and brings higher comfort for patient.
The prototype of Robotic 3D Scanner has been developed, which is fully capable of building 3D scans. In future work, the safety functions will be more developed in order to be sure, that operation of manipulator cannot be harmful for its users and scanned patients at any circumstances. Scanning capability will be also extended with multi-spectral texture mapping, that shows information of colours and temperatures on the surface of 3D model.
Entire research contributes to optimization of public health care operation by avoiding expensive examinations, which could be performed in cheaper and smarter way. This research was performed on behalf of St. Anne’s University Hospital Brno, where application of proposed Robotic 3D Scanner is planned.
All the experiments were perfomed in Compliance with the Helsinki Declaration and persons taking part in it gave their approval to perform the experiment.
This work was supported by junior inter-faculty research FAST/FEKT-J-13-1987 "Matrix optical sensors data fusion" of internal grant system BUT and by the projects CEITEC - Central European Institute of Technology (CZ.1.05/1.1.00/02.0068) and FNUSA ICRC (CZ.1.05/1.1.00/02.0123) from European Regional Development Fund.
- Chen MB: A parallel 3d delaunay triangulation method. In Parallel and Distributed Processing with Applications (ISPA), 2011 IEEE 9th International Symposium On. Czech Republic: Fakultni nemocnice u Sv. Anny v Brne, Brno; 2011:52-56.View ArticleGoogle Scholar
- Chromy A: 3d scanning with proximity planar scanner. PhD thesis, Brno University of Technology, Faculty of Electrical Engineering and Communication, Department of Control and Instrumentation. 2013.Google Scholar
- Compare CAT Scan Cost 2012.http://www.comparecatscancost.com/ . Accessed 2013-11-6
- Compare Ultrasound Cost 2012.http://www.compareultrasoundcost.com/ . Accessed 2013-11-6
- Epson C3 Compact 6-Axis RobotManual 2011.http://robots.epson.com/admin/uploads/product_catalog/files/EPSON_C3_Robot_Manual(R7).pdf . Accessed 2013-10-22
- Grootjans R: XNA 3.0 Game Programming Recipes. New York: Apress; 2009.View ArticleGoogle Scholar
- Herman G, Gabor T: Fundamentals of computerized tomography: image reconstruction from projection. New York: Springer; 2010.Google Scholar
- Instruction Manual scanCONTROL 2008.http://www.micro-epsilon.cz/download/manuals/man--scanCONTROL-2700--en.pdf . Accessed 2013-10-22
- International Vocabulary of Metrology-Basic and General Concepts andAssociated Terms (VIM) 2012.http://www.bipm.org/utils/common/documents/jcgm/JCGM_200_2008.pdf . Accessed 2013-11-05
- Konecny P, et al.: Nove trendy v neurorehabilitaci [abstract]. In Dobsak P (ed) Proceedings of the IV. Dny Fyzioterapie: 11–12 October 2013. Czech Republic: Mikulov, Fakultni nemocnice u Sv. Anny v Brne, Brno; 2013:7-7.Google Scholar
- Lehmann EL, Casella G: Theory of point estimation. New York: Springer; 1998.Google Scholar
- LMS 400 Laser Measurement System Operating Instructions 2006.https://www.mysick.com/saqqara/pdf.aspx?id=im0010698 . Accessed 2013-10-22
- Magnetic Resonance Imaging 2010.http://www.mri-portal.com/clanky/magneticka_rezonance.php . Accessed 2013-11-6
- MCCollough CH, Zink FE: Performance evaluation of a multi-slice ct system. Med Phys 1999, 26: 2223-2230. 10.1118/1.598777View ArticleGoogle Scholar
- Musil D, Herman J, Hofirek I: Ultrazvukove Vysetreni Zil Dolnich Koncetin. Praha: Grada Publishing; 2008.Google Scholar
- Novelline R: Squire’s fundamentals of radiology. Cambridge: Harvard University Press; 1997.Google Scholar
- Palencar R, Vdolecek F, Halaj M: Nejistoty v mereni ii: nejistoty primych mereni. Automa 2001, 10: 55-56.Google Scholar
- Physics of Ultrasound Imaging 2009.http://www.slideshare.net/u.surgery/physics-of-ultrasound-imaging . Accessed 2013-11-6
- Robertson VJ, Baker KG: A review of therapeutic ultrasound: effectiveness studies. Phys Ther 2001, 81: 1339-1350.Google Scholar
- Seidl Z, Vaneckova M: Magneticka Rezonance Hlavy Mozku a Patere. Praha: Grada Publishing; 2007.Google Scholar
- Shan J, Toth C: Topographic laser ranging and scanning: principles and processing. New York: CRC Press; 2008.View ArticleGoogle Scholar
- Singh Z, Jones J: Foundations of medical imaging. New York: Wiley-IEEE Press; 1993.Google Scholar
- Solc F, Zalud L: Robotika. Brno: Brno University of Technology; 2006.Google Scholar
- Statni urad pro jadernou bezpecnost (Czech State Office for Nuclear Safety) Praha: Vyhlaska O Radiacni Ochrane; 2002.Google Scholar
- Udupa JK, Herman GT: 3D imaging in medicine. New York: CRC Press; 2000.Google Scholar
- Webb A: Introduction to biomedical imaging. New York: Wiley-IEEE Press; 2002.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.