Team:ETHZ Basel/InformationProcessing/Visualization

From 2010.igem.org

(Difference between revisions)
(Background)
(Background)
Line 8: Line 8:
<div class="thumbcaption"><div class="magnify"><a href="http://www.youtube.com/watch?v=hwtOBgQCAAA&hd=1" class="external" title="Enlarge"><img src="/wiki/skins/common/images/magnify-clip.png" width="15" height="11" alt="" /></a></div>The video shows the <b>real-time representation of the current microscope image</b> together with information on all detected cells, the selected cell and its swimming direction, and others. For a description of the single elements in the video, we refer to the text..</div></div></div></html>
<div class="thumbcaption"><div class="magnify"><a href="http://www.youtube.com/watch?v=hwtOBgQCAAA&hd=1" class="external" title="Enlarge"><img src="/wiki/skins/common/images/magnify-clip.png" width="15" height="11" alt="" /></a></div>The video shows the <b>real-time representation of the current microscope image</b> together with information on all detected cells, the selected cell and its swimming direction, and others. For a description of the single elements in the video, we refer to the text..</div></div></div></html>
-
To control the E. lemming, the scientist has to be aware of a huge amount of information, which has to be visualized to him in real-time. Only with this information he or she is able to choose an E. coli cell to control, decide on a reference direction, and interfere in the experiments. This information include
+
To control E. lemming, the scientist has to be aware of a huge amount of information, which has to be visualized in real-time. Only with this information, the user is able to choose an E. lemming to control, decide on a reference direction, and interfere in the experiments. This information includes
-
* the current microscopy image
+
* the current microscopy image,
-
* all detected, not detected and falsely detected cells
+
* all detected, not detected and falsely detected cells,
-
* the selected cell itself
+
* the selected cell itself,
-
* its swimming direction
+
* its swimming direction,
-
* the reference direction
+
* the reference directio ,
-
* its path
+
* its path,
-
* movements of the stage.
+
* and movements of the stage.
Since this information has to be absorbed by the experimentalist at a rate higher than three frames per second, a textual representation is not adequate. We thus decided to represent the information in an intuitive way by incorporating it into the microscope images.
Since this information has to be absorbed by the experimentalist at a rate higher than three frames per second, a textual representation is not adequate. We thus decided to represent the information in an intuitive way by incorporating it into the microscope images.
-
<br>
+
 
-
To enable the scientist to interfere with the experiment without having to interrupt it, thus possibly loosing the currently controlled cell, we established two input devices: The user can either control the experiment and the E. lemming using the keyboard or the joystick. With both devices they can:
+
 
-
* select a cell to control
+
To enable the scientist to interfere with the experiment without having to interrupt, and thus possibly losing the currently controlled cell, we established two input devices: The user can either control the experiment and E. lemming using the keyboard or the joystick. With both devices they can
-
* activate or deactivate the controller
+
* select a cell to control,
-
* set the reference direction
+
* activate or deactivate the controller,
-
* increase or decrease the threshold for cell detection (see [https://2010.igem.org/Team:ETHZ_Basel/InformationProcessing/CellDetection Cell Detection])
+
* set the reference direction,
-
* alternatively, manually induce red or far-red light pulses of various length (instead of using the controllers provided in the toolbox).  
+
* increase or decrease the threshold for [https://2010.igem.org/Team:ETHZ_Basel/InformationProcessing/CellDetection cell detection],
 +
* or alternatively, manually induce red or far-red light pulses of various length (instead of using the controllers provided in the toolbox).  
If using a force-feedback joystick, the current swimming direction is furthermore given as a small force on the direction of the joystick, thus intuitively increasing the amount of information available for the user.
If using a force-feedback joystick, the current swimming direction is furthermore given as a small force on the direction of the joystick, thus intuitively increasing the amount of information available for the user.
-
Both, the visual representation of the current state of the experiment as well as the user input had to be designed to require low computational efforts to not unnecessarily slow down the imaging.
+
Both, the visual representation of the current state of the experiment as well as the user input had to be designed to require low computational efforts not to unnecessarily slow down the imaging.
== User Experience ==
== User Experience ==

Revision as of 19:57, 26 October 2010

Visualization and Man-Machine Interface

Background

The video shows the real-time representation of the current microscope image together with information on all detected cells, the selected cell and its swimming direction, and others. For a description of the single elements in the video, we refer to the text..

To control E. lemming, the scientist has to be aware of a huge amount of information, which has to be visualized in real-time. Only with this information, the user is able to choose an E. lemming to control, decide on a reference direction, and interfere in the experiments. This information includes

  • the current microscopy image,
  • all detected, not detected and falsely detected cells,
  • the selected cell itself,
  • its swimming direction,
  • the reference directio ,
  • its path,
  • and movements of the stage.

Since this information has to be absorbed by the experimentalist at a rate higher than three frames per second, a textual representation is not adequate. We thus decided to represent the information in an intuitive way by incorporating it into the microscope images.


To enable the scientist to interfere with the experiment without having to interrupt, and thus possibly losing the currently controlled cell, we established two input devices: The user can either control the experiment and E. lemming using the keyboard or the joystick. With both devices they can

  • select a cell to control,
  • activate or deactivate the controller,
  • set the reference direction,
  • increase or decrease the threshold for cell detection,
  • or alternatively, manually induce red or far-red light pulses of various length (instead of using the controllers provided in the toolbox).

If using a force-feedback joystick, the current swimming direction is furthermore given as a small force on the direction of the joystick, thus intuitively increasing the amount of information available for the user.

Both, the visual representation of the current state of the experiment as well as the user input had to be designed to require low computational efforts not to unnecessarily slow down the imaging.

User Experience

Example Image of the Visualization
The images of the microscope are visualized live at a personal computer which is connected to the microscope over a local network or the internet, thus it is possible to control the E. lemming from another office or city.

Visual Enhancements

All detected cells in the microscope image are highlighted by letting them glow blue (see example picture). The user can select a cell to control with the joystick or the keyboard, which is then glowing yellow instead of blue. The current swimming direction is indicated by a transparent yellow light cone, imitating the floodlight of cars or a flashlight, and the reference direction is depicted as a transparent red line. The path the cell has passed during the experiment is marked by small yellow dots, similar to footprints in snow. Finally, the automatic movement of the stage of the microscope when following a cell which swims out of the current field of view is indicated by arrows in the direction of movement, which are shortly popping up.