{"id":135,"date":"2015-12-16T22:39:47","date_gmt":"2015-12-16T22:39:47","guid":{"rendered":"https:\/\/live-optics-wp.pantheonsite.io\/3dvis\/?page_id=135"},"modified":"2015-12-16T22:39:47","modified_gmt":"2015-12-16T22:39:47","slug":"robust-eye-tracking-methods","status":"publish","type":"page","link":"https:\/\/wp.optics.arizona.edu\/3dvis\/research\/robust-eye-tracking-methods\/","title":{"rendered":"Robust Eye Tracking Methods"},"content":{"rendered":"<p>This project aims at the development of robust and accurate 2D\/3D eye tracking methods. We are particularly interested in eye tracking solutions that are suitable for the integration with head-mounted displays. We have been developing feature-based eye tracking methods, using multiple near IR LEDs to improve the robustness of eye illumination, the accuracy of pupil\/cornea tracking, the range of eye movements tracking, as well as the simplification of tracking algorithm for speed concerns. We are also developing 3D tracking methods to obtain point of gaze information. This project has been funded by a three-year NSF HCI grant.<\/p>\n<p>This project aims at the development of robust and accurate 2D\/3D eye tracking methods. We are particularly interested in eye tracking solutions that are suitable for the integration with head-mounted displays. We have been developing feature-based eye tracking methods, using multiple near IR- LEDs to improve the robustness of eye illumination, the accuracy of pupil\/cornea tracking, the range of eye movements tracking, as well as the simplification of tracking algorithm for speed concerns. We are also developing 3D tracking methods to obtain point of gaze information. More details are reported in Prasanna&#8217;s MS thesis.<\/p>\n<h4>Recovered Eyelid<\/h4>\n\n\t\t<style type=\"text\/css\">\n\t\t\t#gallery-1 {\n\t\t\t\tmargin: auto;\n\t\t\t}\n\t\t\t#gallery-1 .gallery-item {\n\t\t\t\tfloat: left;\n\t\t\t\tmargin-top: 10px;\n\t\t\t\ttext-align: center;\n\t\t\t\twidth: 50%;\n\t\t\t}\n\t\t\t#gallery-1 img {\n\t\t\t\tborder: 2px solid #cfcfcf;\n\t\t\t}\n\t\t\t#gallery-1 .gallery-caption {\n\t\t\t\tmargin-left: 0;\n\t\t\t}\n\t\t\t\/* see gallery_shortcode() in wp-includes\/media.php *\/\n\t\t<\/style>\n\t\t<div id='gallery-1' class='gallery galleryid-135 gallery-columns-2 gallery-size-medium'><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"203\" src=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_3-300x203.jpg\" class=\"attachment-medium size-medium\" alt=\"\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_3-300x203.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_3.jpg 478w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n\t\t\t<\/dt><\/dl><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"221\" src=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/Single_LED_HalfCircle-300x221.jpg\" class=\"attachment-medium size-medium\" alt=\"\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/Single_LED_HalfCircle-300x221.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/Single_LED_HalfCircle.jpg 483w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n\t\t\t<\/dt><\/dl><br style=\"clear: both\" \/>\n\t\t<\/div>\n\n<h4>Eyelash<\/h4>\n\n\t\t<style type=\"text\/css\">\n\t\t\t#gallery-2 {\n\t\t\t\tmargin: auto;\n\t\t\t}\n\t\t\t#gallery-2 .gallery-item {\n\t\t\t\tfloat: left;\n\t\t\t\tmargin-top: 10px;\n\t\t\t\ttext-align: center;\n\t\t\t\twidth: 50%;\n\t\t\t}\n\t\t\t#gallery-2 img {\n\t\t\t\tborder: 2px solid #cfcfcf;\n\t\t\t}\n\t\t\t#gallery-2 .gallery-caption {\n\t\t\t\tmargin-left: 0;\n\t\t\t}\n\t\t\t\/* see gallery_shortcode() in wp-includes\/media.php *\/\n\t\t<\/style>\n\t\t<div id='gallery-2' class='gallery galleryid-135 gallery-columns-2 gallery-size-medium'><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"174\" src=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_2-300x174.jpg\" class=\"attachment-medium size-medium\" alt=\"\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_2-300x174.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_2.jpg 537w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n\t\t\t<\/dt><\/dl><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"179\" src=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_1-300x179.jpg\" class=\"attachment-medium size-medium\" alt=\"\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_1-300x179.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/4LEDs_HC_1.jpg 556w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n\t\t\t<\/dt><\/dl><br style=\"clear: both\" \/>\n\t\t<\/div>\n\n<p>Extended Tracking Range<\/p>\n\n\t\t<style type=\"text\/css\">\n\t\t\t#gallery-3 {\n\t\t\t\tmargin: auto;\n\t\t\t}\n\t\t\t#gallery-3 .gallery-item {\n\t\t\t\tfloat: left;\n\t\t\t\tmargin-top: 10px;\n\t\t\t\ttext-align: center;\n\t\t\t\twidth: 33%;\n\t\t\t}\n\t\t\t#gallery-3 img {\n\t\t\t\tborder: 2px solid #cfcfcf;\n\t\t\t}\n\t\t\t#gallery-3 .gallery-caption {\n\t\t\t\tmargin-left: 0;\n\t\t\t}\n\t\t\t\/* see gallery_shortcode() in wp-includes\/media.php *\/\n\t\t<\/style>\n\t\t<div id='gallery-3' class='gallery galleryid-135 gallery-columns-3 gallery-size-medium'><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"171\" src=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_left-300x171.jpg\" class=\"attachment-medium size-medium\" alt=\"\" aria-describedby=\"gallery-3-140\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_left-300x171.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_left.jpg 478w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n\t\t\t<\/dt>\n\t\t\t\t<dd class='wp-caption-text gallery-caption' id='gallery-3-140'>\n\t\t\t\tLeft\n\t\t\t\t<\/dd><\/dl><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"183\" src=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_upLeft-300x183.jpg\" class=\"attachment-medium size-medium\" alt=\"\" aria-describedby=\"gallery-3-142\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_upLeft-300x183.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_upLeft.jpg 437w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n\t\t\t<\/dt>\n\t\t\t\t<dd class='wp-caption-text gallery-caption' id='gallery-3-142'>\n\t\t\t\tUp-Left\n\t\t\t\t<\/dd><\/dl><dl class='gallery-item'>\n\t\t\t<dt class='gallery-icon landscape'>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"240\" src=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_Right-300x240.jpg\" class=\"attachment-medium size-medium\" alt=\"\" aria-describedby=\"gallery-3-141\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_Right-300x240.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/TRange_Right.jpg 432w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>\n\t\t\t<\/dt>\n\t\t\t\t<dd class='wp-caption-text gallery-caption' id='gallery-3-141'>\n\t\t\t\tRight\n\t\t\t\t<\/dd><\/dl><br style=\"clear: both\" \/>\n\t\t<\/div>\n\n<h2>Eye tracking algorithm<\/h2>\n<p>This project aim to build a real-time system for robust gaze direction estimation and tracking. Efforts are on to develop a pupil\/corneal reflection based tracking method exploiting the optical properties of the human eye. We are working on computer vision techniques to extract features from eye images and track them in a video sequence. To this end, we have developed a real-time connected components labeling algorithm as a quick way to initialize pupil detection by zeroing in on the region of interest. We are currently experimenting with robust ellipse fitting techniques for pupil boundary detection and particle filters for subsequent tracking of the boundary through a video sequence.<\/p>\n<p>The following shows a sample pupil boundary detection result.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-143 size-full\" src=\"http:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_detection.jpg\" alt=\"pupil_detection\" width=\"909\" height=\"399\" data-id=\"143\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_detection.jpg 909w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_detection-300x132.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_detection-768x337.jpg 768w\" sizes=\"auto, (max-width: 909px) 100vw, 909px\" \/><\/p>\n<p>The following is a sample sequence of tracked pupil boundaries through the frames of a video.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-144\" src=\"http:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_tracking.jpg\" alt=\"pupil_tracking\" width=\"990\" height=\"657\" data-id=\"144\" srcset=\"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_tracking.jpg 990w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_tracking-300x199.jpg 300w, https:\/\/wp.optics.arizona.edu\/3dvis\/wp-content\/uploads\/sites\/26\/2015\/12\/pupil_tracking-768x510.jpg 768w\" sizes=\"auto, (max-width: 990px) 100vw, 990px\" \/><\/p>\n<h3>Reference<\/h3>\n<ol>\n<li>Hong Hua, C. Pansing, and J. P. Rolland, \u201cModeling of an eye-imaging system for optimizing illumination schemes in an eye-tracked head-mounted display,\u201d Applied Optics, 46(32): 1-14, November 2007.<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>This project aims at the development of robust and accurate 2D\/3D eye tracking methods. We are particularly interested in eye tracking solutions that are suitable for the integration with head-mounted displays. We have been developing feature-based eye tracking methods, using multiple near IR LEDs to improve the robustness of eye illumination, the accuracy of pupil\/cornea tracking, the range of eye<\/p>\n","protected":false},"author":3,"featured_media":0,"parent":29,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-135","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/pages\/135","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/comments?post=135"}],"version-history":[{"count":1,"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/pages\/135\/revisions"}],"predecessor-version":[{"id":145,"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/pages\/135\/revisions\/145"}],"up":[{"embeddable":true,"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/pages\/29"}],"wp:attachment":[{"href":"https:\/\/wp.optics.arizona.edu\/3dvis\/wp-json\/wp\/v2\/media?parent=135"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}