面向视觉质量和视觉健康评测的眼动数据分析

来源 :上海交通大学 | 被引量 : 0次 | 上传用户:luoming106
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
The eye is known as the window of the mind,it is the most important information input system in human information processing system.In order to see an object clearly,our eyes must maintain a certain orientation in order to make the object clearly imaged on the retina.Human eye movement can reflect people’s interest,psychological activity and physical state.The development of eye tracker technology allows us to easily obtain human eye movement information.Eye trackers are widely used in human-computer interaction,fatigue assessment,and measurement of psychological and physiological indicators.Based on the eye tracker,this thesis deeply investigates and solves three major problems that people care about: the design and the evaluation of subjective test of image quality assessment,the assessment of eye fatigue when people are watching electronic screens,and the prediction of the effects of amblyopia treatment.First,Subjective quality assessment serves as the foundation for almost all visual quality related researches.The size of the image quality databases has expanded from dozens to thousands in the last decades.Since each subjective rating therein has to be averaged over quite a few participants,the ever-increasing overall size of those databases calls for an evolution of existing subjective test methods.Traditional single/double stimulus based approaches are being replaced by multiple image tests,where several distorted versions of the original one are displayed and rated at once.This naturally brings upon the question of how to arrange those multiple images on screen during the test.In this thesis,I answer this question by performing subjective viewing tests with an eye tracker for different types of arrangements.My research indicates that isometric arrangement imposes less duress on participants and has a more uniform distribution of eye fixations and movements and therefore is expected to generate more reliable subjective ratings.Second,eye fatigue and associated eye disease have become increasingly severe as the digital device progresses in the last decade.If someone knows how fatigued his eyes are,he can relax and protect his eyes timely.In this thesis,I provided this issue into two distinct application scenarios: liquid-crystal display(LCD)users and head-mounted display(HMD)users.For the LCD users,I provided a novel definition of eye fatigue and a personalized real time eye fatigue assessment model.Questionnaire is an inaccurate and inconvenient way to assess eye fatigue.I proposed an objective assessment in real time.Many previous studies define eye fatigue by only one optometry characteristic.In this research,eye fatigue is defined by seven characteristics.The assessment model is based on an unobtrusive eye tracker.Previous eye-tracking-based methods can judge eye fatigue but can not give a fatigue level.While in this thesis,I selected3 eye movement characteristics based on which different performance of assessment operators are investigated.The proposed eye fatigue assessment model provides a computational measure with results that are well correlated to true eye fatigue values.In addition to the LCD,HMDs and virtual reality(VR)have been frequently used in recent years,and user’s experience and computation efficiency could be assessed by mounting eye trackers.However,in addition to visually-induced motion sickness(VIMS),eye fatigue has increasingly emerged during and after the viewing experience,highlighting the necessity of quantitative assessment of the detrimental effects.In this thesis,I showed the differences between VIMS and eye fatigue,and presented a new scheme to assess eye fatigue of HMDs users by analysis of parameters of the eye tracker.As no measurement method for eye fatigue has been widely accepted.I detected parameters related to optometry test.I proposed a novel computational approach for estimation of eye fatigue by providing various verifiable models.I also implemented three classifications and two regressions to investigate different feature sets,which led to present two valid assessment models for eye fatigue by employing blinking features and eye movement features with the ground truth of indicators for optometry test.As a result,three graded results and one continuous result were provided,respectively by each model,which caused the whole result to be repeatable and comparable.Finally,I proposed an algorithm to predict the treatment effect of the children with amblyopia.Gazing following training is a widely used adjuvant therapy for amblyopia.Researchers found that the therapeutic effect of amblyopia was closely related to the patient’s compliance.I propose an objective algorithm to quantify the performance of the children with amblyopia in the gaze following training.In addition,I propose to predict the patients’ treatment effect according to their performance at the first time training.We recruited 30 children with anisometropic amblyopia and 30 healthy children.Every participant was asked to complete a 2-minute gaze following training in front of a monitor.They needed to follow the red dot moving on the screen.A high-speed eye tracker recorded their gaze locations in the whole process.I extracted 20 eye movement features which might suggest the performance of gaze following.I accumulated each feature in 2 minutes.We compared the difference of each feature between the children with and without anisometropic amblyopia using significance test.Then,we accumulated each feature in 20 seconds and supervised individual’s variation trend of the performance.We compared the corrected visions of the subjects at the beginning and three months later.Among the 20 eye movement features,only 6 features did not show a significant difference between the amblyopia group and the control group.The other 14 features are sensitive to the children with anisometropic amblyopia.Based on the 14 eye movement features,I found that the gaze following performance of some subjects varied greatly throughout the training process.Four features can be the indicators to distinct whether the child could get his/her corrected vision improved or not after treatment.In summary,this thesis based on eye trackers can mainly be separated into three parts: the measurement of human eye workload for subjective image quality assessment,the eye fatigue assessment caused by LCD and HMD,and the prediction of amblyopia treatment.
其他文献
目的:通过CT测量和Mimics软件分析来研究球后颗粒脂肪注射对于创伤后的眼球内陷畸形的改善作用及临床意义,探寻球后颗粒脂肪注射的合理路径和注射部位以及定量方法。方法:动物实验中选择体重为3kg的正常新西兰大白兔12只,每只新西兰白兔的右侧眼窝作为实验组,左侧眼窝作为对照组,先通过对右侧眼窝进行眼窝凹陷的造模,待模型成熟后从大白兔的右侧腹股沟皮下取得脂肪,制得脂肪颗粒,再通过眼眶下壁分离眼眶内组织
研究目的急性髓性白血病(Acute myeloid leukaemia,AML)是一组发生在造血干细胞(hematopoietic stem and progenitor cell,HPCs)水平的血液系统恶性疾病,具有染色体易位和体细胞突变的特征。通过研究AML常见的基因突变谱(重点关注细胞遗传学中等风险组FLT3-ITD、NPM1及DNMT3A突变),初步探讨单独或协同基因突变对AML发病的临
第一部分新生大鼠耳蜗K?lliker器支持细胞的原代培养目的:本部分研究旨在建立K?lliker器支持细胞体外原代培养体系,探讨其在离体培养培养条件下的生物学特性,生长模式。方法:取出生1到3天的SD大鼠耳蜗,在高倍显微镜下通过机械分离和酶消化相结合的办法分离出纯K?lliker器,进行体外组织培养,并对分离的K?lliker器支持细胞通过免疫组化和RT-PCR扩增的办法进行鉴定。结果:免疫组化染
随着海洋油气资源开采从大陆架走向深海,深海立柱式平台受到越来越多的重视。深海立柱式平台在工程应用中面临的重要问题之一就是涡激运动。涡激运动是一个复杂的物理问题。首先,涡激运动出现在高雷诺数流动下,且涉及到包含大分离的湍流流动,带有强烈的非定常特性;其次,立柱式平台的外观型式复杂多变,包括Spar、张力腿、半潜式平台等多种形式,部分平台带有螺旋侧板等附体;第三,在实际情况下,立柱式平台虽然有系泊系统
第一部分微创袖型切除手术对比开胸袖型切除手术的匹配性分析目的本研究的主要目的是通过比较微创外科手术和开胸手术在支气管袖型切除中的围手术期结果和肿瘤学效果,证明胸腔镜手术的安全性、可行性和有效性。方法回顾性研究2013年1月至2017年12月我院连续收治的557名确诊为中心型肺癌、拟行微创外科手术或开胸袖型切除手术的患者的临床资料。我们排除了55例中叶袖型切除和中下叶袖型切除的病例,进行了倾向性评分
背景/目的:线粒体谷胱甘肽(mitochondrial glutathione,mGSH)作为一种细胞抗氧化剂,对人视网膜色素上皮(human retinal pigment epithelium,hRPE)细胞的功能具有重要保护作用。虽然,目前对mGSH的转运机制尚未完全了解,但以往的研究表明,位于线粒体内膜的2-氧戊二酸酯(OGC;SLC25A11)和二羧酸盐(DIC;SLC25A10)作为m
研究目的:前瞻性地研究腭裂修补术后分泌性中耳炎的转归情况,尝试找出影响分泌性中耳炎预后可能的因素,找到腭裂合并分泌性中耳炎较为合理的临床诊疗方案。并且,使咽鼓管功能声测法从理论依据到应用层面得到改良,并初步应用到儿童分泌性中耳炎诊断中。方法:第一,本研究入选了30例年龄在10月至2周岁之间的不完全性腭裂患儿,并在腭裂修补术后进行了至少6个月的随访。所有入选的患儿均在手术前一天完成了声导抗测听、畸变
目的:口腔扁平苔藓(oral lichen planus,OLP)是最常见的口腔黏膜慢性炎症性病,病因不清,普遍被认为是一种潜在的癌前病变状态。最近有研究显示,凋亡异常在OLP疾病的发病机制中发挥重要作用。本研究采用二代测序技术(又称高通量测序),检测OLP和正常口腔黏膜组织各2例中miRNA和mRNA的表达谱,进而从中找到具有显著差异的候选miRNA和基因,以便更好阐释OLP病损的发生发展中病生
第一部分血清Dickkopf-1水平在非小细胞肺癌的早期诊断价值以及与非小细胞肺癌临床病理特征的关系目的:通过检测血清Dickkopf-1(DKK-1)在I-IIIa期非小细胞癌(non-small cell lung cancer,NSCLC)患者和肺部良性小结节患者的表达水平,分析血清DKK-1水平与NSCLC临床病理特征的关系,探讨其在NSCLC早期诊断的价值。方法:收集418例手术完全切除
目的:检测口腔扁平苔藓(OLP)患者颊黏膜表面菌群变化,研究具核梭杆菌对角质形成细胞TLR4/NF-κB通路的影响。方法:(1)收集健康对照与OLP患者颊黏膜样本,高通量技术检测细菌16S rRNA基因,筛选出对照组与OLP组之间颊黏膜表面差异最明显的菌属。(2)real-time PCR技术验证16S测序结果。其次,收集OLP患者损害与非损害黏膜样本,检测16S测序筛选出的细菌表达水平。最后,收