Quality assessment in competition-based software crowdsourcing

来源 :计算机科学前沿 | 被引量 : 0次 | 上传用户:qingdao2046
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Quality assessment is a critical component in crowdsourcing-based software engineering(CBSE)as soft-ware products are developed by the crowd with unknown or varied skills and motivations.In this paper,we propose a novel metric called the project score to measure the perfor-mance of projects and the quality of products for competition-based software crowdsourcing development(CBSCD)activ-ities.To the best of our knowledge,this is the first work to deal with the quality issue of CBSE in the perspective of projects instead of contests.In particular,we develop a hi-erarchical quality evaluation framework for CBSCD projects and come up with two metric aggregation models for project scores.The first model is a modified squale model that can locate the software modules of poor quality,and the second one is a clustering-based aggregation model,which takes dif-ferent impacts of phases into account.To test the effective-ness of the proposed metrics,we conduct an empirical study on TopCoder,which is a famous CBSCD platform.Results show that the proposed project score is a strong indicator of the performance and product quality of CBSCD projects.We also find that the clustering-based aggregation model outper-forms the Squale one by increasing the percentage of the per-formance evaluation criterion of aggregation models by an additional 29%.Our approach to quality assessment for CB-SCD projects could potentially facilitate software managers to assess the overall quality of a crowdsourced project con-sisting of programming contests.
其他文献
  本文介绍了目前化妆品中常用化学防腐剂,并简介了它们的一般作用机制和影响防腐剂性能的因素,并对最常用的化学防腐剂和新型防腐剂进行了重点介绍。
“小丫”摇身变“专家”    张曦文,高挑的个头,白皙的皮肤,看上去有些憔悴,如果穿行在京城繁华大街,看不出她是一位高级工程师,更难想象她是某新型地空导弹指挥控制系统的主管军代表。当笔者看到由她作为第一研制人完成的《地空导弹武器系统战术单位作战训练模型》等两个军队重点科研项目后,为眼前这位年轻漂亮的女军代表所折服。  6年前,张曦文揣着一纸空军通信专业的硕士文凭,来到航天科工集团第二研究院中心代表
  用23种密度泛函方法在相对论有效势基组水平上对NpO22+的几何结构、电子结构和振动光谱进行计算研究,并与NpO2+的数据和文献比较,数据分析显示:(1)BLYP、G96LYP、BHandH和
会议
  目的:研究变绿红菇抗氧化活性;方法:采用DPPH自由基清除法对野生食用菌变绿红菇提取物的体外自由基清除作用进行研究.结论:研究发现,变绿红菇的乙酸乙酯和正丁醇提取物活性较
孔祥熙是国民政府财政部长,他无才无能,却偏爱讲笑话。马寅初很看不起他,见面时总要讽刺他几句。孔祥熙过50岁大寿,给马寅初发了请柬。马赴宴时,提了三斤挂面两斤肉。 Kong
Overlapping community detection has become a very hot research topic in recent decades,and a plethora of methods have been proposed.But,a common challenge in ma
  目的:提取并测定两不同产地蒙药云香十五味丸中的总黄酮含量.方法:以甲醇为提取溶剂,采用索氏提取器提取样品中的总黄酮,以芦丁为对照品,采用分光光度法测定其含量.结果:回
会议
Cloud computing provides the capability to con-nect resource-constrained clients with a centralized and shared pool of resources,such as computational power and
  目的:蒙药材胡芦巴中鞣质的含量测定.方法:采用紫外分光光度比色法测定了总鞣质含量,以没食子酸为对照品制备标准曲线,采用磷钼钨酸法显色,在760 nm波长处测定吸收度.结果:
  目的:快速测定阿米卡星的含量.方法:采用可见分光光度法.结果:阿米卡星与茚三酮在pH为6.5的水溶液中,沸水浴75min可以反应完全,测定波长为402nm,表观摩尔吸光系数为1.16×10