删除或更新信息,请邮件至freekaoyan#163.com(#换成@)

Towards a Service-Oriented Architecture for a Mobile Assistive System with Real-time Environmental S

清华大学 辅仁网/2017-07-07

Towards a Service-Oriented Architecture for a Mobile Assistive System with Real-time Environmental Sensing
Darpan Triboan,Liming Chen,Feng Chen,Zumin Wang*
Darpan Triboan, Liming Chen, and Feng Chen are with the Context, Intelligence, and Interaction Research Group (CIIRG), De Montfort University, Leicester, LE1 9BH, UK. E-mail: darpan.triboan@my365; liming.chen@dmu.ac.uk, fengchen@dmu.ac.uk.
Zumin Wang is with the Department of Information Engineering, Dalian University, Dalian 116622, China.

摘要:

Export: BibTeX | EndNote | Reference Manager | ProCite |RefWorks
AbstractWith the growing aging population, age-related diseases have increased considerably over the years. In response to these, Ambient Assistive Living (AAL) systems are being developed and are continually evolving to enrich and support independent living. While most researchers investigate robust Activity Recognition (AR) techniques, this paper focuses on some of the architectural challenges of the AAL systems. This work proposes a system architecture that fuses varying software design patterns and integrates readily available hardware devices to create Wireless Sensor Networks (WSNs) for real-time applications. The system architecture brings together the Service-Oriented Architecture (SOA), semantic web technologies, and other methods to address some of the shortcomings of the preceding system implementations using off-the-shelf and open source components. In order to validate the proposed architecture, a prototype is developed and tested positively to recognize basic user activities in real time. The system provides a base that can be further extended in many areas of AAL systems, including composite AR.

KeywordsActivities of Daily Living (ADL)Service-Oriented Architecture (SOA)semantic webontology modelingWeb Ontology Language (OWL)Activity Recognition (AR)Smart Homes (SH)Wireless Sensor Networks (WSNs)
Corresponding Authors:Zumin Wang
Issue Date: 13 December 2016
Cite this article:
Darpan Triboan,Liming Chen,Feng Chen, et al. Towards a Service-Oriented Architecture for a Mobile Assistive System with Real-time Environmental Sensing[J]. Tsinghua Science and Technology, 2016, 21(6): 581-597.
URL:
http://tst.tsinghuajournals.com/EN/10.1109/TST.2016.7787002OR http://tst.tsinghuajournals.com/EN/Y2016/V21/I6/581


Fig. 1System architecture overview: Initial implementation of the SMART system (2009).
Fig. 2System architecture overview: Service-oriented implementation of the SMART system (2012).
System detailsSystem version
SMARTProposed
(2009)(2012)(2016)
PurposeActivity recognition using Smart HomesReengineered based on the initial versionReengineered with SOA implementation.
Implementation typeStandalone web applicationSOA; SOAP-based; browser-based interfaceSOA; REST-based; SSE and mobile application
Language (s)C#, ASP.NET, dotNet/GWT basedJava, AJAX, JavaScript, HTML/CSS, SQLJava and SRARQL
Main dependenciesSemantic Web (SemWeb), AJAX, Silverlight, Euler, and PelletPELLET (reasoning tool), Apache Jena, Mule ESB, Glassfish, JAX-WS, H2 RDBMS, AJAXApache Jena, Fuseki Server, JAX-RS 1.1, Jersey 2, Jersey SSE, XBee Java lib, Tyrus Web sockets, Apache Tomcat Server and Android Studio.
InterfaceBrowser-basedBrowser-basedMobile-based (Android application)
PortabilitySingle computerOne-to-manyOne-to-many
LicensingProprietaryOpen-sourceOpen-source


Table 1Comparison between predecessors and the proposed system.
Fig. 3The proposed mobile SMART system using SOA and semantic web technologies.
Fig. 4Software: Breakdown of the “Sensor Utils” package.
Fig. 5Hardware: Connectivity diagram of sensing devices.
Fig. 6SSE mechanism for real-time message flow of sensing and inferencing results between client and web service.
Fig. 7Pseudocode for executing a SPARQL query on the server endpoint using Jena API.
Fig. 8Layered object properties for bucket-based structure data.
Fig. 9Bucket-based approach for data structuring using object properties.
Fig. 10Managing user preferences and ADL simulation mode interface.
Fig. 11ADL simulation result of two possible preferences with their missing sensors to complete the activity.
Fig. 12User preference management interface in action.
Fig. 13Illustrating the inferencing steps taken using SPARQL query language.
Fig. 14Patient’s main menu and UI of managing medicines doses.
Activity number (#)UAPSensor objects sequenceTotal number of sensors
1MakeIndian TeaKitchenDoor1, KitchenCupboard1, TeaBagJar, IndianTeaSpiceJar, SugarJar, Kettle1, KitchenWaterTap1, Fridge1, MilkBottle1,11
2MakeCappuccino CoffeeKitchenDoor1, KitchenCupboard1, CappuccinoBagJar, SugarJar, Kettle1, KitchenWaterTap1, Fridge1, MilkBottle1, EatingSpoon1, Mug110
3MakeStawberry JuiceKitchenDoor1, KitchenCupboard1, JuicerMixerCup1, SugarJar, KitchenCupboard2, ChoppingBoard1, Knife1, Fridge1, StawberryPacket1, MilkBottle1, KitchenWaterTap1, GlassCup1, JuicerMixer1,13
4MakingChips AndBeansKitchenDoor1, FridgeFreezer1, ChipsBag1, KitehenCupboard2, OvenTray1, HeinzBakedBeansCan1, KitchenWaterTap1, MicrowaveBowl1, OvenDoor1, MicrowaveDoor1, CeramicPlate111
5MakePastaKitchenDoor1, KitchenCupboard1, PastaBag1, PastaPot1, KitchenWaterTap1, WoodCookingSpoon, PastaSauce, SaltBottle18
6TakingMedicineKitchenCupboard1, MedicineContainer1, GlassContainer1, KitchenWaterTar14


Table 2User activity preferences with the associated total number of sensor objects.
Scenario typesExact no. of sensorsExtra sensors activationFaulty/missing
TP1××
TP2××
TP3××


Table 3AR test scenario types.
Activity number (#)Examples of tests specifications
1TP1: #1,
TP2: #1, add KitchenCupboard2 and GlasCup1.
TP3: #1, swap TeaBagJar and OvenDoor1.
2TP1: #2,
TP2: #2, add KitchenCupboard2 and GlasCup1.
TP3: #2, replace Mug1 with GlassCup1.


Table 4Two examples of AR test cases.
Activity number (#)Test typeExp1 (ms)Exp2 (ms)Exp2 (ms)Avg. (ms)Avg. per activity number (ms)
 TP13890398851274335.00 
1TP25175417648024717.674472.33
 TP34172414547764364.33 
 TP14013395344394135.00 
2TP24131413547254330.334287.67
 TP34275428846304397.67 
 TP13926392343534067.33 
3TP24303431645714396.674410.56
 TP35310422547684767.67 
 TP14116417544524247.67 
4TP26330447446955166.334636.33
 TP34410446146144495.00 
 TP14150426544094274.67 
5TP24446441459194926.334584.11
 TP34497453346244551.33 
 TP14166480142714412.67 
6TP24532455645634550.334473.56
 TP34415446044984457.67 
      4477.43


Table 5Results showing average activity inferencing duration from the last activities recorded.

[1] Zhang X., Wang H., and Yu Z., Toward a smart home environment for elder people based on situation analysis, in 2010 7th International Conference on Ubiquitous Intelligence & Computing and 7th International Conference on Autonomic & Trusted Computing, 2010, pp. 7-12.
[2] Sterritt R. and Nugent C., Autonomic computing and ambient assisted living - extended abstract, in Engineering of Autonomic and Autonomous Systems (EASe), 2010 Seventh IEEE International Conference and Workshops on, 2010, pp. 149-151.
[3] Triboan D., Chen L., and Chen F., Towards a mobile assistive system using service-oriented architecture, in 2016 IEEE Symposium on Service-Oriented System Engineering Towards, 2016, pp. 187-196.
[4] Bohme G., Invasive Technification: Critical Essays in the Philosophy of Technology. Bloomsbury Publishing, 2012.
[5] Pavlic L., Hericko M., and Podgorelec V., Improving design pattern adoption with ontology-based design pattern repository, in Information Technology Interfaces, 2008. ITI 2008. 30th International Conference on, 2008, pp. 649-654.
[6] Ali M. and Elish M. O., A comparative literature survey of design patterns impact on software quality, in Information Science and Applications (ICISA), 2013 International Conference on, 2013, pp. 1-7.
[7] Zhang C., Budgen D., and Drummond S., Using a follow-on survey to investigate why use of the visitor, singleton & facade patterns is controversial, in Proceedings of the ACM—IEEE International Symposium on Empirical Software Engineering and Measurement—ESEM’12, 2012, pp. 79-88.
[8] Chen L., Hoey J., Nugent C. D., Cook J. D., and Yu Z., Sensor-based activity recognition, IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, vol. 42, no. 6, pp. 790-808, 2012.
[9] Ameen A., Khan K. U. R., and Rani B. P., Extracting knowledge from ontology using Jena for semantic web, in 2014 International Conference for Convergence of Technology(I2CT), 2014.
[10] Staab S. and Rudi S., Handbook on Ontologies, 2nd Ed. Springer-Verlag, 2009.
[11] Culmone R., Falcioni M., Giuliodori R., Merelli E., Orru A., Quadrini M., Ciampolini P., Grossi F., and Matrella G., AAL domain ontology for event-based human activity recognition, in Mechatronic and Embedded Systems and Applications (MESA), IEEE/ASME 10th Intl Conf, 2014.
[12] Chen L., Nugent C., and Okeyo G., An ontology-based hybrid approach to activity modeling for smart homes, IEEE Transactions on Human-Machine Systems, vol. 44, no. 1, pp. 92-105, 2014.
[13] Gaaevic D., Djuric D., Devedzic V., and Selic B., Model Driven Architecture and Ontology Development. Springer-Verlag, 2006.
[14] Davies J., Harmelen F., and Fensel D., eds. Towards the Semantic Web: Ontology-driven Knowledge Management. John Wiley & Sons, 2002.
[15] Powers S., Practical RDF. O’Reilly & Associates, 2003.
[16] Apache, An introduction to RDF and the Jena RDF API, , 2016.
[17] W3C, OWL 2 web ontology language document overview, , 2012.
[18] DuCharme B., Learning SPARQL, 2nd Ed. O’Reilly Media, 2013.
[19] Pawgasame W., A survey in adaptive hybrid wireless sensor network for military operations, in 2016 Second Asian Conference on Defence Technology (ACDT), 2016, pp. 78-83.
[20] Hu X., Yang L., and Xiong W., A novel wireless sensor network frame for urban transportation, IEEE Internet of Things Journal, vol. 2, no. 6, pp. 586-595, 2015.
[21] Gaikwad P., Gabhane J. P., and Golait S. S., A survey based on smart homes system using internet-of-things, in 2015 International Conference on Computation of Power, Energy, Information and Communication (ICCPEIC), 2015, pp. 330-335.
[22] Khan I., Belqasmi F., Glitho R., Crespi N., Morrow M., and Polakos P., Wireless sensor network virtualization: A survey, IEEE Communications Surveys & Tutorials, vol. 18, no. 1, pp. 553-576, 2016.
[23] Amazon, Amazon echo, , 2016.
[24] Samsung, SmartThings, , 2016.
[25] IFTTT, Recipes on IFTTT are the easy way to automate your world, , 2016.
[26] Perez M. S. and Carrera E., Time synchronization in Arduino-based wireless sensor networks, IEEE Latin America Transactions, vol. 13, no. 2, pp. 455-461, 2015.
[27] Samsung SmartThings, SmartThings shield for Arduino, , 2016.
[28] Chen L., Nugent C., and Al-Bashrawi A., Semantic data management for situation-aware assistance in ambient assisted living, in Proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services- IIWAS ’09, 2009.
[29] Chen L., Nugent C., and Rafferty J., Ontology-based activity recognition framework and services, in Proceedings of International Conference on Information Integration and Web-based Applications & Services - IIWAS ’13, 2013, pp. 463-469.
[30] Wang X., Wang J., Wang X., and Chen X., Energy and delay tradeoff for application offloading in mobile cloud computing, IEEE Systems Journal, 2015. doi: 10.1109/JSYST.2015.2466617.
[31] Martn D., Lpez de Ipia D., Alzua-Sorzabal A., Lamsfus C., and Torres-Manzanera E., A methodology and a web platform for the collaborative development of context-aware systems, Sensors, vol. 13, no. 5, p. 6032, 2013.
[32] Guo B., Zhang D., and Imai M., Toward a cooperative programming framework for context-aware applications, Personal and Ubiquitous Computing, vol. 15, no. 3, pp. 221-233, 2011.
[33] Borza P. N., Romanca M., and Delgado-Gomes V., Embedding patient remote monitoring and assistive facilities on home multimedia systems, in 2014 International Conference on Optimization of Electrical and Electronic Equipment (OPTIM), 2014, pp. 873-879.
[34] Kistel T., Wendlandt O., and Vandenhouten R., Using distributed feature detection for an assistive work system, in 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2014, pp. 1801-1802.
[35] Paola A. D., Ferraro P., Gaglio S., and Lo Re G., Autonomic behaviors in an ambient intelligence system, in 2014 IEEE Symposium on Computational Intelligence for Human-like Intelligence (IEEE SSCI 2014), 2014.
[36] Reichman A. and Zwiling M., The architecture of ambient assisted living system, in IEEE International Conference on Microwaves, Communications, Antennas and Electronic Systems, 2011.
[37] Khan A. N., Rodrguez D., Danielsson-Ojala R., Pirinen H., Kauhanen L., Salanter S., Majors J., Bjrklund S., Rautanen K., Salakoski T., et al., Smart dosing: A mobile application for tracking the medication tray-filling and dispensation processes in hospital wards, in 6th International Workshop on Intelligent Environments Supporting Healthcare and Well-being (WISHWell’14), 2014.
[38] Sheng Q. Z., Qiao X., Vasilakos A. V., Szabo C., Bourne S., and Xu X., Web services composition: A decade’s overview, Information Sciences, vol. 280, pp. 218-238, 2014.
[39] He G., Wu S., and Yao J., Application of design pattern in the JDBC programming, in the 8th International Conference on Computer Science & Education (ICCSE), 2013, pp. 1037-1040.
[40] Apache Jena Fuseki, , 2016.
[41] Hu X., Chu T., Leung V., Ngai E.C.-H., Kruchten P., and Chan H., A survey on mobile social networks: Applications, platforms, system architectures, and future research directions, IEEE Communications Surveys Tutorials, vol. 17, no. 3, pp. 1557-1581, 2014.
[42] Jersey, RESTful web services in Java, , 2016.
[43] Jersey, Server-Sent Events (SSE) support, , 2016.
[44] Apache, Jena ontology API, , 2016.
[45] Ayad M., Taher M., and Salem A., Real-time mobile cloud computing: A case study in face recognition, in 2014 28th International Conference on Advanced Information Networking and Applications Workshops (WAINA), 2014, pp. 73-78.
[46] Abolfazli S., Sanaei Z., Ahmed E., Gani A., and Buyya R., Cloud-based augmentation for mobile devices: Motivation, taxonomies, and open challenges, IEEE Communications Surveys and Tutorials, vol. 16, no. 1, pp. 337-368, 2014.
[47] Li Z. and Yap K., Context-aware discriminative vocabulary tree learning for mobile landmark recognition, Digital Signal Processing, vol. 24, pp. 124-134, 2014.
[48] Shimmer, Shimmer sensing, , 2015.
[49] Libelium, Waspmote plug & sense, , 2013.
[50] Care Quality Commission, About us, , 2016.
[51] Dentler K., Cornet R., ten Teije A., and de Keizer N., Comparison of reasoners for large ontologies in the OWL 2 EL profile, Semantic Web, vol. 2, no. 2, pp. 71-87, 2011.
[52] Stanford University, A free, open-source ontology editor and framework for building intelligent systems, , 2016.
[53] Google, Products, , 2016.
[54] Faludi R., Building Wireless Sensor Networks, 1st Ed. O’Reilly Media, 2010.
[55] Igoe T., Making Things Talk, 2nd Ed. Maker Media, Inc, 2007.
[56] Meditskos G., Dasiopoulou S., Vasiliki E., and Kompatsiaris I., Sp-act: A hybrid framework for complex activity recognition combining owl and sparql rules, in 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops), 2013, pp. 25-30.
[57] W3C, SPIN — Overview and motivation, , 2011.
[58] Lomotey R. K. and Deters R., Sensor data propagation in mobile hosting networks, in 2015 IEEE Symposium on Service-Oriented System Engineering (SOSE), 2015, pp. 98–106.
[59] Dai W. and Vyatkin V., A component-based design pattern for improving reusability of automation programs, in IECON Proceedings (Industrial Electronics Conference), 2013, pp. 4328-4333.
[60] Xu X., Tao Y., Wang X., and Ding X., Research on architecture of smart home networks and service platform, in 2014 5th International Conference on Digital Home (ICDH), 2014, pp. 232–236.
[61] Chen L., Nugent C. D., and Wang H., A knowledge-driven approach to activity recognition in smart homes, IEEE Transactions on Knowledge and Data Engineering, vol. 24, no. 6, pp. 961-974, 2012.
[62] Amazon Developer, Alexa — Build engaging voice experiences for your services and devices. , 2016.
[63] W3C, SWRL: A semantic web rule language combining OWL and RuleML, , 2004.

[1]Samneet Singh,Yan Liu. A Cloud Service Architecture for Analyzing Big Monitoring Data[J]. Tsinghua Science and Technology, 2016, 21(1): 55-70.
[2]. Efficient Composition of Semantic Web Services with End-to-End QoS Optimization[J]. Tsinghua Science and Technology, 2010, 15(6): 678-686.
[3]. Service-Oriented Enterprise Network Performance Analysis[J]. Tsinghua Science and Technology, 2009, 14(4): 492-503.

相关话题/摘要

  • 领限时大额优惠券,享本站正版考研考试资料!
    大额优惠券
    优惠券领取后72小时内有效,10万种最新考研考试考证类电子打印资料任你选。涵盖全国500余所院校考研专业课、200多种职业资格考试、1100多种经典教材,产品类型包含电子书、题库、全套资料以及视频,无论您是考研复习、考证刷题,还是考前冲刺等,不同类型的产品可满足您学习上的不同需求。 ...
    本站小编 Free壹佰分学习网 2022-09-19
  • 货币金融圆桌会议·2013冬 “三中全会后的人民币国际化新时代”研讨会讨论摘要
    文献详情货币金融圆桌会议·2013冬“三中全会后的人民币国际化新时代”研讨会讨论摘要文献类型:会议作者:赵然[1]赵雪情[2]宋海[3]魏本华[4]邵汉青[5]张建军[6]周小雄[7]南岭[8]向松祚[9]周子友[10]涂永红[11]潘西里[12]江社安[13]陈列江[14]沙石[15]王芳[16] ...
    中国人民大学 辅仁网 2017-07-05
  • IMI·双周论坛 “怎么看美联储货币互换网络”讨论摘要
    文献详情IMI·双周论坛“怎么看美联储货币互换网络”讨论摘要文献类型:会议作者:李婧[1]李建军[2]罗勇[3]涂永红[4]王文[5]夏斌[6]徐以升[7]许元荣[8]张斌[9]张茉楠[10]机构:首都经贸大学经济学院;中国银行国际金融研究所;北京大学中国金融政策研究中心;中国人民大学国际货币研究所 ...
    中国人民大学 辅仁网 2017-07-05
  • 城市与区域形象及旅游营销--淄博城市形象及青年旅游细分市场部分摘要
    文献详情城市与区域形象及旅游营销--淄博城市形象及青年旅游细分市场部分摘要文献类型:会议作者:陈冠[1]高铭泽[2]王金山[3]黄秋莹[4]机构:[1]中国人民大学《城市品牌与营销》专题组[2]中国人民大学《城市品牌与营销》专题组[3]中国人民大学《城市品牌与营销》专题组[4]中国人民大学《城市品牌 ...
    中国人民大学 辅仁网 2017-07-04
  • IPTV中国细分市场类型分析--IPTV市场营销策略研究部分摘要
    文献详情IPTV中国细分市场类型分析--IPTV市场营销策略研究部分摘要文献类型:会议作者:陈冠[1]梁威[2]机构:[1]中国人民大学《电信营销》专题组[2]中国人民大学《电信营销》专题组年:2013会议名称:中国商品学会第十五届学术论坛会议论文集:中国商品学会第十五届学术论坛论文集页码范围:77 ...
    中国人民大学 辅仁网 2017-07-04
  • 城市与区域形象及旅游营销——淄博城市形象及青年旅游细分市场部分摘要
    文献详情城市与区域形象及旅游营销——淄博城市形象及青年旅游细分市场部分摘要文献类型:会议作者:陈冠[1]高铭泽[2]王金山[3]黄秋莹[4]机构:[1]中国人民大学《城市品牌与营销》专题组[2]中国人民大学《城市品牌与营销》专题组[3]中国人民大学《城市品牌与营销》专题组[4]中国人民大学《城市品牌 ...
    中国人民大学 辅仁网 2017-07-04
  • IPTV中国细分市场类型分析——IPTV市场营销策略研究部分摘要
    文献详情IPTV中国细分市场类型分析——IPTV市场营销策略研究部分摘要文献类型:会议作者:陈冠[1]梁威[2]机构:[1]中国人民大学《电信营销》专题组[2]中国人民大学《电信营销》专题组年:2013会议名称:中国商品学会第十五届学术论坛页码范围:6会议地点:中国北京会议开始日期:2013-07- ...
    中国人民大学 辅仁网 2017-07-04
  • 2012年上半年至2013年上半年证据学论文精品摘要
    文献详情2012年上半年至2013年上半年证据学论文精品摘要文献类型:期刊作者:张小敏[1]机构:[1]中国人民大学法学院年:2013期刊名称:证据学论坛期:00页码范围:278-302增刊:不确定所属部门:法学院语言:中文关键词:刑事诉讼法;证据制度;证据调查;非法证据排除;证据学;证明标准;排除 ...
    中国人民大学 辅仁网 2017-07-04
  • 国际货币基金组织(IMF)2013年《世界经济展望报告》发布会 演讲摘要
    文献详情国际货币基金组织(IMF)2013年《世界经济展望报告》发布会演讲摘要文献类型:会议作者:张之骧[1]魏本华[2]向松祚[3]涂永红[4]机构:IMF;IMF研究部;国际货币研究所;中国农业银行;中国人民大学财政金融学院年:2013页码范围:10会议开始日期:2013-12-01所属部门:财 ...
    中国人民大学 辅仁网 2017-07-04
  • 对法律体系与部门法理论的批判(大纲摘要)
    文献详情对法律体系与部门法理论的批判(大纲摘要)文献类型:会议作者:赵晓耕[1]机构:[1]中国人民大学法学院年:2013会议名称:亚欧法律史论坛第二届年会“理念与过程:近代亚洲与欧洲的法律交流”页码范围:15会议地点:中国北京会议开始日期:2013-11-04所属部门:法学院人气指数:1浏览次数: ...
    中国人民大学 辅仁网 2017-07-04
  • 首届中国媒体微博大会嘉宾发言摘要
    文献详情首届中国媒体微博大会嘉宾发言摘要文献类型:期刊作者:郑志[1]喻国明[2]邹建华[3]邢镔[4]李茂山[5]王辉[6]李子雯[7]王舒怀[8]田洪[9]机构:[1]中国人民大学舆论研究所[2]外交部[3]外交部[4]灵思营销媒介运营中心[5]腾讯媒体拓展部[6]灵思营销媒介运营中心第二中心[ ...
    中国人民大学 辅仁网 2017-07-03