Machine Learning based Activity learning for Behavioral Contexts in Internet of Things

Ontology based activity learning models play a vital role in diverse fields of Internet of Things (IoT) such as smart homes, smart hospitals or smart communities etc. The prevalent challenges with ontological models are their static nature and inability of self-evolution. The models cannot be completed at once and smart home inhabitants cannot be restricted to limit their activities. Also, inhabitants are not predictable in nature and may perform “Activities of Daily Life (ADL)” not listed in ontological model. This gives rise to the need of developing an integrated framework based on unified conceptual backbone (i.e. activity ontologies), addressing the lifecycle of activity recognition and producing behavioral models according to inhabitant’s routine. In this paper, an ontology evolution process has been proposed that learns particular activities from existing set of activities in daily life (ADL). It learns new activities that have not been identified by the recognition model, adds new properties with existing activities and learns inhabitant’s newest behavior of performing activities through Artificial Neural Network (ANN). The better degree of true positivity is evidence of activity recognition with detection of noisy sensor data. Effectiveness of proposed approach is evident from improved rate of activity learning, activity detection and ontology evolution.

1. Choudhury T., Consolvo S., Harrison B. et al. The mobile sensing platform: An embedded activity recognition system. IEEE Pervasive Computing, vol. 7, no. 2, 2008, pp. 32-41.

2. Philipose M., Fishkin K.P., Perkowitz M. et al. (2004). Inferring activities from interactions with objects. IEEE Pervasive Computing, vol. 3, no. 4, 2004, pp. 50-57.

3. Safyan M., Qayyum Z.U., Sarwar S., Iqbal M., Ahmed M. Context-Aware Personalized Activity Modeling in Concurrent Environment. In Proc. of the 10th International Conference on Internet of Things (iThings-17), 2017, pp 977-982.

4. Fernández-Caballero A., Castillo J.C., Rodríguez-Sánchez J.M. Human activity monitoring by local and global finite state machines. Expert Systems with Applications, vol 39, no. 8, 2012, pp 6982-6993.

5. Chervyakov N., Babenko M., Tchernykh A. et al. AR-RRNS: Configurable reliable distributed data storage systems for Internet of Things to ensure security. Future Generation Computer Systems, vol. 92, 2019, pp. 1080-1092.

6. Chen L., Nugent C., & Okeyo G. An ontology-based hybrid approach to activity modeling for smart homes. IEEE Transactions on Human-Machine Systems, vol. 44, no. 1, 2014, pp. 92-105.

7. Poppe R. A survey on vision-based human action recognition. Image and Vision Computing, vol. 28, no. 6, 2010, pp. 976-990.

8. Weinland D., Ronfard R., & Boyer E. A survey of vision-based methods for action representation, segmentation and recognition. Computer Vision and Image Understanding, vol. 115, no. 2, 2011, pp. 224-241.

9. Azkune G., Almeida A., López-de-Ipiña D., & Chen L. Extending knowledge-driven activity models through data-driven learning techniques. Expert Systems with Applications, vol. 42, no. 6, 2015, pp. 3115-3128.

10. Ye J., Stevenson G., & Dobson S. KCAR: A knowledge-driven approach for concurrent activity recognition. Pervasive and Mobile Computing, vol. 19, 2015, pp. 47-70.

11. Riboni D., Sztyler T., Civitarese G., & Stuckenschmidt H. Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning. In Proc. of the ACM International Joint Conference on Pervasive and Ubiquitous Computing, 2016, pp. 1-12

12. Okeyo G., Chen L., & Wang H. Combining ontological and temporal formalisms for composite activity modelling and recognition in smart homes. Future Generation Computer Systems, vol. 39, 2014, pp. 29-43.

13. Chen L., Nugent C.D., & Wang H. A knowledge-driven approach to activity recognition in smart homes. IEEE Transactions on Knowledge and Data Engineering, vol. 24, no. 6, 2012, pp. 961-974.

14. Azkune G., Almeida A., López-de-Ipiña D., & Chen L. (2015). Extending knowledge-driven activity models through data-driven learning techniques. Expert Systems with Applications, vol. 42, no. 6, 2015, pp. 3115-3128.

15. Chen L, Nugent C.D., and Wang H. A Knowledge-Driven Approach to Activity Recognition in Smart Homes. IEEE Transactions on Knowledge and Data Engineering, vol. 24, no. 6, 2012, pp. 961-974.

16. Gellersen H.W., Schmidt A., & Beigl. M. Multi-sensor context-awareness in mobile devices and smart artifacts. Mobile Networks and Applications, vol. 7, no. 5, 2002, pp. 341-351.

17. Buettner M., Prasad R., Philipose M., & Wetherall D. Recognizing daily activities with RFID-based sensors. In Proc. of the 11th International Conference on Ubiquitous Computing, 2009, pp. 51-60.

18. Gellersen H.W., Schmidt A., & Beigl M. (2002). Multi-sensor context-awareness in mobile devices and smart artifacts. Mobile Networks and Applications, vol. 7, no. 5, 2002, pp. 341-351.

19. Ravi N., Dandekar N., Mysore P., & Littman M.L. (2005, July). Activity recognition from accelerometer data. In Proc. of the Twentieth National Conference on Artificial Intelligence and the Seventeenth Innovative Applications of Artificial Intelligence Conference, 2005, pp. 1541-1546.

20. Brezmes T., Gorricho J.L., & Cotrina J. Activity recognition from accelerometer data on a mobile phone. Lecture Notes in Computer Science, vol. 5518, 2009, pp. 796-799.

21. Dayan P. Unsupervised learning. In Wilson R.A. & Keil F., editors. The MIT Encyclopedia of the Cognitive Sciences. MIT, 1999, 7 p.

22. Chen L., Nugent C. Ontology-based activity recognition in intelligent pervasive environments. International Journal of Web Information Systems, vol. 5, no. 4, 2017, pp. 410-430.

23. Liao L., Fox D., & Kautz H. Extracting places and activities from gps traces using hierarchical conditional random fields. The International Journal of Robotics Research, vol. 26, no. 1, 2007, pp. 119-134.

24. Tapia E.M., Choudhury T., & Philipose M. Building reliable activity models using hierarchical shrinkage and mined ontology. Lecture Notes in Computer Science, vol. 3968, 2006, pp. 17-32

25. Yamada N., Sakamoto K., Kunito G. et al. Applying ontology and probabilistic model to human activity recognition from surrounding things. IPSJ Digital Courier, vol. 3, 2007, pp. 506-517.

26. Safyan M., Qayyum Z.U., Sarwar S., Iqbal M., Ahmed M. Ontology-driven Semantic Unified Modeling for Concurrent Activity Recognition (OSCAR). International Journal of Multimedia Tools and Applications, vol. 78, 2019, pp. 2073–2104.

27. Fong T., Nourbakhsh I., and Dautenhahn K. A survey of socially interactive robots. Journal of Robotics and Autonomous Systems, Vol 42, no. 2, 2003, pp. 143-166.

28. Latfi F., Lefebvre B., & Deschen C. (2017). Ontology-Based Management of the Telehealth Smart Home, Dedicated to Elderly in Loss of Cognitive Autonomy. In Proc. of the OWLED: Workshop on OWL: Experiences and Directions, 2027, pp. 3-16.

29. Klein M., Schmidt A., & Lauer R. (2007). Ontology-centered design of an ambient middleware for assisted living: The case of soprano. In Proc. of the 30th Annual German Conference on Artificial Intelligence KI, 2007, pp. 2-8.

30. Chen L., Nugent C., Mulvenna M., Finlay D., & Hong X. Semantic smart homes: towards knowledge rich assisted living environments. Studies in Computational Intelligence, vol 189, 2009, pp. 279-296.

31. Машечкин И.В., Петровский М.И., Царев Д.В., Чикунов М.Н. Методы машинного обучения для задачи обнаружения и мониторинга экстремистской информации в сети интернет. Программирование, том 45, no. 3, 2019 г., стр. 18-37 / Mashechkin I.V., Petrovskiy M.I., Tsarev D.V., Chikunov M.N. Machine Learning Methods for Detecting and Monitoring Extremist Information on the Internet. Programming and Computer Software, vol. 45, no. 3, 2019, pp. 99–115.

32. Сарвар С., Кайум З.У, Сафьян М., Икбал М., Махмуд Я. Выявление характерных особенностей программ для борьбы с компьютерным пиратством на основе интеллектуального анализа графов. Труды ИСП РАН, том 31, вып. 2, 2019 г., стр. 171-186. DOI: 10.15514/ISPRAS-2019-31(2)-12 / Sarwar S., Qayyum Z.U., M Safyan, Iqbal M., Mahmood Y. (2019). Graphs Resemblance based Software Birthmarks through Data Mining for Piracy Control. Programming and Computer Software, vol 45, no. 8, 2019, pp. 581–589.

33. Бабенко М.Г., Черных А.Н., Червяков Н.И. и др. Эффективное сравнение чисел в системе остаточных классов на основе позиционной характеристики. Труды ИСП РАН, том 31, вып. 2, 2019 г., стр. 187-202. DOI: 10.15514/ISPRAS-2019-31(2)-13 / Babenko M., Tchernykh A., Chervyakov N. et al. Positional Characteristics for Efficient Number Comparison over the Homomorphic Encryption. Programming and Computer Software, vol 45, no. 8, 2019, pp 532–543.

34. Augusto J.C. & Nugent C.D. (2004). The use of temporal reasoning and management of complex events in smart homes. In Proc. of the 16th European Conference on Artificial Intelligence, 2004, pp. 778-782.

35. García-Hernández L.E., Tchernykh A., Miranda-López V., Babenko M. Multi-objective Configuration of a Secured Distributed Cloud Data Storage. In Proc. of the Latin American High Performance Computing Conference, 2019, pp. 78-93.