Internet of Things meets Big Data: An Infrastructure to Collect, Connect, and Analyse Sensor Data
Conference: VDE-Kongress 2016 - Internet der Dinge
11/07/2016 - 11/08/2016 at Mannheim, Deutschland
Proceedings: VDE-Kongress 2016 – Internet der Dinge
Pages: 6Language: englishTyp: PDFPersonal VDE Members are entitled to a 10% discount on this title
Gursch, Heimo; Kern, Roman (Know-Center GmbH, Graz, Austria)
Many different sensing, recording and transmitting platforms are offered on today’s market for Internet of Things (IoT) applications. But taking and transmitting measurements is just one part of a complete system. Also long time storage and processing of recorded sensor values are vital for IoT applications. Big Data technologies provide a rich variety of pro-cessing capabilities to analyse the recorded measurements. In this paper an architecture for recording, searching, and analysing sensor measurements is proposed. This architecture combines existing IoT and Big Data technologies to bridge the gap between recording, transmission, and persistency of raw sensor data on one side, and the analysis of data on Hadoop clusters on the other side. The proposed framework emphasises scalability and persistence of measurements as well as easy access to the data from a variety of different data analytics tools. To achieve this, a distributed architecture is designed offering three different views on the recorded sensor readouts. The proposed architecture is not targeted at one specific use-case, but is able to provide a platform for a large number of different services.