animal monitoring based on iot...

34
© 2018, it - instituto de telecomunicações. Todos os direitos reservados. Luís Nóbrega, DETI/IT Telecomunications Institute André Tavares, DETI/IT - Universidade de Aveiro André Cardoso, DETI/IT Universidade de Aveiro Pedro Gonçalves, ESTGA/IT Universidade de Aveiro Animal monitoring based on IoT technologies IoT Vertical and Tropical Summit for Agriculture 08-09 May 2018 Tuscany, Italy

Upload: others

Post on 14-Apr-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

© 2018, it - instituto de telecomunicações. Todos os direitos reservados.

Luís Nóbrega, DETI/IT – Telecomunications Institute

André Tavares, DETI/IT - Universidade de Aveiro

André Cardoso, DETI/IT – Universidade de Aveiro

Pedro Gonçalves, ESTGA/IT – Universidade de Aveiro

Animal monitoring based on IoT

technologies

IoT Vertical and Tropical Summit for Agriculture

08-09 May 2018 – Tuscany, Italy

Page 2: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

2 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Outline

1. Motivation

2. Overall Architecture

3. Animal Behaviour Monitoring

• ML use case – detecting sheep’s posture

4. Conclusion and future work

IoT Vertical and Topical Summit for Agriculture

Page 3: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

3 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Outline

1. Motivation

2. Overall Architecture

3. Animal Behaviour Monitoring

• ML use case – detecting sheep’s posture

4. Conclusion and future work

IoT Vertical and Topical Summit for Agriculture

Page 4: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

4

IoT Vertical and Topical Summit for Agriculture

| Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Motivation

• Continuous growth of weeds needs to be controlled

• Traditional methods include:

• Mechanical machinery

• Chemical herbicides

• However, they are:

• Onerous

• Environmentally aggressive

• Hard-working

• Needs to be repeated through all the year

Page 5: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

5 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Motivation

So, how to remove vegetable species growing in vineyards and

other farmlands without using expensive and aggressive

mechanical or/and chemical methods?

IoT Vertical and Topical Summit for Agriculture

Page 6: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

6 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Motivation

Using animals, specially ovines!!

So, how to remove vegetable species growing in vineyards and

other farmlands without using expensive and aggressive

mechanical or/and chemical methods?

IoT Vertical and Topical Summit for Agriculture

Page 7: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

7 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Motivation

• An ancient method

• Advantages:

• Reduction of environmental impact

• Provision of land fertilization

• Enhancement of the production

• Disadvantages

• Cannot be used all the year to protect cultures

• Need a automatized mechanism of animal handling

Solution?

SheepIT (www.av.it.pt/sheepit)

IoT Vertical and Topical Summit for Agriculture

Page 8: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

8 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Outline

1. Motivation

2. Overall Architecture

3. Animal Behaviour Monitoring

• ML use case – detecting sheep’s posture

4. Conclusion and future work

IoT Vertical and Topical Summit for Agriculture

Page 9: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

9 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT Overall Architecture

IoT Vertical and Topical Summit for Agriculture

IoT local network Cloud platform

Page 10: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

10 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT local network

IoT Vertical and Topical Summit for Agriculture

IoT local network

• Collars are carried by sheep and

sense animal’s behaviour

• Integrated sensors:

• Accelerometer

• Magnetometer

• Ultrasounds transceiver

• Integrated actuators

• Buzzer

• Electrostatic stimulation circuit

• Use sporadic communications to enter

in the network

• Send periodic sensed data to beacons

Page 11: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

11 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT local network

IoT Vertical and Topical Summit for Agriculture

IoT local network

• Beacons are installed in the intended

grazing areas

• Send periodic data to collars to:

• Collar’s synchronization

• Virtual Fence implementation

• RSSI-based localization

• Exchange periodic data with remaining

beacons

• Relay of collar’s data

• Relay of protocol data

Page 12: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

12 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT local network

IoT Vertical and Topical Summit for Agriculture

IoT local network

• Gateway is an aggregation element

• Powerful version of a beacon.

Integrates:

• A standard beacon +

• WPAN connection +

• Greater processing power

• Additional functions:

• Message transportation

• Network Manager

• Alarm generator

• Enables the integration between non-

IP network and IP-based network

Page 13: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

13 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT cloud platform

IoT Vertical and Topical Summit for Agriculture

Cloud platform

• Message Oriented Middleware

(RabbitMQ)

• Receives JSON messages from

the Gateway

• Supports AMQP and MQTT

• Based on Asynchronous publish

/subscribe

• Implements a FIFO queue

• Implements security SSL/TLS

Page 14: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

14 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT cloud platform

IoT Vertical and Topical Summit for Agriculture

Cloud platform

• Subscriber of the RabbitMQ

• Orchestrates all the operation

inside the platform

• JSON data translation

• Alarms generation

• Data processing (including ML)

• Data persistence

• Stream process »» real-time

analysis

• Batch process »» non-period

analysis

Page 15: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

15 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT cloud platform

IoT Vertical and Topical Summit for Agriculture

Cloud platform

• Storage of the data from:

• Stream process

• Batch process

• PostgreSQL

Page 16: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

16 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT cloud platform

IoT Vertical and Topical Summit for Agriculture

Cloud platform

• Storage of the data from:

• Stream process

• Batch process

• PostgreSQL

• API framework to allow WEB

development

• Interaction with upper layer

applications

Page 17: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

17 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Outline

1. Motivation

2. Overall Architecture

3. Animal Behaviour Monitoring

• ML use case – detecting sheep’s posture

4. Conclusion and future work

IoT Vertical and Topical Summit for Agriculture

Page 18: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

18 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Animal behaviour monitoring

IoT Vertical and Topical Summit for Agriculture

• Collars gather several data from sensors. They allow to monitor

sheep’s ..

• .. posture

• .. location

• .. Infractions

• .. Hours of activity

• .. Travel times

• .. Preferred pasture areas

• .. Timings

• .. Anomalous situations (panic, illness)

• ….

• However, retrieve these information is not straightforward

• DM and ML techniques have a great potential to help solving

these issues

Page 19: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

19 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

ML use case – detecting sheep’s

posture infractions

IoT Vertical and Topical Summit for Agriculture

• Supervised learning algorithms to evaluate sheep’s posture

• Attributes:

• 3-axis accelerometer »» neck’s tilt

• Ultrasounds transceiver »» distance to the ground

• 3 hours of monitoring activity

• Timestamped Data recorded in a file for posterior classification

• Timestamped Video recorded

Page 20: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

20 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

ML use case – detecting sheep’s

posture infractions

IoT Vertical and Topical Summit for Agriculture

• Dataset

• 20555 entries

• 75% for training

• 25% for testing

• Manual classification:

• Resting >> NOT INFRACTION

• Eating from the ground >> NOT INFRACTION

• Standing reaching for food >> INFRACTION

• Walking >> NOT INFRACTION

• Running >> NOT INFRACTION

Page 21: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

21 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

ML use case – detecting sheep’s

posture infractions

IoT Vertical and Topical Summit for Agriculture

AlgorithmMetric

ACC TPR TNR PPV AUC

Random Forest 0.9696 0.8267 0.9861 0.8728 0.987

DT (C50) 0.9693 0.8475 0.9833 0.8539 0.986

XGBoost 0.9685 0.82674 0.9848 0.8625 0.988

KNN 0.9622 0.7702 0.9844 0.85.03 0.977

SVM 0.9642 0.7590 0.9879 0.8778 0.972

DT (rpart) 0.9591 0.8211 0.9750 0.8728 0.970

Naïve Bayes 0.9527 0.8795 0.9612 0.7230 0.979

Page 22: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

22 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

ML use case – detecting sheep’s

posture infractions

IoT Vertical and Topical Summit for Agriculture

AlgorithmMetric

ACC TPR TNR PPV AUC

Random Forest 0.9696 0.8267 0.9861 0.8728 0.987

DT (C50) 0.9693 0.8475 0.9833 0.8539 0.986

XGBoost 0.9685 0.82674 0.9848 0.8625 0.988

KNN 0.9622 0.7702 0.9844 0.85.03 0.977

SVM 0.9642 0.7590 0.9879 0.8778 0.972

DT (rpart) 0.9591 0.8211 0.9750 0.8728 0.970

Naïve Bayes 0.9527 0.8795 0.9612 0.7230 0.979

Page 23: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

23 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

ML use case – detecting sheep’s

posture infractions

IoT Vertical and Topical Summit for Agriculture

Page 24: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

24 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Webplatform

IoT Vertical and Topical Summit for Agriculture

Page 25: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

25 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Webplatform

IoT Vertical and Topical Summit for Agriculture

Page 26: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

26 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

IoT Vertical and Topical Summit for Agriculture

Webplatform

Page 27: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

27 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Conclusion

• Weed control entails on a

significant economic and labor

efforts from winemakers;

• Sheep may be an alternative if

sheep’s posture could be

conditionate

• SheepIT project aims at solving

that issue

• Offers an integrated platform,

since the IoT local network until a

could computational platform

IoT Vertical and Topical Summit for Agriculture

Page 28: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

28 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Conclusion

• The overall architecture was

implemented and a ML use case

was tested

• Data was gathered using the

implemented network and ML

algorithms used to detect posture

infractions

• DT were specially relevant to

retrieve useful information to the

algorithm development

IoT Vertical and Topical Summit for Agriculture

Page 29: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

29 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Future work

• Extend the posture control

algorithm for lands with big slope

(as can be found in Douro’s

region)

• Evaluate the platform

performance and scalability with

larger amounts of devices

• Evaluate other ML use cases (e.g.

detection of illness, panic attacks,

patterns of movement, food

preferences, etc).

IoT Vertical and Topical Summit for Agriculture

Page 30: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

30 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

Questions?

Thank you for your attention!

IoT Vertical and Topical Summit for Agriculture

Page 31: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

31

EXTRA SLIDES

| Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

IoT Vertical and Topical Summit for Agriculture

Page 32: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

32 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

IoT Vertical and Topical Summit for Agriculture

Page 33: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

33 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT Networking Architecture

IoT Vertical and Topical Summit for Agriculture

Periodic sensor data

Sporadic requests

Periodic protocol data

Periodic sensor/protocol data

Periodic Inter-beacon

sensor/protocol data

Beacons GatewayCollars

Page 34: Animal monitoring based on IoT technologiestuscany2018.iot.ieee.org/files/2018/05/IEEE-IoT-2018-May... · 2018-05-16 · 2 | Luís Nóbrega, lnobrega@ua.pt 08-09 May 2018, Tuscany

34 | Luís Nóbrega, [email protected] 08-09 May 2018, Tuscany – Italy

SheepIT IoT Networking Architecture

• uC common structure

• Beacon window, where beacons send short synchronization

and protocol data;

• Turn-around window for local processing

• A window for transmitting specific data to each uC

• Eg. In a uC type 2, the window is used for collar’s data transmission

IoT Vertical and Topical Summit for Agriculture