embeddedlinuxsystem-drbadlishah

8/9/2019 EmbeddedLinuxSystem-DrBadlishah

1/32

1

Embedded GNU/Linux System: AEmbedded GNU/Linux System: ASmart Camera ProjectSmart Camera Project

R. Badlishah AhmaR. Badlishah Ahmad (PhD)d (PhD)

Head of Embedded Computing,UniMAP Research Cluster

email: [email protected]@unimap.edu.myhttp://publicweb.unimap.edu.my/~badli/http://publicweb.unimap.edu.my/~badli/


2/32

2

Contents - I

Embedded System (ES): Definition

Embedded GNU/Linux: products

Example of processors used for ES

Single Board Computer (SBC)

Choices of SBC

Advantages of using SBC

When & Why to choose SBCEmbedded Operating System (EOS)


3/32

3

Contents - II

GNU/Linux OS

GNU/Linux Advantages

SBC in UniMAP

Smart Camera Project (SCP)

SCP: Introduction

SCP: Objectives

SCP: System Overview

SCP: Hardware & Software

Difficulties & Lessons Learned

Conclusion


4/32

4

Embedded System (ES)

ES consists of input/output (I/O) & Control

Logic

Classified as a combination of hardware and

software

Different from PC that is multitasking

ES performs specific tasks


5/32

5

Embedded System (ES)

Common ES characteristics:

Single-functioned/specific task

Tightly constrained resources

Reactive and real-time


6/32

6

Embedded GNU/Linux

http://linuxdevices.com/


7/32

7

Embedded GNU/Linux


8/32

8

Embedded GNU/Linux


9/32

9

Embedded GNU/Linux

Single Board Computer byTechnologic System use in

UniMAP


10/32

10Microprocessor: 64-bit MIPS RISCSony Aibo ERS-110 Robotic Dog

Microprocessor: 32-bit RISCRCA RC5400 DVD Player

Microprocessor: 32-bit RISCRio 800 MP3 Player

Microprocessor: Motorola 32-bit MCOREMotorola i1000plus iDEN Multi-ServiceDigital Phone

Microprocessor: 32-bit MotorolaDragonball EZ

Palm Vx handheld

Microprocessor: 16-bitGarmin SteetPilot GPS Receiver

Microprocessor: 8-bit Intel 80C85NASAs Mars Sojourner Rover

Microprocessor: 8-bit Motorola 68HC05Miele dishwashers

Microprocessor 8-bit Zilog Z8Sonicare Plus tootbrush

Microprocessor: 8-bit Motorola 68HC11Vendo V-MAX 720 vending machine

PlatformProducts

Processors used for ES


11/32

11

Single Board Computer (SBC)

Characteristics

Computer like

Manufactures with important peripherals

Stand-alone computer

Ready-made device

Constraint

Small RAM (compared to Desktop)

No Graphical Interface or Keyboard


12/32

12

Advantechs Half-Biscuit Ampros EnCore

Kontrons Standalone SBCKontrons EPIC SBC

TS-7200 ARM SBC

TS-5500 PC/104

Choices of SBC


13/32

13

Advantages of using SBC

Faster speed development

Choices for various clock speed (price varies

as processor speed)

Capabilities of using Open Source Software

(OSS)/Free Software (FS) and tools

Support high level programming


14/32

14

When & Why to use SBC

WhenLack of resources (hardware designers)

Lack of manufacturing capabilities

WhyFaster Time to Market

Proven hardware design by vendor -> reliable

design and reduce risk of defectMore vendor choices (different size, functions and

price options)


15/32

15

Embedded OS (EOS)

EOS is a software program that manages all

other programs in embedded devices

EOS is a small OS designed to operate with

embedded devices to perform certain tasks

which control effectively all the hardware

components


16/32

16

Embedded OS (EOS)

Real-Time & Non Real-Time (commercial)

QNX, DOS, Windows CE, LynxOS

VxWorks

PSOS RTLinux

Other Choices?? create own? Yes,

modify/customize GNU/Linux OS!!!! it's FREE


17/32

17

GNU/Linux OS

Unix-based OS originally developed for Intel-

compatible PC's

Modern OS -> include features such as virtual

memory, memory protection and pre-emptivemultitasking

Source code is freely available!!!


18/32

18

GNU/Linux OS

Embedded Linux is increasing due to the ability tomodify subsystem code to suit application designs

Support Portable Operation Interface (POSIX) ->

easy to port existing code to different processorarchitecture

GNU/Linux are available for x86, SPARC, ARM,

PowerPC, MIPS etc....


19/32

19

GNU/Linux Advantages

Robust Features multi-threaded, multi-

functions

Scalability can run on flash cards and boards

to PCs and larger system

Widespread acceptance communities of

programmers available

NO ROYALTIES!!!!


20/32

20

SBC in UniMAP

Based from Technologic System Co. (USA)

(http://www.embeddedarm.com/)

Model bought available TS5500TS5500,

TS7200/TS7800TS7200/TS7800 and TS3300TS3300

133-200MHz, AMD/I386, USBs, 10/100

Ethernet, Wi-Fi (PCMCIA), COM ports, Digital

I/Os, ADC Comes with TS-Linux (EOS)


21/32

21

Smart Camera Project

A sample of Embedded GNU/Linux developedin UniMAP

Network Vision based system

Using GNU/Linux & Free Software tools (GCC) Using TS5500 SBC Board

Development tasks:

Integrating Web Camera

Developing software for image capture, imageconversion, image manipulations and socketprogramming


22/32

An example of an Embedded GNU/Linux.

Situation awareness is the key to security and safety.

Traffic surveillance system that exist today consist of CCTV (deployed incritical areas), a lot of monitors and traffic operators.

Traffic operators are assigned the task of visual monitoring and threatdetection process which is really tedious and error prone for a humaninvestigator.

Smart Camera Project

Existing Surveillance System


23/32

Problems in traffic surveillance area :

Inefficient network monitoring

traffic operators are burden with visual monitoring task,therefore a threat detection process would be ineffective,unreliable and prone to error.

the presence of stationary vehicle on the road, especially at acritical places could cause a secondary crashes, trafficcongestion and other traffic incident.

Therefore, there is a NEED of a vision system to giveearlier detection and notification ofstationary vehicle

to the security personnel or traffic operator on theevents

Introduction


24/32

Objective

To develop, integrate, configure and analyze the performance

of Embedded Vision System for stationary vehicle detectionutilizing GNU/Linux and Single Board Computer


25/32

System Overview

utilizing SBCas a processor andLogitech Quickcam Pro 4000webcamera as an image sensor.

Task : to monitor road conditions anddetect stationary vehicle inside themonitoring area.

If the object of interest is detected onthe scene, the system willnotify theoperators by transmittingthe image tothe supervision center.

Network

SBC

Monitor

Alarm

USB Webcam

Supervision Center

Smart Camera

d


26/32

Hardware

SENSING UNIT

LOGITECH QUICKCAM PRO4000

VGA-sized (640x480 pixel) CCDsensor

capture video at maximum 30frames per second. driver used : pwc-8.8 & usb-

pwcx-8.2.2

PROCESSING &COMMUNICATION UNIT

TS-5500 SINGLE BOARD COMPUTER

AMD Elan 520 processor (133Mhz)

32 MB RAM

10/100 Base-T Ethernet port

S f M d l


27/32

Software Module

Divided into 3 modules: Module 1: Image Acquisition Module 2: Image Processing and Object

Detection Module 3: Data Transmission

P


28/32

Processes

IMAGE CAPTUREIMAGE CAPTURE

COLOR SPACECOLOR SPACE

CONVERSIONCONVERSION

FRAMEFRAME

DIFFERENCINGDIFFERENCING

NOISENOISE

REMOVALREMOVAL

OBJECTOBJECT

EXTRACTIONEXTRACTION

FILTERINGFILTERING

(CONVOLUTION)(CONVOLUTION)

DETECTION &DETECTION &IMAGE SAVINGIMAGE SAVING

&&

NOTIFICATIONNOTIFICATION

H d P f


29/32

Hardware Performance

Specification Desktop PC SBC

Processor Type Intel(R) Pentium(R) 4 CPU AMD Elan 520

Processor Speed 2.66 GHz 133 MHz

RAM Size 512 MB 32 MB

Operating System Mandriva 2006 TS-Linux

Smart Camera OperationPlatform

Overall Processing(s)

Desktop PC 6.09

TS-5500 SBC 38.82

Results


30/32

30

Difficulties & Lessons Learned

Understanding system & file structure

Revising programming skill in C/C++ for socket programming, shellprogramming & database

Ability to do various system configuration using CLI

Understanding cross compiling process & techniques

Difficulties to integrate external devices such as Webcam, touchscreen etc..:Kernel version mismatch!!

Difficulties to compile on the SBC!! programming are done on a host PC

Execution problem on SBC board due to library mismatch between host PC

and SBC

Limited/No Technical support

C l i


31/32

31

Conclusion

Applications using SBC can be extended into many morefields such as automation, robotic, firewall, intrusiondetection system, carried grade telecommunication andnetwork devices

The availability of Linux kernel and GNU applicationdevelopment tools ANY applications or system can be

build!!!!

Wide oppurtunities for system development

Q&A


32/32

32

Q&A

SMART CAMERAPROTOTYPE

embeddedlinuxsystem-drbadlishah

Documents