Journal of the Society of Korea Industrial and Systems EngineeringVol, 29, No. 4, pp.8 17, December 2006.

평가기법을 활용한 웹 기반 물류정보시스템 개발Usability

Development of Web-based Logistics Information SystemUsing Usability Evaluation

Kyoung-Yeol Jang Sang-Kyu Byun Woo-Sik Yoo

Department of Industrial Engineering, University of Incheon

Presented in this paper was to evaluate and improve the usability of a web-based logistics information system. The sys-tem was developed for the domestic company to track and monitor its own transportation vehicles and for the customersto check the current location of their packages by using Global Positioning System (GPS) and Short Massage Service(SMS). Since the initial system was developed under a tight schedule set by the company, the system designers and pro-grammers did not focus on the usability of the system but on the functionality. Consequently, some usability problems ofthe system were discovered during the heuristic usability evaluation. This study was required to solve these usabilityissues. Usability problems of the initial system were identified and analyzed, and the user’s requirements for the systemwere re-evaluated to meet the company’s expectation. Several alternative designs were developed by fitted guidelines andthen a updated system was developed.

The updated system had an empirical usability test to find how much the initial system was improved from the heu-ristic evaluation. Two kinds of data were gathered during the tests: objective (completion time and number of errors) andsubjects’ preference. Data showed the updated system is better than the initial system in terms of usability. Presented inthis paper includes introduction of the Usability evaluation, usability engineering process applied in this research, alter-native design of GUI, usability test and results.

Keywords Heuristic Evaluation, Usability Test, Logistics Information System

서 론1. 1)

Usability ‘’

(Nielson, 1994b). Usability ,, , , ,

.

GPS(Global Positioning System) SMS(Short Message Service)

Usability.

Usability

,

2005 .

. (ISO)Usability ‘

(effectiveness)·(efficiency) (satisfaction) ’(ISO 9241-11). , Usability ,

,.

Usability , S/W,

, (PDA),(mobile phone),

, .

GPS SMS.

, GPS, SMS

.Usability

,Usability

.2 Usability

3, 4

. 5 UsabilityUsability 6

GUI .

평가 기법2. Usability

Usability ,. Usability

표 평가 기법의 종류 및 특성< 1> Usability

GOMS 휴리스틱 평가(HE) 테스트Usability (UT)

UsabilityUsability

1. Goals

2. Operators

3. Methods

4. Selection.

.

1.2.

, , ,

1.2.

, GOMS Usability, ,

.

, , , ,, ,

1. GOMS Usability.

2. GOMS.

1. HE UT.

2. HE Usability.

1. UT HE.

2. UT.( ,

, )3. UT

.1. GOMS

.1. HE UT .2.

.3. HE Usability

.4. HE

Usability.

1. UT .2. UT

.

1. (Card, Moran, and Newell, 1983)2. (Kieras, 1988)3. (John and Kieras, 1996a)4. (John andKieras, 1996b)5. (Kieras et al., 1995)

1. (Nielsen, 1994a)2. (Nielsen, 1994b)3. (Nielsen and Mack, 1994)

1. (Shackel, 1990)2. (Virzi, 1992)3. (Lewis, 1994)

,, GOMS(Goals, Operators, Methods,

Selection) (HCI Human Com-puter Interaction, Kieras, 1988 Kieras, Wood, Abotel, andHornof, 1995) Usabil-ity . Usability

, Usability

Usability Usability. , ‘ Usability (UT)’

. Usability< 1> . Usability

,.

, Usability.

.,

. Usability

.

,

., Usability

.Usability

.

웹 기반 물류정보시스템의 초기 개발3.

GPS

SMS.

(LBS-LocationBased Service) . , LBS

, LBS.

. GPS(CDMA)

.SMS

. . <1> .

.

.

.GPS

.

SMS 3 SMS. < 2>

.D

.

그림 웹 기반 물류정보시스템 구성도< 1>

그림 서비스 체계도< 2>

휴리스틱 평가 및 시스템 재설계4.

휴리스틱 평가4.1

.

.,

.

.

, ..

.

(HCI) , (HCI)PhD 2 , ,

..

초기시스템에 대한 개선안4.2

. < 2>.

표 초기시스템에 대한 개선안 요약< 2> ( )

구 분 개 선 사 항

“ ” “ ”“ ”“ ” “ ” ,“ ” “ ” field

( , , )

3 orderfield sorting

order“order ” field “ ”“ ”

/ “ ” order ..

/ / . / , /, / / .

. , “ ” “ ”. . ( , DB )

“ ” field .. , field

field “ ”, “ ”“ ” .

. , ( , ), ,

SMS“ ” ( )

sorting , ( , , )

(“ ”, “ ”, ” ) .

LBS( )

“ ” test1 -, ,

, ,

표 초기시스템과 개선시스템에서 공차관리 모듈 비교< 3>

초기시스템 개선시스템

,.

,. ‘ , , ’ , ‘ , , ’

, ‘ , ’ .

.

.

/ / ./ , /

, / /.

“ ” field.

. ,field .

“ ”.

SMS

개선 시스템 설계4.3

< 2>.

.

< 3> .

< 1>, < 2> . < 3>.

GPS,

.

. SMS,

. SMSSMS

.

그림 프로세스 흐름도< 3>

실험적 테스트5. Usablilty

실험적 테스트5.1 Usability

Usability

. Usability

,

. .

Microsoft Windows XP512MB RAM, IV 1.6 GHz

Usability

.

(1 ) ,(50 ) ,

( 50%)

. 82

.

,. ,

Usability.

,

..

표 테스트의 가지 시나리오< 4> Usability 8

시나리오 1 :대고객 서비스 화면

시나리오 2 :업무지원 서비스 화면

1-1.,

.

.

2-1.

.2-2.

‘ ’

.1-2.

.

2-3..

1-3.

.

2-4.

SMS.

2-5.

.

, 1 3 , 2 5

.

. 8< 4> .

실험적 테스트 결과5.2 Usability

,, & , ,

, LBS.

Usability ,<

5>, < 6> .< 5>

.2055 , 1297

.

758, 36.9%

.

표 과제 완료 시간 결과< 5>

평균 시나리오완료 시간

시나리오 1 시나리오 2 전체 시나리오

개선시스템

초기시스템

개선시스템

초기시스템

개선시스템

초기시스템

(4 )

584.3 807.3 704.8 1103.3 1289.0 1910.5

190.5 65.5 244.6 679.4 291.9 632.3

(4 )

471.3 912.3 824.5 1286.3 1305.8 2098.5

171.5 237.6 323.9 492.4 414.5 580.7

(8 )

532.8 859.8 764.6 1194.8 1297.4 2054.5

176.6 170.8 273.3 557.9 332.0 582.7

표 결과 분석< 6>

통계적테스트 결과

시나리오 1과제(3 )

시나리오 2과제(5 )

전체 시나리오(6 tasks)

개선시스템Vs.

초기시스템

개선시스템Vs.

초기시스템

개선시스템Vs.

초기시스템

(4 )

W+ = 18,W- = 48

W+ = 50,W- = 160

W+ = 115,W- = 381

p-Value p < 0.103 p < 0.020 p < 0.005

(4 )

W+ = 12,W- = 66

W+ = 64,W- = 146

W+ = 129.50,W- = 398.50

p-Value p < 0.017 p < 0.066 p < 0.006

(8 )

W+ = 219.50,W- = 56.50 t-ratio= 2.503 t-ratio= 3.826

p-Value p < 0.007 p < 0.008 p < 0.0002

< 6> 1

, 2

. < 6>1, 2

. 1

, 2.

. 1,

2.

28 , 13 ,

.2.4 ,

2.9 .< 7> .

표 메뉴선택 오류 횟수 및 입력오류 횟수< 7>

메뉴선택오류횟수입력오류횟수/

시나리오 1 시나리오 2 전체 시나리오

개선시스템

초기시스템

개선시스템

초기시스템

개선시스템

초기시스템

5/2.3 10/2.0 4/0.0 5/1.3 9/2.3 15/3.3

4/1.5 11/1.3 14/1.0 31/1.3 18/2.5 42/2.5

5/1.9 11/1.6 9/0.5 18/1.3 13/2.4 28/2.9

개선시스템 평가 및 사용자 인터페이스6.

개선시스템의 사용자 인터페이스6.1

< 4> < 9>.

. < 4>

.

.< 5>

. <6>

. < 7>

.< 8> LBS LBS

1:1 . < 9> SMS

,.

그림 대고객서비스 주문상세조회< 4> ( )

그림 대고객서비스 차량궤적검색< 5> ( )

그림 공차관리 및 차량상태조회< 6>

그림 차량 현재위치 조회< 7>

그림 차량관리< 8> LBS

그림 송신 모듈< 9> SMS

개선시스템의 위치보고 주기 결정6.2

.1.219,000 .

.

.

.

‘1008’.

.

3.

개선 시스템의 성능평가6.3

.. < 8>. ‘K’

CVO ‘D’ OKNET, ‘S’

REMWIZ.

(,

, PDA ) .

표 타 시스템과의 성능 비교< 8>

기 능본 논문의차량관제시스템

K사서비스CVO

S사REMWIZ

D사OKNET

( )

/

(SMS) ×

×

×

) , , ×

.

결론 및 토의7.

( )D

ASP(Application Service Provider)75

1.

Usability,

.Usability .

10 Usability.

Usability .

.Usability

.Usability

, ..

Usability.

UsabilityUsability ,

. Usability

.Usability Usability

. LBSGIS MAP WAP Call backURL ,

,

ASP.

참고문헌

[1] , , , ; “

”, 2003-15, , 2003.[2] ; SMS , SDS IT Review,

2001. 9.[3] , ; Usability Framework,

2003.[4] , ; “ SMS Transaction

”, .[5] , ; “

”, 1, 2003.[6] , , ; “2004

- GPS/GIS ()”, ,

2004.[7] ; “GPS/PCS

”, , 14(6), 2003.[8] ; “GPS

”, , 2003.[9] Card, S. K., Moran, T. P., and Newell, A.; The psychol-

ogy of human-computer interaction, Hillsdale, N.J. : L.Erlbaum Associates, 1983.

[10] Gregoire Heugel, Webraska; Telematics and Naviga-tion systems, The New Challenges, 2002.

[11] Internet ITS; The Telematics Market in Japan in 2002and Beyond, 2002.

[12] JAcques Nouvier; Telematics and Road Safety theFrench proach, 2001.

[13] Jim Mcgeough; Location-Basec Services and Technol-ogy, 2001.

[14] John, B. E. and Kieras, D. E.; “The GOMS Familyof User Interface Analysis Techniques Comparisonand Contrast,” ACM transactions on computer-humaninteraction, 3(4) : 320-351, 1996a.

[15] John, B. E. and Kieras, D. E.; “Using GOMS for userinterface design and Evaluation : Which Technique?”ACM transactions on computer-human interaction, 3(4): 287-319, 1996b.

[16] Jonathan Lawrence, Mitchell Leung, Dain RauscherWessles; Telematics and Location-Based Services,2001.

[17] Kieras, D. E.; “Towards a practical GOMS model meth-odoloy for user interface design,” In Handbook of hu-man-computer interaction (pp. xxxiii, 1167). Amster-dam, New York, N.Y., U.S.A.: North-Holland ;Soledistributors for the U.S.A. and Canada Elsevier SciencePub. Co., 1988.

[18] Kieras, D. E., Wood, S. W., Abotel, K., and Hornof,A.; “Glen A Computer-Based Toolfor Rapid GOMSModel Usability Evaluation of User Interface Designs,”Paper presented at the Paper presented at the Proceed-ings of the 8th annual ACM symposium on User inter-face and software technology, Pittsburgh, Pennsylvania,United States, 1995.

[19] Lewis, J. R.; “Sample sizes for usability studies: addi-tional considerations,” Hum Factors, 36(2) : 368-378,1994.

[20] Nielsen, J.; “Heuristic evaluation,” In Usability inspec-tion methods, John Wiley & Sons, Inc., pp. 25-62, 1994a.

[21] Nielsen, J.; Usability engineering ([Updated ] ed.), San

Francisco, Calif.: Morgan Kaufmann Publishers, 1994b.[22] Nielsen, J. and Mack, R.; Usability Inspection Methods,

New York, NY : John Wiley and Sons, 1994.[23] Nielson, J.; Usability Engineering, MA: Academic

Press Professional, 1993.[24] Shackel, B.; “Human factors and usability,” In Human-

computer interaction, Prentice Hall Press, pp. 27-41,1990.

[25] SMS-Controlled Mains Sockets; Elektor Electronics, 29: 12-19, 2003.

[26] Virzi, R. A., “Refining the test phase of usability evalu-ation: how many subjects is enough?” Hum. Factors,34(4) : 457-468, 1992.