1806014

Upload: ivan-avramov

Post on 04-Apr-2018

212 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/30/2019 1806014

    1/9

    Industrial Robot: An International JournalEmerald Article: A robotic system based on fuzzy visual servoing forhandling flexible sheets lying on a table

    Paraskevi Zacharia, Nikos Aspragathos, Ioannis Mariolis, Evaggelos Dermatas

    Article information:

    To cite this document: Paraskevi Zacharia, Nikos Aspragathos, Ioannis Mariolis, Evaggelos Dermatas, (2009),"A robotic system

    based on fuzzy visual servoing for handling flexible sheets lying on a table", Industrial Robot: An International Journal, Vol.6 Iss: 5 pp. 489 - 496

    Permanent link to this document:

    http://dx.doi.org/10.1108/01439910910980213

    Downloaded on: 08-01-2013

    References: This document contains references to 22 other documents

    Citations: This document has been cited by 1 other documents

    To copy this document: [email protected]

    This document has been downloaded 286 times since 2009. *

    Users who downloaded this Article also downloaded: *

    Paraskevi Zacharia, Nikos Aspragathos, Ioannis Mariolis, Evaggelos Dermatas, (2009),"A robotic system based on fuzzy visual

    ervoing for handling flexible sheets lying on a table", Industrial Robot: An International Journal, Vol. 36 Iss: 5 pp. 489 - 496

    http://dx.doi.org/10.1108/01439910910980213

    Paraskevi Zacharia, Nikos Aspragathos, Ioannis Mariolis, Evaggelos Dermatas, (2009),"A robotic system based on fuzzy visual

    ervoing for handling flexible sheets lying on a table", Industrial Robot: An International Journal, Vol. 36 Iss: 5 pp. 489 - 496

    http://dx.doi.org/10.1108/01439910910980213

    Paraskevi Zacharia, Nikos Aspragathos, Ioannis Mariolis, Evaggelos Dermatas, (2009),"A robotic system based on fuzzy visual

    ervoing for handling flexible sheets lying on a table", Industrial Robot: An International Journal, Vol. 36 Iss: 5 pp. 489 - 496

    http://dx.doi.org/10.1108/01439910910980213

    Access to this document was granted through an Emerald subscription provided by TECHNICAL UNIVERSITY OF SOFIA

    For Authors:

    f you would like to write for this, or any other Emerald publication, then please use our Emerald for Authors service.

    nformation about how to choose which publication to write for and submission guidelines are available for all. Please visit

    www.emeraldinsight.com/authors for more information.

    About Emerald www.emeraldinsight.com

    With over forty years' experience, Emerald Group Publishing is a leading independent publisher of global research with impact in

  • 7/30/2019 1806014

    2/9

    Research article

    A robotic system based on fuzzy visual servoingfor handling flexible sheets lying on a table

    Paraskevi Zacharia, Nikos Aspragathos, Ioannis Mariolis and Evaggelos Dermatas

    Department of Mechanical and Aeronautics Engineering, University of Patras, Patras, Greece

    AbstractPurpose The purpose of this paper is to present a flexible automation system for the manipulation of fabrics lying on a work table and focuses on thedesign of a robot control system based on visual servoing and fuzzy logic for handling flexible sheets lying on a table. The main contribution of thispaper is that the developed system tolerates deformations that may appear during robot handling of fabrics due to buckling without the need for fabricrigidization.Design/methodology/approach The vision system, consisting of two cameras, extracts the features that are necessary for handling the fabricdespite possible deformations or occlusion from the robotic arm. An intelligent controller based on visual servoing is implemented enabling the robot tohandle a variety of fabrics without the need for a mathematical model or complex mathematical/geometrical computations. To enhance its

    performance, the conventional fuzzy logic controller is tuned through genetic algorithms and an adaptation mechanism and the respective performanceis evaluated. The experiments show that the proposed robotic system is flexible enough to handle various fabrics and robust in handling deformationsthat may change fabrics shape due to buckling.Findings The experiments show that the proposed robotic system is flexible enough to handle various fabrics and robust in handling deformationsthat may change fabrics shape due to buckling.Research limitations/implications It is not possible to cover all the aspects of robot handling of flexible materials in this paper, since there are stillseveral related issues requiring solutions. Considering the future research work, the proposed approach can be extended to sew fabrics with curvededges and correcting the distortions presented during robot handling of fabrics.Practical implications The paper includes implications for robot handling a variety of fabrics with low and medium bending rigidity on a workingtable. The intent of this paper deals with buckling in context of achieving a successful seam tracking and not the correction strategy against folding orwrinkling problems.Originality/value This paper fulfils an identified need to study the fabrics behavior towards robot handling on a working table.

    Keywords Fuzzy control, Robotics, Materials handling equipment, Textiles, Intelligent agents

    Paper type Research paper

    1. Introduction

    The development of intelligent control systems with vision

    feedback enables robots to perform skillful tasks in more realistic

    environments. Flexible materials pose additional problems

    compared to rigid bodies due to low bending rigidity,

    non-linearity, anisotropy and structure complexity. Thus, their

    mechanical behavior is rather difficult to be modeled.

    A method was introduced in Torgerson and Paul (1988) for

    the manipulation of fabrics towards the needle employing a

    geometric approach for path-point computation related torobot motion. The deviation errors lie in the range of 3-5 mm,

    while visual feedback was not used. The deformation problems

    that arise towards handling of fabrics were not discussed.

    The FIGARO system (Gershon and Porat, 1988, 1986)

    performed handling and assembling operations using two

    superimposed servo control systems. The first system

    maintains a small tension moving the robot forward with

    the cloth and the second one rotates the cloth about the

    sewing needle to produce a seam parallel to the edges. The

    system performed best with shirting and worsted woven

    fabrics, which have a reasonable resistance in buckling.Robotic manipulation strategies were investigated in

    Gershon (1993) for handling limp materials proposing a

    parallel process decomposition of the robot sewing task

    (Gershon, 1990). A robot arm manipulates the fabric,

    modeled as a mass-spring-damper system, to modify its

    orientation and control the fabric tension during the sewing

    process, which was decomposed into four concurrent

    processes within a superposition parallel architecture.The current issue and full text archive of this journal is available atwww.emeraldinsight.com/0143-991X.htm

    Industrial Robot: An International Journal

    36/5 (2009) 489496

    q Emerald Group Publishing Limited [ISSN 0143-991X]

    [DOI 10.1108/01439910910980213]

    This paper is financed by the General Secretariat for Research andTechnology of Greek Government as part of the project XROMA-Handling of non-rigid materials with robots: application in roboticsewing PENED 01. This project is integrated to EU-funded FP6Innovative Production Machines and Systems Network of Excellence.

    489

  • 7/30/2019 1806014

    3/9

    An automated sewing system was developed (Kudo et al.,

    2000) including two coordinated robots handling the fabric

    on the table. The programming included hands coordination

    during task execution by applying hybrid force/position

    control and synchronization with the sewing machine speed.

    Visual feedback was used to control the seam path and the

    deviation from the desired trajectory and the trajectory error

    was within ^0.5mm.The present work is part of a project for the development of

    a robotic workcell for sewing fabrics. The project includes

    handling tasks (ply separation, translation, placement, folding,

    feeding and orientation), tension control and quality control of

    fabrics and stitches (Moulianitis et al., 1999; Koustoumpardis

    and Aspragathos, 2003; Koustoumpardis e t a l., 2006;

    Zoumponos and Aspragathos, 2008). The innovation of this

    work is the design of a control system that is capable of reliably

    handling flexible materials towards sewing. The main

    contribution of this paper is the design of a robot fuzzy visual

    servoing controller forhandling fabrics on a work table,which is

    enhanced using genetic-based and adaptive control. The

    system works without the need for special mathematical

    computations and can tolerate deformations on condition thatthey do not appear in the seam segment to be sewed.

    2. Robot handling of flexible sheets towardssewing

    The developed vision system is a combination of image- and

    position-based control system (Hutchinson et al., 1996;

    Corke, 1996). The image-based analysis is used for the

    identification of the fabrics shape, the needle-point and the

    sewing lines orientation. The needle position is also known in

    the robot coordinate system. The end-effectors position is

    unknown in the image coordinate system; however, the robot

    system gives feedback to the control system of the current

    end-effectors position in the robot base coordinate system.

    Moreover, the relation between the robot- and the image-coordinate system is known from the calibration of the

    camera. This approach makes the system more flexible and

    limits the calibration errors:. The movement towards a point (e.g. a needle). First, the

    cameras image extracts the vertices of the fabric. After the

    starting seam edge is identified, the distance (r) between

    the starting seam vertex and the sewing needle and the

    orientation angle (u) formed by the starting seam segment

    and the sewing line (Figure 1(a)) are computed. The linear

    (u) and angular end-effectors velocity (v) are derived

    through the designed fuzzy decision system (Section 4).

    The velocity (u) is the resultant of the velocities in x- and

    y-direction. The angular velocity (v) is referred to the

    z-direction, since the x- and y-component are zero;

    otherwise, collision between the gripper and the worktable

    would occur. Given the time step Dt and the angle f,

    i.e. the orientation ofr in the image coordinate system, thenew position and orientation of the end-effector is

    computed. Therefore, the fabric is transferred to a new

    position with new orientation by moving end-effector

    along the direction of r (defined by f) rotated around

    z-axis until the angle becomes u0. The fabric is stuck on

    the gripper to avoid slipping; however, the system can

    cope with slipping, but it is more probable to make some

    oscillations before the fabric reaches the needle within an

    acceptable tolerance.. The sewing process. During sewing, the fabric is guided along

    the sewing line with a constant velocity, which should be the

    same with the velocity of the sewing machine, so that good

    seam quality is ensured. At each time step, the current

    image of the fabric is captured in order that the orientationerror is determined and then, fed back to be corrected by

    rotating the fabric around the needle.. The rotation around the needle. The robot rotates the fabric

    around the needle until the next seam segment is aligned

    to the sewing line. The end-effector is enforced to make a

    circular motion around the needle, since it has penetrated

    into the fabric. The fuzzy system outputs the end-

    effectors angular velocity (v) around an axis

    perpendicular to the table at the needle-point.

    3. Image-based estimation of fabric location

    In real-time systems, the estimation of the fabric position and

    seam line trajectory must be fast and accurate. In this

    direction, a novel estimator of seam lines trajectory uses asystem of two cameras. The first camera detects the fabric

    location during robotic handling towards the needle and its

    view covers the worktable, while the high-resolution images of

    the second camera are used to detect the exact position of the

    fabric edges in the area near the needle.

    3.1 Detection during robot handling

    The detection of the fabric position is affected by the

    transportation of the fabric, the partial occlusion caused by

    Figure 1 Scene of the fabric lying on the work table

    (a) Without deformations (b) With deformations

    Sewing line

    Needle

    y-axis

    r

    x-axis

    Needle

    Sewing line

    r

    y-axis

    x-axis

    A robotic system based on fuzzy visual servoing

    Paraskevi Zacharia et al.

    Industrial Robot: An International Journal

    Volume 36 Number 5 2009 489 496

    490

  • 7/30/2019 1806014

    4/9

    the robotic arm and possible deformation of the fabric (Koch

    and Kashyap, 1987; Ayach and Faugeras, 1986). A model and

    scene description (SD) method has been evaluated on the

    detection of rigid industrial parts (Ayach and Faugeras,

    1986), while several tasks involving fabric handling aided by

    visual information are presented in Fahantidis et al. (1997),

    addressing the problem of fabric deformation, in occlusion

    absence.In the proposed three-stage fabric detection method,

    efficient solutions presented in Ayach and Faugeras (1986)

    are modified to face both partial occlusion and deformation

    problems. In the first stage, thefabric is placed into the working

    area in the absence of any occlusion or deformation. The points

    of high curvature, called fabric-corners, are detected by

    applying Harris corner detector (Deriche and Giraudon, 1990;

    Vernon, 1991) on the acquired grayscale image. The fabrics

    shape is then approximated by the planar polygon having these

    fabric-corners as vertices and a model description (MD) of the

    fabric is generated using the image coordinates of the fabric

    corner, the polygon sides lengths and angles.

    During robot handling, grayscale-images of the fabric are

    acquired (Figure 2(a)) and thresholded using the ISODATA

    method (Ridler and Calvard, 1978) (Figure 2(b)) segmenting

    the binary image into objects using the eight-connected

    components criterion (Haralick and Linda, 1992), and

    keeping the largest object (LO) (Figure 2(c)). Each pair of

    gray-scale and binary images is used to generate a SD

    containing all corners detected in the scene image. The novel

    method of detecting potential fabric-corners is accomplished

    by applying the Harris algorithm to both images and selecting

    only the common corners.In the last stage, multiple hypotheses for all triples of SD

    corners are created by selecting the MD elements with error

    in polygon angle and sides length less than the corresponding

    threshold that are experimentally derived. For each

    hypothesis, the corresponding fabric corners are used to

    define the optimum rigid transformation of the fabric withrespect to the least square error. The rigid transformation of

    the fabric with maximum common area to LO results to the

    estimation of the actual fabric position. In the proposed

    method, since only segments of the fabric are compared, apart

    from coping with partial occlusion, a certain amount of

    deformation is tolerable as well. Actually, if at least two

    successive vertices of the fabric are not deformed or occluded,

    the method can generate a valid hypothesis.

    3.2 Detection of fabric edges near needle

    In the case of the second camera, only a part of the fabric is

    contained in the image and no occlusion occurs. Therefore,

    after applying the Harris corner detector, all the detected

    corners belong to the fabric and the one closest to the needle

    is defined as the first sewing corner. The first sewing corner

    and the two corners that appear at the image borders define

    two sides. The side with minimum absolute differencebetween its slope and the slope of the sewing line is selected

    as the desired sewing side of the fabric and the border corner

    of that side is defined as the second sewing corner. In the rest

    video images, the Harris corner-detection process is repeated

    and the sewing corners of the new image are the detected

    corners closest to the sewing-corners of the previous image.

    4. The fuzzy control system

    Since modeling the mechanical behavior of fabrics for real-

    time applications is rather difficult due to their low bending

    rigidity, an approach based on a fuzzy logic controller (FLC)

    is developed considering the robustness and the fast response

    requirements. The block diagram for the control system isshown in Figure 3, where the symbols in parentheses stand

    for the fuzzy system that controls the orientation of the

    end-effector. The controller inputs are the position error

    (er) and the orientation error (eu), which are computed on the

    image, and their time rates (e0

    r) and (e0

    u). The linear (u) and

    angular velocity (v) of the end-effector around z-axis are the

    outputs.

    The membership functions for the two inputs (Figure 4(a)

    and (b)) and the output of the system that controls the

    translation of the fabric towards the needle (Figure 4(c)) are

    experimentally tuned with various fabrics. Expert knowledge,

    often afflicted with uncertainty, is summarized in the

    proposition:

    The larger the distance/angle and the smaller its change rate is, the faster the

    fabric should move/rotate.

    The fuzzy associative memory (FAM) of the system that

    controls the translation of the fabric (Table I) is derived after

    studying the behavior of the human workers towards sewing.

    For the rule evaluation, the min operator is used and for

    the aggregation mechanism the max operation is used.

    The centroid defuzzification method is used to determine the

    linear and angular velocity. Owing to space limitation, only

    Figure 2

    (a) (b) (c)

    Notes: (a) Original grayscale image acquired by the first camera; (b) binary image after thresholding; and (c) binary image after selecting the largest

    eight-connected object

    A robotic system based on fuzzy visual servoing

    Paraskevi Zacharia et al.

    Industrial Robot: An International Journal

    Volume 36 Number 5 2009 489 496

    491

  • 7/30/2019 1806014

    5/9

    the study for the system that controls the translation is

    presented.

    An analytical model of the robot and the fabric is not

    necessary, since no geometrical characteristics are taken into

    account and there is no need for special mathematical

    computations for different fabrics. The proposed technique is

    feature-based, since only the features, r and u, are necessary

    for handling the fabric and can cope with the uncertainties

    that arise due to deformations.

    The proposed controller can handle the possible

    deformations without changes in its structure achieving the

    desired accuracy on condition that the seam segment targeted

    for sewing is undistorted. Figure 1(b) shows the fabric of

    Figure 1(a), which has been deformed except for the seam

    segment targeted for sewing. It is clear from Figure 1(b) thatthe presence of deformations does not affect the control

    system, despite the fact that the shape of the fabric has

    significantly changed. It is worth noting that the intent of this

    paper deals with buckling in context of achieving a successful

    seam tracking and not the correction strategy against folding

    or wrinkling problems.

    4.1 The proposed genetic fuzzy logic controllerThe parameters of each membership function are determined

    using genetic algorithms (Michalewitz, 1996) as tuning mode

    (Figure 3) to improve the efficiency of the system, to

    overcom e the subjectivity and extensive m anual

    experimentation. The optimum values for the parameters of

    Figure 4 The membership functions

    Small

    Very small Very smallSmall

    SmallMedium MediumLarge Large

    Degreeofmembership

    Degreeofmembership

    Degreeofmembership

    Degreeofmembership

    1

    0.8

    0.6

    0.4

    0.2

    0

    1

    0.8

    0.6

    0.4

    0.2

    0

    1

    0.8

    0.6

    0.4

    0.2

    0

    1

    0.8

    0.6

    0.4

    0.2

    0

    0 50 100 150 200 250 300 0 50 100 150 200 250 300

    Position error (pixels) Position error diagram (pixels/s)

    Small Medium MediumLarge LargeVery large Very large

    0 10 20 30 40 50 60 70 80 90 100 0 10 20 30 40 50 60 70 80 90 100

    Error velocity (pixels/s) Error velocity (pixels/s)

    (a) (b)

    (c) (d)

    Notes: (a) The position error; (b) the position error rate; (c) the linear velocity after manual tuning; and (d) the linear velocity after

    o timization with GAs

    Figure 3 The block diagram of the fuzzy logic control

    A robotic system based on fuzzy visual servoing

    Paraskevi Zacharia et al.

    Industrial Robot: An International Journal

    Volume 36 Number 5 2009 489 496

    492

  • 7/30/2019 1806014

    6/9

    the output membership functions are determined, so that the

    total time required for the fabric to reach the needle is

    minimum and the deviations of the seam segment from the

    needle and the seam line are less than the predefined

    acceptable limits.The evaluation mechanism. The total time ttotal required for

    the robot to move the fabric until reaching the needle is given

    by the summary of the total steps satisfying the constraints:

    jrj # e1 pixels and juj # e2, where e1 and e2 are the maximumacceptable error limits for the desired seam quality.

    Encoding. The problem variables are the parameters

    defining the shapes of the membership functions of the

    output of each fuzzy system. The triangular fuzzy sets aredefined through three parameters and the trapezoidal fuzzy

    sets are defined through four parameters. Therefore, the

    chromosome can be generated by concatenating the

    parameters of the membership functions using the binary

    alphabet. For example:

    1st fuzzy set 2nd fuzzy set 3rd fuzzy set

    4th fuzzy set 5th fuzzy set

    1 11..0 001..0 100..1 000..1 .....

    000..0 001..1

    ..... ..... ..... ..... .....

    ..... ..... ..... ..... .....

    d5c5b5a5b4 c4a4

    b3 c3a3b2 c2a2d1c1b1a1

    The genetic fuzzy logic controller (GFLC) was simulated and

    tested for various combinations of the genetic algorithm

    control parameters. The whole procedure is off-line, since the

    required time for convergence is prohibitive for an online

    application, and the resulted fuzzy sets of the output is shown

    in Figure 4(d). Comparing Figure 4(d) to Figure 4(c),

    the support of the membership function Very Small

    is broadened in order to resolve the oscillations that appear

    when the vertex is very close to the needle. The support of the

    fuzzy set Very Large is narrowed and the membership

    function becomes more abrupt, which urges the fabric to

    make greater movements when it is distant from the needle.

    The supports of the fuzzy sets, Small, Medium and

    Large have also changed, so that the minimum time is

    achieved.

    4.2 The proposed adaptive fuzzy logic controller

    Adaptive fuzzy logic controllers (AFLCs) (Passino and

    Yurkovich, 1998; Patcharaprakiti et al., 2005) provide fast

    response and can change the fuzzy parameters for improving

    the control systems performance. An AFLC is also designed

    for robot handling fabrics. Again, the goal is to alter the

    supports of the fuzzy sets of the outputs, so that the

    performance of the system is improved. The proposed AFLC

    uses only qualitative knowledge of the plant and consists of

    two parts: the fuzzy knowledge-based controller (Section 3.1)

    and an adaptation mechanism, which tunes the output

    (Figure 3) through a supervisory fuzzy system.

    The adaptation mechanism resembles to the fuzzy

    knowledge-based controller in the sense that it has the same

    inputs (Figure 4(a) and (b)) and the same rule base, but the

    output is a scaling factor (Figure 5) lying inside an

    experimentally derived interval [1, 2.5]. The parametersdefining the membership functions of the output have been

    optimized using the genetic algorithm presented in Section

    4.1. The scaling factor changes the universe of discourse of

    the output of the fuzzy knowledge base controller and

    consequently, the support of each fuzzy set is changed by the

    same ratio according to:

    The larger the distance from the needle and the smaller its change rate is, the

    greater the increase of the scaling factor.

    The alteration of the universe of discourse by a ratio greater

    than one results in the acceleration of the sewing process.

    In addition, the AFLC has the advantage of the online tuning.

    5. Experimental results

    The experiments were carried out using a robotic manipulator

    with six rotational degrees of freedom (RV4A) and controlled

    by a PC. The robot is programmed in Melfa-Basic language

    in Cosirop environment, while the analysis of the visual

    information is performed with Matlab 7.1. The vision system

    consists of a Pulnix analog video camera at 768 576 pixels

    resolution RGB and an analog camera of the same resolution,

    which are fixed above the working table in a vertical position

    (Figure 6). The vision is transferred to the second camera

    when the position error becomes less than ten pixels

    (

  • 7/30/2019 1806014

    7/9

    leg. The curved edges of the cloth parts are approximated

    with straight lines as shown in Figure 7, since this paper

    focuses on the handling of fabrics with straight edges. The

    fabrics that are selected for the handling experiments are

    prone to small or relatively large deformations due to

    buckling, such as wrinkling or even folding.In our work, buckling modes during robot handling

    are supportable on the condition that it does not appear

    in the segment to be sewed. However, it still remains a

    problem that should be avoided. Thus, the position where the

    gripper touches the fabric is estimated in terms of reducing

    the possibilities for deformation appearance, taking into

    account the properties of the fabric (Koustoumpardis and

    Aspragathos, 2003). It is worth noting that the intent of this

    paper deals with buckling in context of achieving a successful

    seam tracking and not the correction strategy against folding

    or wrinkling problems. The experimental tests also showed

    that deformations are likely to appear close to the gripperposition on the fabric, and not on the edge.

    Since there is no standardization for deformations, it is

    difficult to be quantified. However, the greater deformation

    observed in buckling is about 30 mm, which is the height

    between the highest and the lowest point of the fabric. In some

    cases, fabrics were partially folded. In other cases, the

    wrinkles induced the fabric to fold due to its own weight

    forming a loop at one side of the fabric. In some experiments,

    the fabric presented simultaneously both wrinkles, and folds.

    Fir st, the FLC, th e GFLC and the AFLC are

    experimentally tested for several times changing the initial

    arbitrary location of the cloth part on the table. In some

    experiments, the fabric undergoes wrinkling or partially

    folding due to buckling and its shape deforms. Table II

    presents the mean absolute values for the steps required toreach the needle and the position and orientation error for the

    four different fabrics with and without deformations when

    reaching the needle, which are derived from 15 iterations for

    each tested case starting from a different location on the table.

    The total steps needed for the robot to move the fabric until

    its edge reaches the needle are decreased using the GFLC

    and the AFLC compared to the simple FLC. For example,

    the total steps for the case of the sleeve have been decreased

    using the GFLC by:

    14:58422 11:6667

    14:5842100% < 20%

    while they have been decreased by:

    14:

    58422 10:

    0000

    14:5842100% < 31:4%

    using the AFLC. However, no direct comparison between

    GFLC and AFLC concerning the performance is possible due

    to the fact that the GFLC has been tuned off-line through

    simulation tests, where some factors affecting the system,

    such as the camera calibration and the robot accuracy, are

    ignored.

    Comparing the experiments carried out using fabrics with

    and without deformations, only slight changes are observed in

    the mean total steps, the mean absolute position and

    orientation error. Consequently, the existence of

    deformations on the fabrics does not degrade the controller

    performance and does not decelerate the sewing process. Thisis the experimental proof that the FLC exhibits flexibility and

    robustness against deformation, since the performance of the

    controller is not affected by possible deformations.

    In the following, some indicative diagrams are presented for

    the total sewing process of the pocket using the GFLC. In

    Figure 8(a), the position error is presented while the robot

    moves from the random initial location towards the needle.

    Figure 7

    (a) (b) (c) (d)

    Notes: (a) Sleeve; (b) trousers leg; (c) pocket; and (d) shorts leg

    Figure 6 The experimental stage

    A robotic system based on fuzzy visual servoing

    Paraskevi Zacharia et al.

    Industrial Robot: An International Journal

    Volume 36 Number 5 2009 489 496

    494

  • 7/30/2019 1806014

    8/9

    The change between the cameras happens at the seventh step,

    where a slight increase in the position error is observed due to

    the higher resolution of the second cameras image. The

    position error in the last step is three pixels (

  • 7/30/2019 1806014

    9/9

    6. Conclusions

    The main focus of this work lies on the design of an innovative

    visual servoing manipulator controller based on fuzzy logic

    that aims to enable robots to handle flexible fabric sheets lying

    on a work table. The designed visual servoing control system

    can deal with a variety of fabrics that are likely to deform and

    can cope with possible deformations due to buckling(wrinkling and folding) towards handling without degradingits performance, on condition that the seam segment to be

    sewed is undistorted. The desired accuracy is achieved in

    approaching the needle even in cases where deformations

    appeared.

    Besides the conventional fuzzy controller, which is manually

    tuned, a GFLC and an AFLC are proposed and tested for

    different fabrics. The experimental results show that the

    proposed approach is effective and efficient in guiding the

    fabric towards the sewing needle, sewing it and rotating it

    around the needle. After extensive experimentation, it has

    been proved to be rather simple, flexible and robust due to its

    capability to respond to any position and orientation error fora variety of fabrics that are likely to present deformations.

    Since it is not possible to cover all the aspects of robothandling of flexible materials in this paper, there are still

    several related issues requiring solutions. Considering our

    future research work, the proposed approach can be extended

    to sew fabrics with curved edges and correcting the distortions

    presented during robot handling of fabrics.

    References

    Ayach, N. and Faugeras, O. (1986), HYPER: a newapproach for the recognition and positioning of two

    dimensional objects, IEEE Transactions on Pattern

    Analysis and Machine Intelligence, Vol. 8 No. 1, pp. 44-54.

    Corke, P.I. (1996), Visual Control of Robots High Performance

    Visual Servoing, Research Studies Press, Taunton.

    Deriche, R. and Giraudon, G. (1990), Accurate corner

    detection: an analytical study, Proceedings of 3rd

    International Conference on Computer Vision, Osaka,

    pp. 66-70.

    Fahantidis, N., Paraschidis, K., Petridis, V., Doulgeri, Z.,

    Petrou, L. and Hasapis, G. (1997), Robot handling of flat

    textile materials, IEEE Robotics & Automation Magazine,

    Vol. 4 No. 1, pp. 34-41.

    Gershon, D. (1990), Parallel process decomposition of adynamic manipulation task: robotic sewing, IEEE

    Transactions on Robotics and Automation, Vol. 6 No. 3,

    pp. 357-66.

    Gershon, D. (1993), Strategies for robotic handling of

    flexible sheet material, Mechatronics, Vol. 3 No. 5,

    pp. 611-23.Gershon, D. and Porat, I. (1986), Robotic sewing using

    multi-sensory feedback, Proceedings of the 16th InternationalSymposium of Industrial Robots, Brussels, pp. 823-34.

    Gershon, D. and Porat, I. (1988), Vision servo control of a

    robotic sewing system, Proceedings of the IEEE International

    Conference on Robotics and Automation, Philadelphia, PA,

    pp. 1830-5.

    Haralick, R.M. and Linda, G.S. (1992), Computer and Robot

    Vision, Vol. I, Addison-Wesley, Reading, MA, pp. 28-48.

    Hutchinson, S., Hager, G.D. and Corke, P.I. (1996),

    A tutorial on visual servo control, IEEE Transactions on

    Robotics and Automation, Vol. 12 No. 5, pp. 651-70.

    Koch, M.W. and Kashyap, R.L. (1987), Using polygons torecognize and locate partially occluded objects,

    IEEE Transactions on Pattern Analysis and Machine

    Intelligence, Vol. 9 No. 4, pp. 483-94.

    Koustoumpardis, P. and Aspragathos, N. (2003), Fuzzy

    logic decision mechanism combined with a neuro-controller

    for fabric tension in robotized sewing process, Journal of

    Intelligent and Robotic Systems, Vol. 36 No. 1, pp. 65-88.

    Koustoumpardis, P., Zoumponos,G., Zacharia, P., Mariolis, I.,

    Chatzis, I., Evangelidis, G. and Zampetakis, A. (2006),

    Handling of non-rigid materials (XROMA), application in

    robotic sewing, paper presented at 37th International

    Symposium on novelties in Textiles, Ljubljana.

    Kudo, M., Nasu, Y., Mitobe, K. and Borovac, B. (2000),

    Multi-arm robot control system for manipulation offlexible materials in sewing operation, Mechatronics,

    Vol. 10 No. 8, pp. 371-402.Michalewitz, Z. (1996), Genetic AlgorithmsData Structures

    Evolution Programs, 3rd ed., Springer, New York, NY.

    Moulianitis, V., Dentsoras, A. and Aspragathos, N. (1999),

    A knowledge-based system for the conceptual design of

    grippers for handling robots, Artificial Intelligence for

    Engineering Design, Analysis and Manufacturing, Vol. 13

    No. 1, pp. 3-25.

    Passino, K.M. and Yurkovich, S. (1998), Fuzzy Control,

    Addison-Wesley, Reading, MA.

    Patcharaprakiti, N., Premrudeepreechacharn, S. and

    Sriuthaisiriwong, Y. (2005), Maximum power point

    tracking using adaptive f uzzy logic control f orgrid-connected photovoltaic system, Renewable Energy,

    Vol. 30 No. 11, pp. 1771-88.

    Ridler, T.W. and Calvard, S. (1978), Picture thresholding

    using an iterative selection method, IEEE Transactions on

    System, Man and Cybernetics SMC-8, pp. 630-2.

    Torgerson, E. and Paul, F.W. (1988), Vision-guided robotic

    fabric manipulation for apparel manufacturing, IEEE

    Control Systems Magazine, Vol. 8 No. 1, pp. 14-20.

    Vernon, D. (1991), Machine Vision, Prentice-Hall, New York,

    NY, pp. 34-6.

    Zoumponos, G. and Aspragathos, N. (2008), Fuzzy logic

    path planning for the robotic placement of fabrics on a work

    table, Robotics & Computer-integrated Manufacturing,

    Vol. 24 No. 2, pp. 174-86.

    Corresponding author

    Paraskevi Zacharia can be contacted at: zacharia@mech.

    upatras.gr

    A robotic system based on fuzzy visual servoing

    Paraskevi Zacharia et al.

    Industrial Robot: An International Journal

    Volume 36 Number 5 2009 489 496

    496

    To purchase reprints of this article please e-mail: [email protected]

    Or visit our web site for further details: www.emeraldinsight.com/reprints