Download - CV Versi LN
CURRICULUM VITAEJeremy R. Cooperstock
Contents
Background 2Personal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2Education . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2Awards and Distinctions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Work Experience 3Academic Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3Industrial and Consulting Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
Research 5Publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5Non-refereed Contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15Public Awareness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16Supervision . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24Active Collaborations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30Funding Awarded . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Teaching 35Courses Taught . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35Undergraduate Supervision . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Service 38University Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38Professional Activities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
CURRICULUM VITAEJeremy R. Cooperstock
Background
Personal
Nationality Canadian
Languages English, French and Hebrew
Address Department of Electrical and Computer EngineeringMcGill University3480 University Street, Montreal, QC, H3A 2A7, Canada
Telephone (514) 398-5992
email [email protected]
Education
Ph.D. Electrical and Computer Engineering, University of Toronto, 1996.Thesis: “Reactive Environments and Augmented Media Spaces.”(Nominated for NSERC Doctoral Dissertation Award)Advisors: Prof. K.C. Smith and Prof. W. Buxton
M.Sc. Computer Science, University of Toronto, 1992.Thesis: “Neural Network Operated Vision-Guided Mobile Robot Armfor Docking and Reaching.”Advisor: Prof. E. Milios.
B.Ap.Sc. Electrical Engineering, Computer Engineering Option, University ofBritish Columbia, 1990 (Honours)
Awards and Distinctions
2009 Nominee, NSERC Brockhouse Canada Prize for Interdisciplinary Re-search in Science and Engineering Award
2005 ACM/IEEE Supercomputing, International Conference for High Per-formance Computing, Networking, Storage and Analysis, Award forMost Innovative Use of New Technology
2001 Audio Engineering Society Distinction Award2000 ExCESS award for Best Technological Innovator, ECE department,
McGill University1999 Petro-Canada Young Innovator Award1996 Departmental Selection for NSERC Doctoral Dissertation Award, Uni-
versity of Toronto1995 Information Technology Research Center of Ontario (now CITO), In-
novation Award for Increasing Awareness in Leading Edge Technology
2
WORK EXPERIENCE
Work Experience
Academic Experience
May–June2009
Bang & Olufsen, DenmarkVisiting Professor, World Opera Project
Jan 2009 –present
Bielefeld University, GermanyVirtual Member, Center of Excellence Cognitive Interaction Technology(CITEC)
June 2003 –present
McGill University, Montreal, QCAssociate Professor, Electrical and Computer Engineering.Supervising 5 research associates, 4 post-doctoral fellows, 4 Ph.D. stu-dents, 3 M.Eng. students
Sep. 2004 –Aug. 2005
Universite de Paris VI, Paris FranceInvited Professor, Laboratoire des Instruments et Systemes d’Ile-de-France
Apr. 2000 –present
McGill University, Montreal, QCAssociate Member, Faculty of Music, Department of Theory.Founding member of the Centre for Interdisciplinary Research in MusicMedia and Technology. Actively participated in preparation of the CFIand VRQ grant applications that brought in a total $8.7M. Developedtechnology for use in distance music teaching trials. Advised the facultyon networks issues for the new Music building. Served on three thesiscommittees.
Nov. 1997 –May 2003
McGill University, Montreal, QCAssistant Professor, Electrical and Computer Engineering.Supervised 6 M.Eng. students and 3 research staff. Instructed courses inhuman-computer interaction, artificial intelligence, operating systems,and supervised the computer architecture laboratory. Conducted origi-nal research in the areas of high-bandwidth communication, augmentedreality, and intelligent environments. Developed the technology behindthe “Intelligent Classrooms” and maintained these rooms since their de-ployment. Served on nine thesis committees and numerous departmentand university committees.
3
Industrial and Consulting Experience WORK EXPERIENCE
Industrial and Consulting Experience
May – Nov.2007
Boucher HarperAnalysis and expert testimony in intellectual property case (software-related)
Feb. – Oct.2004
Crawford Adjusters CanadaAnalysis of artifacts in high definition video
May 2002 –Nov. 2003
Solicitor General of CanadaMedia streaming configuration and user interface design.
May 2001 National Research CouncilInstructor of short course in Soft Computing, Institut des MateriauxIndustriels.
Jan. – Sep.1999
Audio Engineering SocietyTechnical leader of a demonstration of multichannel and multimediaaudio distribution, sponsored by the Audio Engineering Society’s Tech-nical Committee for Network Audio Systems
Jan. – Aug.1999
Ontario Science CenterScientific Director of Timescape Millenium Exhibit
July 1998 NortelInstructor of short course in videoconferencing systems for the NortelInternational SL-1 User’s Association (ISLUA), Long Beach
Sep. 1996 –Oct. 1997
Sony Computer Science LaboratoryVisiting Researcher at the Sony Computer Science Laboratory, Tokyo,Japan.Developed speech-interface controlled VCR with visual tape databasefunctionality. Wrote two patent applications, one filed. Supervised aresearch intern.
June – Aug.1990
Fibronics ResearchVisiting Researcher at the Fibronics Advanced Research Center, Haifa,Israel.Developed and tested an FDDI-to-token ring bridge, reverse engineer-ing the control protocol used for a LAN manager.
May – Aug.1989
IBM T.J. Watson Research CenterResearch Intern at the IBM T.J. Watson Research Center, YorktownHeights, NY.Developed a VLIW architecture simulator.
4
RESEARCH
Research
Publications
Note that in the following listings, authors whose names are underlined were under my supervisionat the time of writing.
Book Chapters
B1 Wozniewski, M. Settel, Z., and Cooperstock, J.R. (2011, to appear). Sonic Interaction viaSpatial Arrangement in Mixed Reality Environments. Sonic Interaction Design, K. Franinovicand S. Serafin, eds. MIT Press.
B2 Cooperstock, J.R. (2008). Human-Computer Interaction. Chapter in Wiley Encyclopedia ofComputer Science and Engineering, ISBN 978-0-471-38393-2, Benjamin W. Wah, ed., Vol. 3,1529-1542.
Journal Articles
J1 Blum, J., Olmos, A., Sun, H. and Cooperstock, J.R. (in review: TOMCCAP-2010-0144) End-User Viewpoint Control of Live Video from a Medical Camera Array. ACM Transactions onMultimedia
J2 Giordano, B.L, Visell, Y., Yao, H.-Y., Hayward, V., Cooperstock, J.R., and McAdams, S.(in review: MS 10-09611). Audiohaptic identification of ground materials while walking.Acoustical Society of America.
J3 Olmos, A., Bouillot, N., Knight, T., Mabire, N. and Cooperstock, J.R. (in review) Open Or-chestra: a high-fidelity orchestra simulator, Computer Music Journal.
J4 Qi, Z. and Cooperstock, J.R. (in review: TIP-06954-2010). Towards Dynamic Image MosaicGeneration With Robustness to Parallax. IEEE Transactions on Image Processing.
J5 Dansereau, D., Brock, N., and Cooperstock, J.R. (in review: MM-003442). A Particle Filterfor Predicting an Orchestral Conductor’s Baton Movements. IEEE Transactions on Multime-dia
J6 Pelletier, S. and Cooperstock, J.R. (in review: TIP-06592-2010). Preconditioning for Edge-Preserving Image Super-Resolution, IEEE Transactions on Image Processing.
J7 To, L., Thompson, B., Blum, J.R., Maehara, G., Hess, R., and Cooperstock, J.R. (in review:TNSRE-2010-00139) A game platform for treatment of amblyopia, IEEE Transactions onNeural Systems and Rehabilitation Engineering
J8 Benovoy, M., Salimpoor, V.N., Longo, G., Zatorre, R.J., and Cooperstock, J.R. (in review:TAFFC-2010-07-0053). Pleasurable Affective State Recognition Using Non-Linear FeatureTransformation, IEEE Transactions on Affective Computing
5
Publications RESEARCH
J9 Bouillot, N. and Cooperstock, J.R. (in review: TOMCCAP-2010-0134) Quality of Experience-Based Evaluation of Distributed Mobile Audio Applications. ACM Transactions on Multime-dia
J10 Benovoy, M., Cooperstock, J.R., Xiao, Q., and Levine, M. (in review: TIP-06385-2010), Real-Time Multiple Video Face Recognition Using Adaptive Probe Update, IEEE Transactions onImage Processing.
J11 Cooperstock, J.R. (2011). Multimodal Telepresence Systems: Supporting Demanding Col-laborative Human Activities, IEEE Signal Processing Magazine, special issue on ImmersiveCommunications, 28(1), 77-86.
J12 Pellerin, R., Bouillot, N., Pietkiewicz, T., Wozniewski, M., Settel, Z., Gressier-Soudan E., andCooperstock, J.R. (2010). SoundPark: Exploring Ubiquitous Computing through a MixedReality Multi-player Game Experiment, Studia Informatica Universalis, 8(3), Hermann, 21pages.
J13 Bouillot, N., Cohen, E., Cooperstock, J.R., Floros, A., Fonseca, N., Foss, R., Goodman, M.,Grant, J., Gross, K., Harris, S., Harshbarger, B., Heyraud, J., Jonsson, L., Narus, J., Page, M.,Snook, T., Tanaka, A., Trieger, J. Zanghieri, U. (2009). AES White Paper AESTD1003V1:Best Practices in Network Audio, Jeremy R. Cooperstock, ed., Audio Engineering Society57(9), September, 729-741.
J14 Visell, Y., Law, A. and Cooperstock, J.R. (2009). Touch Is Everywhere: Floor Surfaces asAmbient Haptic Interfaces, IEEE Transactions on Haptics, 2(3), July–September, 148–159.
J15 Salimpoor, V., Benovoy, M., Longo, G., Cooperstock, J.R., and Zatorre, R.J. (2009). TheRewarding Aspects of Music Listening are Related to Degree of Emotional Arousal, PLoSONE, 4(10): e7487, June, doi:10.1371/journal.pone.0007487.
J16 Sun, W. and Cooperstock, J.R. (2006). Don’t Count Your Pixels Until They’re Calibrated:An Empirical Evaluation of Factors Influencing Camera Calibration Accuracy, Machine Visionand Applications Journal, 17(1), 51–67, February.
J17 Woszczyk, W., Cooperstock, J., Roston, J., Martens, W. (2005). Shake, Rattle, and Roll:Getting Immersed in Multisensory, Interactive Music via Broadband Networks, Audio Engi-neering Society, 53(4), April, 336–344.
J18 Yin, J. and Cooperstock, J.R. (2004). Color Correction Methods with Applications to DigitalProjection Environments. Winter School of Computer Graphics, 12, No. 3, 499–506.
J19 Winer, L. and Cooperstock, J.R. (2002). The “Intelligent Classroom”: Changing teaching andlearning with an evolving technological environment. Computers and Education, 38, 253–266.
J20 Xu, A., Woszczyk, W., Settel, Z., Pennycook, B., Rowe, R., Galanter, P., Bary, J., Martin,G., Corey, J., and Cooperstock, J.R. (2000). Real-Time Streaming of Multichannel AudioData over Internet. Audio Engineering Society, 48(7/8), July-August, 627–641.
6
Publications RESEARCH
J21 Cooperstock, J.R., Fels, S.S., Buxton, W. and Smith, K.C. (1997). Reactive Environments:Throwing Away Your Keyboard and Mouse. Communications of the ACM, 40(9), 65–73.
J22 Cooperstock, J.R. and Milios, E. (1993). Self-supervised learning for docking and targetreaching. Robotics and Autonomous Systems, 11, 243–260.
Refereed Conference Publications
C1 Dorado, I.G. and Cooperstock, J.R. (in review: paper 688) Automatic multi-projector cali-bration with an uncalibrated camera, CVPR.
C2 Olmos, A., Lachapelle, K., and Cooperstock, J.R. (2010) Multiple Angle Viewer for RemoteMedical Training. Second ACM International Workshop on Multimedia Technologies for Dis-tance Leaning, October 25-29, Florence, Italy.
C3 Ellaway, R., Cooperstock, J.R., and Spencer, B. (2010) Simulation Integration for HealthcareEducation, Training and Assessment. Fifth International Conference on Digital InformationManagement, July 5-8, Thunder Bay, ON.
C4 Rajalingham, R., Visell, Y. and Cooperstock, J.R. (2010) Probabilistic Tracking of PedestrianMovements via In-Floor Force Sensing. Seventh Canadian Conference on Computer and RobotVision, May 31-June 2, Ottawa, ON.
C5 Benovoy, M. and Cooperstock, J.R. (2010) Psychophysiological signal analysis and classifica-tion. CHI 2010 Brain Body and Bytes Workshop, April 10-15, Atlanta, GA.
C6 Visell, Y. and Cooperstock, J.R. (2010). Optimized Design of a Vibrotactile Device via aRigid Surface. IEEE Haptics Symposium, March 25-26, Waltham, MA. Best Paper Award
C7 Visell, Y., Law, A., Ip, J., Smith, S. and Cooperstock, J.R. (2010). Interaction Capture inImmersive Virtual Environments via an Intelligent Floor Surface, IEEE Virtual Reality, March20-24, Waltham, MA.
C8 Visell, Y., Smith, S., Law, A., Rajalingham, R. and Cooperstock, J.R. (2010). Contact Sens-ing and Interaction Techniques for a Distributed, Multimodal Floor Display, IEEE 3D UserInterfaces, March 20-21, Waltham, MA.
C9 Olmos, A, Brule, M., Bouillot, N., Benovoy, M., Blum, J., Sun, H., Lund, N.W., and Coop-erstock, J.R. (2009). Exploring the role of latency and orchestra placement on the networkedperformance of a distributed opera, 12th Annual International Workshop on Presence, LosAngeles, Nov. 11–13.
C10 Bouillot, N., Brule, M., and Cooperstock, J.R. (2009). Performance metrics for network au-dio systems: Methodology and a preliminary comparison. Audio Engineering Society 127thConvention, New York, Oct. 9–12.
C11 Anlauff, J., Hermann, T., Grosshauser, T., and Cooperstock, J.R. (2009). Modular tacTilesfor Sonic Interactions with Smart Environments, Haptic and Audio Interaction Design, Dres-den, Germany, September 10–11.
7
Publications RESEARCH
C12 Berard, F., Ip, J., Benovoy, M., El-Shimy, D., Blum, J. and Cooperstock, J.R. (2009). DidMinority Report Get it Wrong? Superiority of the Mouse over 3D Input Devices for a 3DPlacement Task, IFIP TC13 Conference in Human-Computer Interaction (INTERACT), Up-psala, Sweden, August 24–28.
C13 Settel, Z., Wozniewski, M., Bouillot, N. and Cooperstock, J.R. (2009). Audio Graffiti: Alocation based audio-tagging and remixing environment, International Computer Music Con-ference, Montreal, Aug. 16–21.
C14 Law, A., Ip, J., Peck, B. Visell, Y., Kry, P., and Cooperstock, J.R. (2009). Multimodal floorfor immersive environments, ACM SIGGRAPH Emerging Technologies, New Orleans, August3–7.
C15 Pellerin, R., Bouillot, N., Pietkiewicz, T., Wozniewski, M., Settel, Z., Gressier-Soudan E., andCooperstock, J.R. (2009). SoundPark: Exploring Ubiquitous Computing through a Mixed Re-ality Multi-player Game Experiment, 9e Conference Internationale sur Les Nouvelles Tech-nologies de la Repartition (NOTERE), Montreal, June 29–July 3.
C16 Pellerin, R., Bouillot, N., Pietkiewicz, T., Wozniewski, M., Settel, Z., Gressier-Soudan E.,and Cooperstock, J.R. (2009). SoundPark: Towards Highly Collaborative Game Supportin a Ubiquitous Computing Architecture, 9th IFIP International Conference on DistributedApplications and Interoperable Systems, Lisbon, Portugal, June 9–12.
C17 Bouillot, N. and Cooperstock, J.R. (2009) Challenges and Performance of High-Fidelity Au-dio Streaming for Interactive Performances, New Interfaces for Musical Expression (NIME),Pittsburgh, June 4–6.
C18 Visell, Y., Law, A.W., and Cooperstock, J.R. (2009). Toward Iconic Vibrotactile InformationDisplay Using Floor Surfaces, Third Joint Eurohaptics Conference and Symposium on HapticInterfaces for Virtual Environment and Teleoperator Systems, Salt Lake City, UT, March18–20.
C19 El-Shimy, D., Marentakis, G., and Cooperstock, J.R. (2009) Multimodal Feedback in 3DTarget Acquisition, IEEE 3D User Interfaces, Lafayette, Louisiana, March 14–15.
C20 Ellaway, R.H., Topps, D., Lachapelle, K., and Cooperstock, J.R. (2009) Integrating Simu-lation Devices and Systems. Medicine Meets Virtual Reality (MMVR) Medical EducationConference, Long Beach, Jan. 19–22.
C21 Wang, G., Mercier, L, Collins, D.L, and Cooperstock, J.R. (2009). A Comparative Study ofMonoscopic and Stereoscopic Display for a Probe-Positioning Task. Medicine Meets VirtualReality (MMVR) Medical Education Conference, Long Beach, Jan. 19–22.
C22 Cooperstock, J.R. and Wang, G. (2009). Stereoscopic Display Technologies, Interaction Paradigms,and Rendering Approaches for Neurosurgical Visualization. Stereoscopic Displays and Appli-cations, San Jose, Jan. 18–22.
8
Publications RESEARCH
C23 Qi, Z. and Cooperstock, J.R. (2008). Depth-based Image Mosaicing for Both Static andDynamic Scenes. International Conference on Pattern Recognition (ICPR), Tampa, Dec.8–11.
C24 Law, A.W., Peck, B.V., Visell, Y., Kry, P., and Cooperstock, J.R. (2008) A Multi-modalFloor-space for Experiencing Material Deformation Underfoot in Virtual Reality. IEEE In-ternational Workshop on Haptic Audio Visual Environments and Games, Ottawa, October18–19.
C25 Benovoy, M., Zadel, M., Absar, R., Wozniewski, M., and Cooperstock, J.R. (2008). Towardsimmersive multimodal gameplay. GAMEON-NA, Montreal, Aug. 13–15.
C26 Pelletier, S. and Cooperstock, J.R. (2008). Fast image restoration with the Huber-Markovprior model, International Conference on Image Processing, San Diego, Oct. 12–15.
C27 Cupellini, E., Rizzuti, C., Bilotta, E., Pantano, P., Wozniewski, M., and Cooperstock, J.R.(2008). Exploring Musical Mappings and Generating Accompaniment with Chaotic Systems,International Computer Music Conference, Belfast, Aug. 24–29.
C28 Giordano, B.L, McAdams, S., Visell, Y., Cooperstock, J.R., Yao, H.-Y., and Hayward, V.(2008). Non-visual identification of walking grounds. Acoustics’08, Paris, June 29–July 4.
C29 Salimpoor V.N., Benovoy M., Longo G., Cooperstock J.R., and Zatorre R.J. (2008). Mu-sic and the Reward System: Characterizing Intensely Pleasurable Responses to Music, TheNeurosciences and Music – III, Montreal, June 26–28.
C30 Visell, Y., Giordano, B., Cooperstock, J.R., Franinovic, K., Law, A., McAdams, S., Jathal, K.,and Fontana, F. (2008). A Vibrotactile Device for Display of Virtual Ground Materials inWalking, EuroHaptics, Madrid, Spain, June 11–13.
C31 Bouillot, N., Wozniewski, M., Settel, Z., and Cooperstock, J.R. (2008). A Mobile WirelessPlatform for Augmented Instruments, New Interfaces for Musical Expression (NIME), June5–7, Genova, Italy.
C32 Wozniewski, M., Bouillot, N., Settel, Z., and Cooperstock, J.R. (2008). Large-Scale MobileAudio Environments for Collaborative Musical Interaction, New Interfaces for Musical Ex-pression (NIME), June 5–7, Genova, Italy.
C33 Wozniewski, M., Bouillot, N., Settel, Z., and Cooperstock, J.R. (2008). An Augmented Real-ity Framework for Wireless Mobile Performance, Mobile Music Workshop, May 13–15, Vienna,Austria.
C34 Benovoy, M., Deitcher, J., and Cooperstock, J.R. (2008). Biosignals Analysis and its Appli-cation in a Performance Setting: Towards the development of an Emotional-Imaging Genera-tor, IEEE International Conference on Bio-Inspired Systems and Signal Processing (BIOSIG-NALS), Jan. 28–31, Madeira, Portugal.
9
Publications RESEARCH
C35 Visell, Y., Cooperstock, J.R., and Franinovic, K. (2007). Toward an Architectural Platformfor Audio-Haptic Simulation in Walking. Enactive Interfaces (ENACTIVE’07), Nov. 19–25,Grenoble, France.
C36 Visell, Y. and Cooperstock, J.R. (2007). Enabling Gestural Interaction by Means of TrackingDynamical Systems Models and Assistive Feedback. IEEE Systems, Man and Cybernetics,Montreal, Oct. 7–10.
C37 Qi, Z. and Cooperstock, J.R. (2007). Automated Change Detection in an Undersea Environ-ment using a Statistical Background Model. Oceans ’07, Vancouver, Sept. 29–Oct. 4.
C38 Pelletier, S. and Cooperstock, J.R. (2007). Fast super-resolution for rational magnificationfactors. International Conference on Image Processing (ICIP), San Antonio, TX, Sept. 16–19.
C39 Qi, Z. and Cooperstock, J.R. (2007). Overcoming Parallax and Sampling Density Issuesin Image Mosaicing of Non-Planar Scenes. British Machine Vision Conference (BMVC),Warwick, Sept. 10–13.
C40 Cooperstock, J.R., Wozniewski, M., Settel, Z. (2007). Towards mobile spatial audio for dis-tributed musical systems and multi-user virtual environments. Spatial Audio for Mobile De-vices, Workshop in conjunction with International Conference on Human Interaction withMobile Devices and Services (MobileHCI), Singapore, Sept. 9.
C41 Wozniewski, M., Settel, Z. Cooperstock, J.R. (2007). AudioScape: A Pure Data library formanagement of virtual environments and spatial audio. PureData Convention, Montreal,Aug. 21–26.
C42 Audet, S. and Cooperstock, J.R. (2007). Shadow Removal in Front Projection Environmentsusing Object Tracking, IEEE Projector-Camera Systems (ProCams), Minneapolis, June 18.
C43 Visell, Y. and Cooperstock, J.R. (2007). Modeling and Continuous Sonification of Affordancesfor Gesture-Based Interfaces. International Conference on Auditory Display, Montreal, June26–29.
C44 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2007). User-specific audio rendering andsteerable sound for distributed virtual environments. International Conference on AuditoryDisplay, Montreal, June 26–29.
C45 Kinoe, Y. and Cooperstock, J.R. (2007). Peripheral Telecommunications: Supporting Dis-tributed Awareness and Seamless Transitions to the Foreground. International ConferenceOn Smart homes and health Telematics, Nara, Japan, June 21–23.
C46 Arseneau, S. and Cooperstock, J.R. (2006). An Improved Representation of Junctions throughAsymmetric Tensor Diffusion. International Symposium on Visual Computing, Lake Tahoe,Nevada, Nov. 6–8.
C47 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2006). A Paradigm for Physical Interactionwith Sound in 3-D Audio Space. International Computer Music Conference, New Orleans,Nov. 6–11.
10
Publications RESEARCH
C48 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2006). A Spatial Interface for Audio andMusic Production. International Conference on Digital Audio Effects (DAFx), Montreal,Sept. 18–20.
C49 Pelletier, S. and Cooperstock, J.R. (2006). Preconditioning for temporal video superresolu-tion. British Machine Vision Conference (BMVC), Edinburgh, Sept. 4–7.
C50 Arseneau, S. and Cooperstock, J.R. (2006). An Asymmetrical Diffusion Framework for Junc-tion Analysis. British Machine Vision Conference (BMVC), Edinburgh, Sept. 4–7.
C51 Qi, Z. and Cooperstock, J.R. (2006). Wide-Baseline Image Mosaicing for Indoor Environ-ments, International Conference on Pattern Recognition (ICPR), Hong Kong, Aug. 20–24.
C52 Cayouette, F. and Cooperstock, J.R. (2006). Generic Real-Time Tracking Method on Semi-Dynamic Scenes. International Conference on Pattern Recognition (ICPR), Hong Kong, pp.711-714, Aug. 20–24.
C53 Rudzicz, F. (2006). Clavius: Bi-Directional Parsing for Generic Multimodal Interaction. JointConference of the International Committee on Computational Linguistics and the Associationfor Computational Linguistics (COLING/ACL-06 SRW), Sydney, Australia, July 17–21.
C54 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2006). A framework for immersive spatialaudio performance. New Interfaces for Musical Expression (NIME), Paris, June 5–7.
C55 Rudzicz, F. (2006). Put a Grammar Here: Bi-Directional Parsing in Multimodal Interac-tion. ACM Conference on Human Factors in Computing Systems (CHI) Work-in-progress,Montreal, April 22–27.
C56 Cooperstock, J.R. (2005). Interacting in Shared Reality. HCI International, Conference onHuman-Computer Interaction, Las Vegas, July 22–27.
C57 Yin, J. and Cooperstock, J.R. (2005) A New Photo Consistency Test for Voxel Coloring.Canadian Conference on Computer and Robot Vision, Victoria, May 9–11.
C58 Pelletier, S., Spackman, S. and Cooperstock, J.R. (2005). High-Resolution Video Synthesisfrom Mixed-Resolution Video Based on the Estimate-and-Correct Method. IEEE Workshopon Applications of Computer Vision (WACV), Breckenridge, January 5–7.
C59 Sun, W. and Cooperstock, J.R. (2005). Requirements for Camera Calibration: Must AccuracyCome with a High Price? IEEE Workshop on Applications of Computer Vision (WACV),Breckenridge, January 5–7.
C60 Boussemart, Y., Rioux, F., Rudzicz, F., Wozniewski, M. and Cooperstock, J.R. (2004). AFramework for Collaborative 3D Visualization and Manipulation in an Immersive Space usingan Untethered Bimanual Gestural Interface. ACM Virtual Reality Software and Technology,Hong Kong, November 10–12.
C61 Woszczyk, W., Cooperstock, J., Roston, J., Martens, W. (2004) Environment for immersivemulti-sensory communication of music using broadband networks. 23rd TonmeistertagungVDT International Audio Convention, Leipzig, November 5–8.
11
Publications RESEARCH
C62 Aube, F. and Shield, R. (2004). Modeling the Effect of Leadership on Crowd Flow Dynamics.International Conference on Cellular Automata for Research and Industry. Amsterdam, Oc-tober 25–27 (also appears in Lecture Notes in Computer Science, Springer-Verlag Heidlerberg,ISSN: 0302-9743, 601–611).
C63 Rioux, F., Rudzicz, F., and Wozniewski, M. (2004). The Modellers’ Apprentice – The Tool-glass Metaphor in an Immersive Environment. British HCI Group Annual Conference. Leeds,September 6–10.
C64 Usher, J., Cooperstock, J.R., and Woszczyk, W. (2004) A multi-filter approach to acousticecho cancellation for teleconferencing. 75th Meeting of the Acoustical Society of America, NewYork, May 24–28.
C65 Hilario, M. and Cooperstock, J.R. (2004). Occlusion Detection for Front-Projected InteractiveDisplays. Pervasive Computing Vienna, April 21–23 (also appears in Advances in PervasiveComputing, Austrian Computer Society, ISBN 3-85403-176-9).
C66 Yin, J. and Cooperstock, J.R. (2004). Improving Depth Maps by Nonlinear Diffusion. 12thInternational Conference on Computer Graphics, Visualization and Computer Vision, Plzen,February, pp. 305–311.
C67 Cooperstock, J.R. (2003). Intelligent Classrooms need Intelligent Interfaces: How to Build aHigh-Tech Teaching Environment that Teachers can use? American Society for EngineeringEducation, Nashville, June.
C68 Cohen, E., Cooperstock, J.R., Kyriakakis, C. (2002). The Challenges of Archiving NetworkedBased Multimedia Performances. Acoustical Society of America, Cancun, December.
C69 Yao, J. and Cooperstock, J.R. (2002). Arm Gesture Detection in a Classroom Environment.IEEE Workshop on Applications of Computer Vision (WACV), Orlando, December.
C70 Arseneau, S. and Cooperstock, J.R. (2002). Automated Feature Registration for RobustTracking Methods, IEEE International Conference on Pattern Recognition, Quebec City, Au-gust.
C71 Cooperstock, J.R. and Spackman, S. (2001). The Recording Studio that Spanned a Conti-nent. IEEE International Conference on Web Delivering of Music (WEDELMUSIC), Flo-rence, November, pp. 161–167.
C72 Arseneau, S., Sun, W., Zhao, C., and Cooperstock, J.R. (2000). Inter-layer Learning TowardsEmergent Cooperative Behavior. American Association of Artificial Intelligence 17th AnnualConference, Austin, Texas, pp. 3–8.
C73 Hochstein, L., Lerner, S., Clark, J.J and Cooperstock, J.R. (2000). Soccer-Swarm: A Graph-ical Framework for Soccer-Player Design. International Symposium on Robotics. Montreal,QC, pp. 108–113.
12
Publications RESEARCH
C74 Xu, A. and Cooperstock, J.R. (2000). Real Time Streaming of Multi-Channel Audio throughInternet. 108th Audio Engineering Society Convention, Paris, France. [14 pages in CD-ROMProceedings]
C75 Blatter, J. Cooperstock, J.R., and Harris, R. (1999). Designing Tools, Designing LearningOpportunities: Issues in Developing a CSCL System for the Technical Communication Class-room. Computer Supported Cooperative Learning, Stanford, CA, December.
C76 Arseneau, S. and Cooperstock, J.R. (1999). Presenter Tracking in a Classroom Environment.IEEE Industrial Electronics (IECON’99), Session on Cooperative Environments, Vol. 1, pp.145–148.
C77 Arseneau, S. and Cooperstock, J.R. (1999). Real-Time Image Segmentation for Action Recog-nition. IEEE Pacific Rim Conference on Communications, Computers and Signal Processing(PACRIM’99), Victoria, B.C., Canada, pp. 86–89.
C78 Cooperstock, J.R. (1997). Rethinking the Remote Control. HCI International, Conferenceon Human-Computer Interaction, San Francisco, pp. 116.
C79 Cooperstock, J.R. (1997). From the Flashing 12:00 to a Usable Machine: Applying UbiCompto the VCR. ACM Conference on Human Factors in Computing Systems (CHI), Atlanta, pp.281–282.
C80 Yamaashi, K, Cooperstock, J.R., Narine, T., and Buxton, W. (1996). Beating the Limitationsof Camera-Monitor Mediated Telepresence with Extra Eyes. ACM Conference on HumanFactors in Computing Systems (CHI), Vancouver, pp. 50–57.
C81 Cooperstock, J.R. and Kotsopoulos, S. (1996). Why Use a Fishing Line When You Have aNet? An Adaptive Multicast Data Distribution Protocol. USENIX. San Diego, pp. 343–352.
C82 Tsotsos, J.K., Dickinson, S., Jenkin, M., Milios, E., Jepson, A., Down, B., Amdur, E., Steven-son, S., Black, M., Metaxas, D., Cooperstock, J., Culhane, S., Nuflo, F., Verghese, G., Wai,W., Wilkes, D., and Ye, Y. (1995). The PLAYBOT Project. IJCAI Workshop on AI Appli-cations for Disabled People, Montreal.
C83 Cooperstock, J.R., Tanikoshi, K., Beirne, G., Narine, T., and Buxton, W. (1995). Evolutionof a Reactive Environment. ACM Human Factors in Computing Systems (CHI), Denver, pp.170–177.
C84 Cooperstock, J.R. (1995). Making the User Interface Disappear: The Reactive Room. IBMCenter for Advanced Studies (CASCON), Toronto, pp. 241–250.
C85 Gujar, A., Daya, S., Cooperstock, J.R., Tanikoshi, K., and Buxton, W. (1995). Talking YourWay Around a Conference: A speech interface for remote equipment control, IBM Center forAdvanced Studies (CASCON), Toronto, pp. 289.
C86 Cooperstock, J.R., Tanikoshi, K., and Buxton, W. (1995). Turning Your Video Monitor intoa Virtual Window. IEEE Pacific Rim Conference on Communications, Computers, Visual-ization and Signal Processing (PACRIM), Victoria, May 17–19.
13
Publications RESEARCH
C87 Cooperstock, J.R. and Kotsopoulos, S. (1995). Exploiting Group Communications for Re-liable High Volume Data Distribution. IEEE Pacific Rim Conference on Communications,Computers, Visualization and Signal Processing (PACRIM), Victoria, May 17–19.
C88 Chou, A., Cooperstock, J.R., El-Yaniv, R., Klugerman, M., and Leighton, T. (1995). TheStatistical Adversary Allows Optimal Money-Making Trading Strategies. ACM-SIAM Sym-posium on Discrete Algorithms (SODA), pp. 467–476.
C89 Cooperstock, J.R. and Milios, E. (1993). An Efficiently Trainable Neural Network BasedVision-Guided Robot Arm. IEEE Robotics and Automation, Atlanta, Vol. 2, pp. 738–743.
C90 Cooperstock, J.R. and Milios, E. (1993). Self-Supervised Learning for Docking and TargetReaching. Intelligent Autonomous Systems, Pittsburgh, pp. 582–591.
C91 Cooperstock, J.R. and Milios, E. (1992). Adaptive Neural Networks for Vision-Guided Posi-tion Control of a Robot Arm. IEEE Intelligent Control, Glasgow, pp. 397–403.
C92 Cooperstock, J.R. and Milios, E. (1992). Neural Network Control for a Vision-Guided MobileRobot Arm. IASTED Control and Robotics, Vancouver pp. 278–281.
Patents
P1 Floor-based haptic communication system. Cooperstock, J.R., Visell, Y., Law, A., and Frani-novic, K. United States Provisional Patent Application Number US 61/184015 submitted onJune 4, 2009, US Patent Application Number 12/794,045 filed June 4, 2010.
P2 Binocular vision assessment and/or therapy. Cooperstock, J.R., To, L., and Hess, R. UnitedStates Patent Application 12/772,162, filed April 30, 2010.
P3 Remote Sign Language Interpretation. Roston, J., Cooperstock, J.R., MacDougall, J., andSpackman, S., Report of Invention submitted to Office of Technology Transfer, McGill Uni-versity, February 2003; US patent 7395200 subsequently issued to Roston J.
P4 Method and Apparatus for Coding Spatial Data. Cooperstock, J.R., Zhang, Y., and Spackman, S.Provisional patent application filed Dec. 17, 2001 (subsequently abandoned)
P5 High-resolution Video Synthesis. Canadian patent application 2,435,791 filed July 24, 2003.Spackman, S., Pelletier, S., and Cooperstock, J.R. (subsequently abandoned)
P6 A robust person tracking method and system. U.S. Provisional patent application filed Sept.20, 2000. Cooperstock, J.R. and Arseneau, S.
P7 Universal Remote Control. (Orientation-sensitive control with speech recognition). Patentapplication submitted by Sony Corp., Japan. Cooperstock, J.R.
P8 Pixel Count-Sensitive PDA Tool Mechanism with Cut/Paste and/or Copy/Paste Function.P09-022797. Patent filed in Japan by Sony Corp., Japan. Feb. 5, 1997. Cooperstock, J.R.
14
Non-refereed Contributions RESEARCH
Other Refereed Contributions
O1 Visell, Y., Millet, G. and Cooperstock, J.R. (2010). Haptic Display via a Vibrating, RigidSurface, Demonstration in IEEE Haptics Symposium, March 25-26, Waltham, MA.
O2 Law, A. Ip, J., Peck, B., Visell, Y., Kry, P. and Cooperstock, J.R. (2009). A MultimodalFloor for Virtual Environments, SIGGRAPH Emerging Technologies, Aug. 3–7.
O3 Salimpoor, V.N., Benovoy, M., Longo, G., Larcher, K., Dagher, A., Cooperstock, J.R., andZatorre, R.J. (2009). The Rewarding Aspects of Music Listening Involve the DopaminergicStriatal Reward Systems of the Brain: An Investigation with [C11]Raclopride PET and fMRI,Poster presentation in 15th Annual Meeting of the Organization for Human Brain Mapping,San Francisco, June, 18–23.
O4 Salimpoor V.N., Benovoy M., Longo G., Cooperstock, J.R., and Zatorre R.J. (2008) Qualify-ing the Chills Response: Differences between Transient and Prolonged Chills in Response toMusic. Auditory Perception, Cognition, and Action Meeting, Chicago.
O5 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2007). Menagerie Imaginaire. ArtworkPerformance in New Interfaces for Musical Expression (NIME), New York, June 6–10.
O6 Cooperstock, J.R. (2005). Novel Video Encoding Algorithms for Remote Monitoring and Dis-tributed Human-Human Interaction. 8th International Symposium on Artificial Intelligence,Robotics and Automation in Space, Munich, September 5–8.
O7 Cote C., Arseneau, S. and Cooperstock, J.R. (2001). Telepresence with no Strings Attached:An Architecture for a Shared Reality Environment. International Symposium on Mixed Re-ality, Yokohama, March.
O8 Winer, L.R. and Cooperstock, J.R. (2001). The “Intelligent Classroom”: Changing teachingand learning with an evolving technological environment. Computers and Learning, Coventry,UK, April.
O9 Arseneau, S. and Cooperstock, J.R. (2000). Automated Camera Tracking in a Real-WorldEnvironment. Graphics Interface, Montreal.
O10 Saroyan, A., Harris, R., and Cooperstock, J. (2000). Applying pedagogical principles toteaching and learning with technology. Multi-cultural perspectives on the use of technology ineducation, Montreal. http://www.education.mcgill.ca/NAFTA
Non-refereed Contributions
N1 Benovoy, M., Cooperstock, J.R., and Levine, M. (2010) Real-Time Facial Recognition. PhaseII Project Report for Department of National Defence.
N2 Levine, M., Cooperstock, J.R., and Benovoy, M. (2009) An Automatic Real-Time FacialRecognition System. Phase I Project Report for Department of National Defence.
15
Public Awareness RESEARCH
N3 Roston, J., Bradley, C., and Cooperstock, J.R. (2007) Underwater Window: High DefinitionVideo on VENUS and NEPTUNE. Oceans 2007, Vancouver, Sept. 29–Oct. 4. (Invited.)
N4 Cooperstock, J.R. (2006). Plus de largeur du bande, s’il vous plaıt. Oral presentation insession on L’interdiscplinarite dans les sciences et technologies de la musique. Associationfrancophone pour le savoir (ACFAS), Montreal, May 17.
N5 Cooperstock, J.R. (2005). Integrating Communication with Interaction: Computer VisionChallenges for Interactive and Intelligent Environments. Workshop on Computer Vision forInteractive and Intelligent Environments (CV4IIE), Lexington, KY, November 17–18. (In-vited.)
N6 Cooperstock, J.R., Roston, J., Woszczyk (2004). Broadband Networked Audio: Entering theEra of Multisensory Data Distribution. 18th International Congress on Acoustics, Kyoto,April 4–9. (Invited.)
N7 Cayouette, F., Sud, D., Patel, K., Sarikaya, D., and Cooperstock, J.R. (2002). McGill Red-dogs RoboCup 2002 Final Report.
N8 Cooperstock, J.R., (2001). Classroom of the Future: Enhancing Education through Aug-mented Reality. HCI International, Conference on Human-Computer Interaction, New Or-leans. (Invited.)
N9 Sud, D., Cayouette, F., Gu, J., and Cooperstock, J.R. (2001). McGill Reddogs RoboCup 2001Final Report.
Public Awareness
Research Demonstrations
D1 Distributed Musical Practice and Performance, I Medici di McGill, Oscar Peterson Hall,Montreal, April 28, 2008.
D2 Wide Screen Window on the World: Life Size HD Videoconferencing. Supercomputing 2005,Bandwidth Challenge, Seattle, November 16, 2005.
D3 Streaming DSD Audio comes to the AES. Audio Engineering Society 117th Convention, SanFrancisco, October 31, 2004.
D4 Cross-continental low-latency ultra-videoconferencing. McGill-Stanford jazz jam, June 13,2002.
D5 Remote master’s class using SDI video and multichannel audio. McGill-National ResearchCouncil session with Pinchas Zukerman, March 25, 2002.
D6 SDI video and multichannel audio. CANARIE’s 7th Advanced Networks Workshop, Toronto,November 28, 2001.
16
Public Awareness RESEARCH
D7 Low-latency distributed violin duet in full-frame video. RISQ 2001 Conference, Montreal,November 5, 2001.
The Globe and Mail noted that “Cooperstock’s demonstration was a watershed event forthe elite club of the world’s computer network engineers. No one had ever before been ableto demonstrate that, under the right conditions, it is possible for natural, normal humaninteraction to occur over the Internet.”
D8 The Recording Studio that Spans a Continent. Audio Engineering Society 109th Convention,Los Angeles, September 23, 2000.
The Audio Engineering Society noted that this “Landmark demonstration shows cost effec-tive and high performance transmission systems for high quality 24-bit, 96kHz uncompressedmulitchannel audio are on horizon”
D9 Dolby Digital 5.1 audio with MPEG-2 video around the world. Internet Global Summit INET2000 Conference, Yokohama, July 20, 2000.
CBC Radio noted that “McGill University in Montreal has made Internet history by settingup the first intercontinental netcast of a live concert in surround sound and full-screen video.”
D10 Dolby Digital 5.1 audio with MPEG-2 video. CANARIE’s 5th Advanced Networks Workshop,Toronto, November 29, 1999.
D11 First real-time Multichannel Audio Internet demo. Audio Engineering Society 107th Conven-tion, New York, September 26, 1999.
The Learning Technologies Networked noted that “The performance marked the first real timemultichannel audio Internet transmission, a feat made possible by software developed at McGillUniversity by a team under the leadership of Professor Jeremy Cooperstock.”
Invited Talks
T1 “Around the World in 80 ms.” Panel presentation in Workshop of the Audio EngineeringSociety Convention, San Francisco, November 5, 2010.
T2 “UltraVideo and Virtual Presence: A Video Perspective.” Presentation on Teaching in Dis-tributed Performance, Tromsø, Norway, October 15, 2010.
T3 “Future Interfaces for Audio.” Panel presentation in Workshop of the Audio EngineeringSociety Convention, New York, October 10, 2009.
T4 “World Opera Technologies and Tests”, Danish Sound Technology Network, Aalborg Univer-sity, June 8, 2009.
T5 “This is your brain on Shared Reality: Toward perceptually convincing computed-mediatedenvironments”, Simula Lab, Oslo, May 15, 2009.
T6 “The Montreal World Opera Experiments”. Presentation at the World Opera Symposium,Struer, Denmark, May 12, 2009.
17
Public Awareness RESEARCH
T7 “Audio-Visual-Haptic-Tactile: Putting them all together for an engaging immersive experi-ence”. Panel presentation in Workshop of the Audio Engineering Society Convention, Munich,Germany, May 10, 2009.
T8 “New Technologies for Audio over IP”. Panel presentation in Workshop of the Audio Engi-neering Society Convention, Munich, Germany, May 10, 2009.
T9 “This is your brain on Shared Reality: Toward perceptually convincing computed-mediatedenvironments”, Ambient Intelligence Group, CITEC, Bielefeld University, May 6, 2009.
T10 “Distributed and Multimodal Interaction in Virtual and Augmented Reality Environments”,McGill University, School of Physical and Occupational Therapy, November 25, 2008.
T11 “A Platform to Create and Support Ocean Science Virtual Organizations (Oceans 2.0)” and“HSVO Health Services Virtual Organization”, RISQ 2008 Colloquium, Montreal, November14, 2008.
T12 “Shared Reality: Effective Interaction for (Demanding) Distributed Tasks”, University ofVictoria, September 16, 2008.
T13 “The Future of VC: Music Teaching and High Fidelity Video”, Elevate 2008: Reaching NewHeights in Educational Video-conferencing, Banff, August 27–28, 2008.
T14 “Bidirectional video communication for real-time applications”, Institut fur Telematik, Uni-versity of Lubeck, Germany, May 15, 2008.
T15 “Shared Reality: Effective Interaction for (Demanding) Distributed Tasks”, Aalborg Univer-sity, Esbjerg, Denmark, May 14, 2008.
T16 “Distributed Multimodal Interaction”, Bang & Olufsen, Struer, Denmark, May 13, 2008.
T17 “Creating an immersive video space”, International Symposium on The World Opera: Whenthe Opera stage becomes worldwide, Tromsø, Norway, May 9, 2008.
T18 “Distributed Musical Practice and Performance”, Biology and Music Lecture, I Medici diMcGill, April 28, 2008.
T19 “Multimodal Streaming and Distributed Audio Interaction”, High Quality Audio over Net-works (ANET II) Summit, Banff Centre, April 12, 2008.
T20 “Shared Reality: Effective Interaction for (Demanding) Distributed Tasks”, Arts, Media andEngineering, Arizona State University, February 29, 2008
T21 “Music and Games: How Fun Applications Stimulate Core Technologies”, Canadian Univer-sity Software Engineering Conference, January 19, 2008.
T22 “From Videoconferencing to Shared Reality.” Department of Electrical and Computer Engi-neering, University of British Columbia, October 4, 2007.
18
Public Awareness RESEARCH
T23 “From Teleoperation to Teleimmersion: Design Challenges for Distributed Interaction”, Cana-dian University Software Engineering Conference, January 19, 2007.
T24 “CANARIE sur UCLP et ROADM, deux technologies qui changent le monde des telecoms”,Round Table panel, RISQ Annual Conference, Quebec City, October 16, 2006.
T25 “La recherche sur en ultra-videoconference”, Panel on “Vitrine technopedagogique sur lavideoconference”, RISQ Annual Conference, Quebec City, October 16, 2006.
T26 “Video Processing Challenges for Intelligent Interactive Environments”, Workshop on Com-puter Vision for Intelligent Interactive Environments”, Lexington, Kentucky, November 17–18,2005.
T27 “Broadband transmission of multimodal content at the Centre for Interdisciplinary Researchin Music Media and Technology (CIRMMT)”, RISQ-CA*net4 Advanced Networking Day,Montreal, October 24, 2005.
T28 “Low-Latency Ultra-Videoconferencing and Shared Reality.” Interfaces Montreal, Rencontredu Genie numerique et des Affaires. Montreal, October 11, 2005.
T29 “Shared Spaces.” Asia-Pacific Advanced Networks (APAN) Conference, Taipei Aug. 22–27,2005.
T30 “Engaging Technolog(ies) for Effective Interaction.” Keynote speaker. World Conference onEducational Multimedia, Hypermedia and Telecommunications, Montreal, June 29, 2005.
T31 “Broadband Distance Education in 2007: Views from the Demand Side.” Invited Panelist.World Conference on Educational Multimedia, Hypermedia and Telecommunications, Mon-treal, June 29, 2005.
T32 “Ultra-Videoconferencing and Intelligent Classrooms.”’ Keynote speaker. Canadian HigherEducation and Information Technology Conference, Montreal, June 28, 2005.
T33 “Engaging Technolog(ies) for Effective Interaction.” Department of Computer Science, He-brew University of Jerusalem, April 19, 2005.
T34 “Engaging Technolog(ies) for Effective Interaction.” Intelligence, Agents, Multimedia Group,University of Southampton, UK, March 7, 2005.
T35 “From Videoconferencing to Shared Reality.” l’Institut de Recherche et Coordination Acous-tique/Musique (IRCAM), Paris, November 25, 2004.
T36 “From Videoconferencing to Shared Reality.” Bell University Laboratories’ Annual Confer-ence, Toronto, November 3, 2004.
T37 “History of Internet Audio Experiments at McGill.” High Quality Audio over Networks(ANET) Summit, Banff Centre, August 20–22, 2004.
T38 “From Videoconferencing to Shared Reality.” Taiyuan University, Taiyuan, China, April 18,2004.
19
Public Awareness RESEARCH
T39 “From Videoconferencing to Shared Reality.” Tsighua University, Beijing, China, April 14,2004.
T40 “From Videoconferencing to Shared Reality.” Beijing University, Beijing, China, April 14,2004.
T41 “From Videoconferencing to Shared Reality.” Beihan University, Beijing, China, April 12,2004.
T42 “From Videoconferencing to Shared Reality.” Advanced Telecommunications Research (ATR),Nara, Japan, April 9, 2004.
T43 “From Videoconferencing to Shared Reality.” Dept. of Industrial Engineering, Musashi Insti-tute of Technology, April 5, 2004.
T44 “Advanced Video Applications: Developments in Extreme Video.” Southeastern UniversitiesResearch Association Video Development Initiative (SURA/ViDe) 6th Annual Digital VideoWorkshop. Indianapolis, March 24, 2004.
T45 “High-fidelity telepresence.” Graphics and Geometric Computing Seminar Series, Technion –Israel Institute of Technology, January 1, 2003.
T46 “The Democratic Revolutions – Peer to Peer Meets Open Source: Design, Philosophy, Engi-neering.” Intimate Technologies/Dangerous Zones. Banff New Media Institute, Banff Centre,April 27, 2002.
T47 “The Development of Ultra VC Applications and Technology.” Southeastern UniversitiesResearch Association Video Development Initative (SURA/ViDe) 4th Annual Digital VideoWorkshop. University of Alabama at Birmingham, April 25, 2002.
T48 “The Virtual Studio.” Royal Conservatory of Music, Toronto, February 25, 2002.
T49 “Building a Shared Reality.” Department of Computer Science, University of Toronto, Febru-ary 25, 2002.
T50 “Distributed Concerts and Shared Reality: Just how much streamed data and computationdo we need to support effective interaction?” Department of Computer Science, ClarksonUniversity, November 1, 2001.
T51 “High quality wide-screen SDI video and multichannel audio over CA*net3.” CANARIE’s7th Advanced Networks Workshop, Toronto, November 28, 2001.
T52 “Low-latency comes to videoconferencing: The Freres Jacques duet at a distance.” RISQ2001 Conference, Montreal, November 5, 2001.
T53 Advanced Networking and the Arts: Innovations in Outreach, Collaboration, and Perfor-mance. Panel Discussion at Internet Global Summit INET 2001 Conference, Stockholm, June6, 2001.
20
Public Awareness RESEARCH
T54 “The McGill - Calgary Advanced Learnware Network.” CANARIE’s 6th Advanced NetworksWorkshop, Montreal, November 29, 2000.
T55 “Networks and Music Instruction.” Panel Discussion with Pinchas Zukerman and WieslawWoszczyk, CANARIE’s 6th Advanced Networks Workshop, Montreal, November 29, 2000.
T56 “Tools for Distributed VR.” Canadian Working Group on Virtualized Reality Systems, Mon-treal, November 28, 2000.
T57 “Evolution of the Intelligent Classroom.” Multicultural Perspectives on the use of Technologyin Education. Montreal, October 2, 2000.
T58 The Brave New World of Ubiquitous Bandwidth.” Internet Global Summit INET 2000 Con-ference, Yokohama, July 20, 2000.
T59 “Multichannel Audio over the Internet: The Next Phase.” RISQ 2000 Conference, May 31,2000.
T60 “Robotics and Design.” Round Table Panel, Centre Design UQAM, February 9, 2000.
T61 “Multichannel Audio over the Internet.” CANARIE’s 5th Advanced NetworksWorkshop,Toronto, November 29, 1999.
T62 “The Shared Reality Environment.” Department of Electrical and Computer Engineering,Ecole Polytechnique, Montreal, May 28, 1999.
T63 “When Telemedicine feels like Regular Medicine.” Communications and Information Tech-nology Ontario (CITO) Healthcare for the Future:Telemedicine, February 18, 1999.
Media Exposure
M1 Global TV (National), Jan. 29, 2009
M2 Global TV (Montreal), Jan. 27, 2009
M3 CBC Radio, As it Happens, Jan. 27, 2009
M4 National Post, Jan. 27, 2009
M5 Montreal Gazette, Jan. 27, 2009
M6 Montreal Gazette, Feb. 20, 2009
M7 Inside Higher Education, Sept. 3, 2008
M8 CBC Radio (Daybreak), Sept. 3, 2008
M9 CJAD radio, Sept. 2, 2008
M10 Cabling Networing Systems, Jan. 2006
M11 McGill Reporter, Nov. 24, 2005
M12 CTV Quebec, Global News, Dec. 23, 2002
M13 New York Times, Technology Section, Dec. 19, 2002
21
Public Awareness RESEARCH
M14 Discovery Channel, Daily Planet, Oct. 30, 2002
M15 CFCF (CTV Quebec) Global News, June 19, 2002
M16 National Post, June 15, 2002
M17 CBC Television, The National, May 3, 2002
M18 McGill Reporter, Learning the Strings, April 11, 2002
M19 Ottawa Citizen, March 29, 2002
M20 Montreal Gazette, March 27, 2002
M21 Globe & Mail, Dec. 1, 2001
M22 Canal Z, La Revanche des Nerdz, Nov. 13, 2001
M23 Montreal Gazette, Nov. 10, 2001
M24 CJAD Radio, The World Today, July 31, 2001
M25 McGill Reporter, April 5, 2001
M26 Globe & Mail Report on Business, Oct. 28, 2000
M27 TQS Double Clic!, Oct. 7, 2000
M28 McGill Reporter, Sept. 21, 2000
M29 UPath.com, Vol 40, 2000
M30 CBC (Montreal) Home Run, Aug. 22, 2000
M31 Montreal Gazette, Aug. 22, 2000
M32 CFCF (CTV Quebec) Pulse News, Aug. 21, 2000
M33 CBC Radio The Arts Report, July 20, 2000
M34 Elle Quebec, June 2000
M35 Journal Le Monde des Affaires, May 2000
M36 Canal Z, Technofolie, May 3, 2000
M37 TQS Double Click, April 29, 2000
M38 McGill Reporter, April 6, 2000
M39 Briefing Digital, April 2000
M40 Interface: La Revue de la Recherche, Vol. 21, No. 2, March-April 2000
M41 American Society of Mechanical Engineers, Mechanical Advantage, Vol 9, No 3, March 2000
M42 Canal Z, La Revanche des Nerdz, Feb. 2000
M43 CFCF (CTV Quebec) Pulse News, Feb. 29, 2000
M44 Canal Vox: CityMag, Jan. 15, 2000
M45 Montreal Mirror, Jan. 6, 2000
M46 Plan Mega: La revue du genie quebecois, Ordre des ingenieurs du Quebec. Vol 1, Jan. 2000
M47 Radio Corporation of Singapore: Science and Technology Watch, Dec. 1999
22
Public Awareness RESEARCH
M48 Radio Canada (CBC French) Les Annees lumiere, Nov. 28, 1999
M49 Financial Times Life/Technology, Nov. 25, 1999
M50 CBC Radio: As it Happens, Nov. 22, 1999
M51 Journal de Montreal, Nov. 19, 1999
M52 Le Devoir, Nov. 18, 1999
M53 TVA CyberClub, Nov. 13, 1999
M54 La Presse, Sept. 26, 1999
M55 CJAD Radio, April 11, 1999
M56 Montreal Mirror, April 8, 1999
M57 McGill Reporter, Jan. 14, 1999
M58 High-Tech Shower International, Nov. 26, 1997
M59 CBC Newsworld “Futureworld”, Oct. 5, 1996
M60 Discovery Channel, Sept. 18, 1996
M61 Toronto Star, Sept. 15, 1996
M62 University of Toronto Varsity, Sept. 3, 1996
M63 TV Ontario “Studio Two”, June 26, 1995
23
Supervision RESEARCH
Supervision
Research Professionals
Name Period Tasks Present PositionChen, Guangyi Jan. 2010 –
Jul. 2010research associate under Canarie NEP
Dansereau, Don June 2009 –Jan. 2010
research associate under FQRNT grant Ph.D. student,UNSW, Australia
To, Long Jan. 2009 –present
research associate under NSERC I2I
Blum, Jeff Oct. 2008 –present
research assistant under MSG project
Olmos, Adriana Sept. 2008 –present
user interface engineer under CanarieNEP
Sun, Haijian Sept. 2008 –Oct. 2010
computer engineer under Canarie NEP programmer, Des-jardins
Soukhodolski, I. Oct. 2005 –Dec. 2007
web services programmer under CanarieIIP
consultant
Kiewe, Howard Oct. 2005 –Dec. 2007
user interface developer under CanarieIIP
consultant
Spackman, S. 2000 – 2006 research associate on Canarie and VRQprojects
Quantum Corpora-tion, San Jose
Sarikaya, Deniz 2003 – 2004 research assistant on VRQ projects deceasedSoucy, Gilbert 1999 research associate on CFI project Imaging Special-
ist, 36pix Inc.,Montreal
24
Supervision RESEARCH
Post-doctoral Fellows
Name Period Tasks (Funding Program) Present PositionPelletier, S. Jan. 2011 –
presentParallax Barrier Display rendering soft-ware optimization (NSERC ENGAGE)
Otis, Martin Jan. 2010 –Dec. 2010
Natural Interactive Walking Asst. Professor,U. Quebec aChicoutimi
Millet, G. Nov. 2009 –present
Natural Interactive Walking
Bouillot, Nicolas Oct. 2009 –present
Open Orchestra (Canarie NEP-2Project)
Pelletier, S. Nov. 2009 –Jun. 2010
Real-time Image-based Rendering (Ca-narie NEP)
(see above)
Darolti, Cristina Jan. – Dec.2009
Real-time Image-based Rendering (Ca-narie NEP)
Patent Examiner,EPO, The Hague
Bouillot, Nicolas 2007 – 2009 Mobile Audio Interaction (NSERC NewMedia Initiative)
(see above)
Wang, Guangyu 2007 –present
Neurosurgical Visualization (NSERCStrategic Grant)
Wang, Yan 2002 – 2003 Channel and spatial view allocation forvideoconferencing (VRQ)
V.P. Marketing,AMH Canada
25
Supervision RESEARCH
Ph.D. Students
Name Period Thesis title Present PositionGhourchian, N. Jan. 2010 –
presentAffective Evaluation (McGill Engineer-ing Doctoral Award Student)
El-Shimy, D. Jan. 2009 –present
Gestural interaction for complex tasks(NSERC PGSD Scholarship Student)
Benovoy, M. Oct. 2007 –Aug. 2010
Biosignals analysis and pattern recog-nition (NSERC PGSD Scholarship Stu-dent)
transferred to an-other group
Visell, Yon Sept. 2005 –present
Walking on virtual ground: physics,perception, and interface design
Qi, Zhi Jan. 2004 –Dec. 2008
Towards dynamic mosaic generationwith robustness to parallax effects
Assistant Professor(EE), SoutheastUniversity, China
Pelletier, S. Jan. 2003 –Oct. 2009
Acceleration methods for image super-resolution
Yin, Jianfeng Sept. 2000 –Aug. 2008
Toward an Alternative Approach toMulti-Camera Scene Reconstruction
Component designengineer, Intel
Sun, Wei 2002 – 2006 Multi-camera Object Segmentation inDynamically Textured Scenes UsingDisparity Contours
Intel Corporation,Santa Clara
Cayouette, F. 2003 – 2006 (NSERC Scholarship – withdrew fromprogram)
Programmer, Arti-ficial Mind & Move-ment, Montreal
Arseneau, S. 2000 – 2006 Representing Junctions through Asym-metric Tensor Diffusion
Chief Engineer forR&D, Laser Shot,Houston
Additional Ph.D. Supervisory Service
I co-supervised a portion of the thesis work of the following students:
• Grond, F.. (Jul.-Dec. 2010), visiting student from Bielefeld University, Germany
• Zambon, S.. (Jul.-Oct. 2010), visiting student from Verona University, Italy
• Cirio, G. (Jun.-Aug. 2010), visiting student from INRIA-IRISA, France
• Rizutti, C. (Sep.-Oct. 2008), visiting student from Universita della Calabria, Italy
• Bossi, E. (Sep.-Oct. 2008), visiting student from Universita della Calabria, Italy
• Pellerin, R. (Jun.-Sep. 2008), visiting student from Conservatoire Nationale des Arts etMetiers, France
• Cupellini, E. (Jul.-Aug. 2007), visiting student from Universita della Calabria, Italy
• Usher, J. (2003-2004), Ph.D. student, Faculty of Music, McGill University
• Mohammadi, M. (Feb.-Aug. 2004). visiting student from Sharif University, Iran
26
Supervision RESEARCH
I served as external reviewer of the following theses:
• Alexandre Plouznikoff, Ecole Polytechnique de Montreal (2009)
• Xiaoyong Sun, School of Information Technology and Engineering, University of Ottawa(2007)
• Nicolas Bouillot, Conservatoire Nationale des Arts et Metiers, France (2006)
• Harold Okai-Tettey, Computer Science, Rhodes University, South Africa (2006)
I served on the supervisory and/or examination committees of the following students:
• Andrew Phan, Department of Electrical and Computer Engineering
• Cory McKay, Faculty of Music
• Vanessa Yarmechuk, Faculty of Music
• Dante De Nigris Moreno, Department of Electrical and Computer Engineering
• Mark Zadel, Faculty of Music
• Sean Olive, Faculty of Music
• Marc Boule, Department of Electrical and Computer Engineering
• Charles-Antoine Julien, Grad. School of Library and Information Studies
• Adam Finkelstein, Department of Educational Psychology and Counselling
• Zahir Albadawi, Department of Mechanical Engineering
• Paul Haroun, School of Computer Science
• Jason Corey, Faculty of Music
• Dale Stammen, Faculty of Music
• Carmen Au, Department of Electrical and Computer Engineering
• Jun Ouyang, Department of Electrical and Computer Engineering
• Wei Chu, Department of Electrical and Computer Engineering
• Vincent Levesque, Department of Electrical and Computer Engineering
• Jerome Pasquero, Department of Electrical and Computer Engineering
• Rui Ma, Department of Electrical and Computer Engineering
• Dingrong Yi, Department of Electrical and Computer Engineering
• Ala Qumsieh, Department of Electrical and Computer Engineering
• Harkirat Sahambi, Department of Electrical and Computer Engineering
• Muhua Li, Department of Electrical and Computer Engineering
• Yick Kei Wong, Department of Electrical and Computer Engineering
• Oliver Astley, Department of Electrical and Computer Engineering
• Edouard Antoniou, Department of Electrical and Computer Engineering
• Wei Sun, Department of Electrical and Computer Engineering
27
Supervision RESEARCH
Masters Students
Name Period Thesis title Present PositionViswanathan, R. Jan. 2010 –
presentGesture Prediction for Video Encoding
Knight, Trevor Jan. 2010 –present
Signal Analysis for Open Orchestra
Li, Weizhong Sept. 2008 –May 2009
(recommended alternative supervision)
Ip, Jessica Sept. 2008 –present
An Augmented Reality Prototype forInteractive Play in a Virtual and Phys-ical Environment
El-Shimy, D. Sept. 2007 –Dec. 2008
Gestural interaction for complex tasks (reclassified asPh.D. student)
Law, A. Sept. 2007 –Sept. 2010
A Vibrotactile Floor for Enabling Inter-action through Virtual Walking Spaces
Applications Engi-neer, Lumerical So-lutions, Vancouver
Benovoy, M. Sept. 2006 –Oct. 2007
Biosignals analysis and its applicationin a performance setting
(reclassified asPh.D. student)
Audet, Samuel 2005-2007 Shadow Removal from Multi-ProjectorDisplays via Three-Dimensional Mod-eling and Object Tracking (NSERCScholarship student)
Ph.D. student,Tokyo Institute ofTechnology, Japan
Wozniewski, M. 2003-2006 A framework for interactive three-dimensional sound and spatial audioprocessing in a virtual environment
research engineerat la Societe desarts technologiques,Montreal
Rudzicz, Frank 2004-2006 CLAVIUS: Understanding LanguageUnderstaing in Multimodal Interaction(FQRNT Scholarship student)
Ph.D. student, Uni-versity of Toronto
Rioux, Francois 2003-2005 Software Framework for Parsing andInterpreting Gestures in a MultimodalVirtual Reality Context (NSERC Schol-arship student)
Ph.D. student,Laval University
Chan, Siu-Chi 2002-2005 Hand and Fingertip Tracking for Ges-ture Recognition
Software Developer,IBM Toronto Soft-ware Laboratory
Hilario, Nadia 2002-2005 Occlusion Detecion in Front Projec-tion Environments based on Camera-Projector Calibration (FCAR Scholar-ship student)
Software Developer,CAE
Perez, Michael 2002-2005 A Study of Multimodal Human-Computer Interaction for a PublicKiosk System
Programmer, Medi-cal Industry
Sud, Daniel 2002-2005 Design of a Multi-Projector DisplaySystem
Programmer, Arti-ficial Mind & Move-ment, Montreal
28
Supervision RESEARCH
Masters Students (cont.)
Name Period Thesis title Present PositionBoussemart, Y. 2002-2005 Design and Implementation of Frame-
work for Immersive Environments in aShared Context
Ph.D. student, MIT
Pelletier, S. 2001-2003 High-Resolution Video Synthesis fromMixed-Resolution Video Based on theEstimate-and-Correct Method
(see above)
Gu, Jinhua 2000-2002 A distributed software architecture forthe Shared Reality Environment.
Assistant VP, Ra-dian Asset Assur-ance Inc., NY
Yao, Jie 2000-2002 Human Arm Gesture Detection andRecognition in a Classroom Environ-ment.
Ph.D. student,Concordia Univer-sity
Zhang, Yuan 2000-2002 An efficient coding method for spatialdata: the rotating, hierarchical, over-lapping representation.
Ph.D. student, Uni-versity of Delaware
Doutriaux, S. 1998-1999 (withdrew in 1999 to launch start-up company)Arseneau, S. 1998-2000 Robust Image Segmentation Towards
an Action Recognition Algorithm.(see above)
Xu, Aoxiang 1998-2000 A High-Performance Audiovisual Com-munication System.
Software engineer,Lumenera Corpora-tion, Ottawa
Additional Masters Supervisory Service
I co-supervised a portion of the thesis work of the following students:
• Mabire, N. (Apr-Sep. 2010). visiting student from Supelec, Metz, France
• Brule, M. (Feb.-Aug. 2009). visiting student from Universite de Louis Pasteur, Strasbourg,France
• Anlauff, J. (Dec. 2008-Mar. 2009). visiting student from Bielefeld University, Germany
• Delattre, G. (Apr.-Aug. 2007). visiting student from Universite Paris VI, France
I served on the supervisory and/or examination committees of the following students:
• Anne-Marie Burns, Faculty of Music, McGill University
• Frank Riggi, Electrical and Computer Engineering, McGill University
• Eric Benzacar, Electrical and Computer Engineering, McGill University
• Oles Protsiym, Faculty of Music, McGill University
29
Active Collaborations RESEARCH
Active Collaborations
Name Affiliation Project DatesHess, Robert Dept. of Ophthalmology,
McGillamblyopia treatment device 2009–present
Thompson, Ben Dept. of Optometry and Vi-sion Science, Auckland
amblyopia treatment device 2009–present
Levine, Martin Dept. of Electrical and Com-puter Engineering, McGill
video-based facial recogni-tion
2009–present
Berard, Francois Laboratoire d’Informatiquede Grenoble
evaluation of 3D input de-vices
2008–present
Giordano, Bruno Faculty of Music, McGill perception of ground sur-faces
2007–present
Marentakis, G. Faculty of Music, McGill feedback influences in targetacquistion
2007–present
McAdams, Stephen Faculty of Music, McGill Perception and EmotionRecognition
2007–present
Sha, Xin-Wei Dept. of Computer Science,Concordia University
Virtual Presence and Perfor-mance
2005–present
Roston, John Instructional Media Ser-vices, McGill
Open Orchestra 2002–present
Woszczyk, Wieslaw Faculty of Music, McGill Open Orchestra 2000–presentSettel, Zack Societe des Arts Tech-
nologiquesIn-Situ Audio Services 2000–present
30
Funding Awarded RESEARCH
Funding Awarded
Individual Research Grants and Contracts
Date Agency Amount Title/Description2011 NSERC $25,000 Improved Parallax Barrier Autostereoscopic Display Soft-
ware Engage Grants Program (SPI) with Industrial Parnter,Holoptick Technologies Inc.
2010 Google $50,000 A Spatialized Audio Map System for Mobile Blind Users. GoogleResearch Awards.
2010 Honda $30,000 Facial Expression Recognition for Machines. Honda ResearchInstitute.
2010 UVic $8,000 NEPTUNE Pleora streamer. University of Victoria software li-cense
2008-2011
MDEIE $367,195 Natural Interactive Walking. Support for International Re-search and Innovation Initiatives, Ministere du Developpementeconomique, de l’Innovation et de l’Exportation; for Canadianparticipation in EU FP-7 program with partners in France, Italy,and Denmark.
2007-2010
MDEIE $15,000 Un environment virtual pour la creation de musique et de sona partir de systemes chaotiques. Support for International Re-search and Innovation Initiatives, Ministere du Developpementeconomique, de l’Innovation et de l’Exportation.
2006-2009
NSERC $317,785 A pervasive multi-user augmented space for mobile immersiveinteraction with sound and music. New Media Initative STPGP337999-06. (matching funding for artist collaborator receivedfrom Canada Council for the Arts)
2006-2011
NSERC $100,000 Enhanced video for shared reality environments. Discoverygrant.
2004-2006
NSERC $136,600 Soundscape performance works via interactive environment forimmersive audiovisual scene generation. (matching funding forartist collaborator received from Canada Council for the Arts)New Media Initative NMIPJ 307934-04.
2002-2006
NSERC $100,000 Shared Reality Interaction over High Bandwidth Connectivity.Discovery grant.
2000 LUB $100,000 Distributed Visualization Environment. Laboratoire universi-taire Bell Equipment Grant.
31
Funding Awarded RESEARCH
Individual Research Grants and Contracts (cont.)
Date Agency Amount Title/Description1999-2000
Petro-Canada
$20,500 Interactive Web Tools for Critique of Presentation Skills andEvaluation of Student Learning. Young Innovator Award.
1999-2002
FCAR $45,000 Augmenting an Electronic Classroom for Improved Instructor-Student Interaction. New Researchers Award.
1999 FCAR $15,700 Augmenting an Electronic Classroom for Improved Instructor-Student Interaction. Equipment Grant.
1999 AES $25,000 Multichannel audio over Internet. Audio Engineering Society.1999 OSC $15,000 Timespace Exhibit. Ontario Science Center contract.1999 Mgmt. $10,000 Intelligent Classroom tools. McGill Faculty of Management.1998-2002
NSERC $76,000 Reactive Hospital Environment. Discovery research grant.
1998 FGSR $20,000 McGill Graduate Studies and Research Development Fund
32
Funding Awarded RESEARCH
Team Research Grants and Contracts (percentages refer to my portion)
Date Agency Amount Title/Description2010-2011
NSERC $49,815(90%)
∗Novel Portable Treatment Device for Lazy Eye Idea to Innova-tion (I2I) Booster (Phase Ib) (with R. Hess)
2009-2011
MSG $200,000(80%)
∗Location-Based Spatialized Audio Interaction for the Blind andVisually Impaired Programme Appui au passage a la societe del’information (Support for the transition to an information soci-ety program), Ministere des Services gouvernementaux (MSG)(with M. Wozniewski and Z. Settel)
2010-2014
CHRP $327,000(?%)
Computational and statistical tools for image guided neuro-surgery of brain tumours NSERC Collaborative Health ResearchProjects (with L. Collins and 7 others)
2009-2010
CCSIP $48,000(4%)
∗Digitally Merged Environments California-Canada StrategicInitiatives Program (with S. Brown, UCSD and 20 co-applicants)
2009-2011
Canarie $927,648(40%)
Open Orchestra Network-Enabled Platforms 2 (with J. Rostonand W. Woszczyk)
2010-2014
NCE $23,000,000(2%)
GRAND: Graphics, Animation and New Media Networks ofCentres of Excellence (With K. Booth and 49 others)
2009 DND $47,500 Video-Based Facial Recognition - Algorithm and DemonstrationDepartment of National Defence Contract (with M. Levine)
2008-2009
NSERC $120,250(90%)
∗Novel Portable Treatment Device for Lazy Eye Idea to Innova-tion (I2I) (with R. Hess)
2008-2010
Canarie $323,365(30%)
NEPTUNE: A Platform to Create and Support Ocean Sci-ence Virtual Organizations Network-Enabled Platforms (withB. Pirenne and J. Roston)
2008-2010
Canarie $2M (18%) Health Services Virtual Organization Network-Enabled Plat-forms (with R. Ellaway and 8 others)
2008-2010
NSERC $196,000(50%)
∗3-D Visualization and gestural interaction with multimodal neu-rological data Strategic Projects (with 5 others)
2006-2009
FQRNT $146,550(50%)
∗Unites agenceables: Reseau d’Environnements Immersifs pourCollaboration a Distance Recherche en equipes (with X.-W. Sha)
2005-2006
Canarie $825,000(50%)
Undersea Window - High Definition Video Online Intelligent In-frastructure Program. (with J. Roston)
2005-2006
SAT $1,276,000(1%)
TOT2: Nouveau Territoires de la Creation-Diffusion en ReseauHeritage Canada New Media Research. (M. Savoie, PI)
2004-2006
Canarie $568,971(33%)
Shared Spaces – High Definition Ultra-Videoconferencing Ad-vanced Applications Program. (with J. Roston)
2003-2004
SAT $792,082(1%)
TOT1: Nouveau Territoires de la Creation-Diffusion en ReseauHeritage Canada New Media Research. (M. Savoie, PI)
2002-2005
IRIS $573,000(25%)
∗Parallel Distributed Camera Arrays for Intelligent Environ-ments (with J. Clark, S. Fels, R. Vertegaal)
33
Funding Awarded RESEARCH
Team Research Grants and Contracts (cont.)
Date Agency Amount Title/Description2002-2005
VRQ $2,180,000(20%)
Real-time Communication Of High-res. Multi-sensory Contentvia Broadband Networks. (with W. Woszczyk and others)
2001-2002
Canarie $391,000(30%)
Remote Video Sign-Language Interpreting. Advanced Network-ing Apps. Services & Technologies. (with J. Roston and others)
2000-2002
Canarie $808,000(35%)
McGill Advanced Learnware Project. Advanced Networking Ap-plications Services and Technologies. (with B. Pennycook)
2000-2003
LUB $150,000(50%)
∗Distributed Shared Visualization Environment. Laboratoireuniversitaire Bell. (with B. Ozell)
2000-2001
RoyalBank
$2,000(80%)
∗Improving Teaching through an Interactive Critiquing System.Teaching Improvement Fund Award. (with R. Harris and J.Blatter)
1999-2002
CFI $400,000(50%)
†The Shared Reality Environment. New Opportunities Award.(with J. Clark)
1999-2000
RoyalBank
$10,000(80%)
∗Interactive Web Tools for Critique of Presentation Skills andEvaluation of Student Learning. TIF (with R. Harris)
∗Indicates grants on which I am project leader. †Grant on which I am co-investigator.
Centre Research Grants
Date Agency Amount Title/Description2008-2014
FQRSC/FQRNT
$1,800,000 Regroupement Strategique: Centre Interdisciplinaire deRecherche en Musique, Medias et Technologie. (with S.McAdams and 23 others)
2007-2009
NSERC $57,630 Major Resources Support: Centre for Interdisciplinary Researchin Music Media and Technology (CIRMMT). (with S. McAdamsand 8 others)
2006-2012
FQRNT $1,530,000 Regroupement Strategique pour l’Etude des EnvironnementsPARTages Intelligents repartis (REPARTI). (with D. Lauren-deau and 23 others) $100,000 per annum allocated to CIM.
2002-2005
FCAR $720,000 Regroupement Strategique: Reseau Quebecois de Recherche enRealite Artificiellle Distribuee (QUERRAnet). (with F. Ferrie,R. Bergevin, P. Cohen, and others)
2001 CFI $6,500,000 Major Facilities Award: Centre for Integrated Research in MusicMedia and Technology. (with W. Woszczyk and 11 others)
2000-2002
FCAR $113,500 Centre de Recherches. (with F. Ferrie and 17 others)
2000 NSERC $275,000 Information Systems in Support of Intelligent Machine Re-search. (with F. Ferrie and 17 others)
34
TEACHING
Teaching
Courses Taught
Course title and number Description Semester
ECSE-526BArtificial Intelligence
Graduate level course in artificial intelli-gence with emphasis on machine learningand autonomous agents
Winter 1998–present
∗ECSE-683Topics in Vision andRobotics†
Graduate level laboratory course forRoboCup projects
Fall 2000Fall 2002
∗ECSE-424BHuman-ComputerInteraction
Undergraduate course in human-computer interaction with emphasis onnew interface paradigms
Winter 2000–present
ECSE-487A/CComputer ArchitectureLaboratory
Undergraduate laboratory course Fall 1999–present, Sum-mer 2000–2002
ECSE-427AOperating Systems
Undergraduate course (core for Com-puter Engineering students)
Fall 1998
CSC-270Introduction to Modellingand Optimization
Computer Science undergraduate course,University of Toronto
1993–1994
CEE 1714YDigital Systems andComputers
Continuing Engineering Educationcourse for the Association of ProfessionalEngineers of Ontario
1993–1994
CSC-228File Structures and DataManagement
Computer Science undergraduate course,University of Toronto
1992–1995
COSC-3411File Structures and DataManagement
Computer Science undergraduate course,York University 1992
∗Indicates new course that I created.†Note that in 2003, this course is being offered under the designation of ECSE-688 RecentAdvances in Electrical Engineering.
35
Undergraduate Supervision TEACHING
Undergraduate Supervision
Honors Undergraduate Projects (2 semesters)
Name Year Research topicWaraich, Shahjahan 2010 Natural Interactive WalkingLin, Nan 2008 Location sensing for mobile apps.Wang, Letao 2007 Interactive AgentCharlebois, Pierre-Olivier 2004–2005 Sound Objects in a SoundscapeMyer, Sam 2003 Automated Music TranscriptionEl-Refaei, Sameh 1998–1999 Shared Reality simulator
Undergraduate Projects (2 semesters)
Savchenko, Eugene 2010 3D interaction
Undergraduate Projects (1 semester)
Name YearHimmelman, Tristan 2009Ephraim, Theo 2009Peck, Benjamin† 2008Mankarios, Daniel 2007Konstantinidis, Alex 2007Pufahl, David 2005Zhu, Ming-Zhang 2005Chan, Keng Chi 2005Phan, Andrew 2004Saifee, Ali-Akber 2004Shield, Robert 2004Aube, Francois 2004Rudzicz, Frank 2003Sarikaya, Deniz 2002Vallianatos, K. 2002Hassaine, Sofiane 2002Wyse, Marisa 2001
Name YearBancroft, David 2001Glass, Emily 2001Asselin, Ramy 2001Sud, Daniel 2001Gapakov, Timofei 2001Rosenblatt, Avi 2001Pekofsky, Gregory 2001Kitisa, Anousack 2000Vial, Thibaut 2000Bernier, Martin 2000Agha, Khurram Z. 2000Bhattacharya S. 2000Lavery, William 2000Yeung, Jason 2000Liao, Yuan Mei 1999Yee, Amy 1999Pereira, David 1999Ciambella, Gary 1999Kassouf, Nadim 1999
Name YearLee, Garvin, 1999Li, (Shao-Gi) Chris 1999El-Sharif, Osama 1999Nasereddin, Hazem 1999Virdi, Gurpratap 1999Shah, Ali 1999Djihanian, Sylvie 1999Moussaoui, Khaled 1999Dib Youssef 1999Tam, H. 1999Gagnon, Gabriel 1999Tjhin, P. 1999Luong, Mai 1999Lau, Sau 1999Tsai, Wanti 1999Lerner, Sorin∗ 1999Hochstein, Lorin∗ 1999Pollack, Jonathan 1998Nguyen, Bau 1998
∗Co-supervised with James Clark†Co-supervised with Paul Kry
36
Undergraduate Supervision TEACHING
Undergraduate Internships
Name Year ProjectTomiyoshi, Marcio 2011 (ELAP Scholarship Student) Open OrchestraBeniak, Stephane 2010 (NSERC Student) Natural Interactive WalkingSalenikovich, Stepan 2010 Natural Interactive WalkingChaw, Gary 2010 Natural Interactive WalkingRedel, Josh 2010 Health Services Virtual OrganizationSmith, Severin 2009-10 Natural Interactive WalkingRajalingham, Rishi 2009 (NSERC Student) Natural Interactive WalkingRener, Farid 2009 (SURE Student) Natural Interactive WalkingBae, Sung 2009 Optical Tracking for Audio GraffitiJathal, Kunal 2007 Analysis of haptic and auditory perception in hu-
man walkingLin, Nan∗ 2006 (NSERC Student) Interactive navigational control
of a robotic wheelchairReiter, Philippe 2005 (VP USRA Student) Distributed Video Rendering
for the SREAriane Chan-You 2003 Region-of-Interest Control and Selective Band-
width AllocationAriane Chan-You 2002 Data Reduction for Audiovisual Transport Qual-
ity EvaluationGupta, Greeshma 2000 (NSERC Student) Automated PowerPoint con-
version & PAQ systemCote, Christian 2000 (NSERC Student) Video perspective transforma-
tion with CAVE libraryAyatizadeh, Negah 2000 Network communication daemonsSwartz, Tanya 2000 Speech-based TV-tuner interfaceCohen, Ouri 2000 Classroom 2000 access controlYeong, Jason Aw 1999 (Work Study) C2000 Previously Asked Questions
(PAQ) systemAgha, Khurram Zubair 1999 (Work Study) URL access tracking for Classroom
2000Lim, Weoi Peng 1999 (Work Study) Graffiti boardAgha, Haroon Ali 1999 (Work Study) Classroom 2000 mini-presentation
coach systemKlinger, Zamir 2000 (NSERC Student) Automated Door AttendantHooshangi, Sara 2000 (NSERC Student) Computer interfaces for elec-
tronic classroomLiao, Yuan Mei 1999 Electronic Classroom control interfacesLuo, Jiexin 1999 PowerPoint C2000 interface and image librariesZhao, Changpeng 1998-99 Seamless PowerPoint upload for Classroom 2000Lakdawalla, Azeem 1998-99 Real-time conjugate-gradient based headtracking
∗Co-supervised with Joelle Pineau
37
SERVICE
Service
University Service
Department Committees
2005-ongoing Scholarships Committee2002 Ad hoc Committee on computing infrastructure for ECE/SOCS2000-2009 College Liason2001-2004 Information Technologies & Undergraduate Lab2000-2002 Curriculum Committee2000 Software Engineering subcommittee2000-ongoing Undergraduate Committee (Undergraduate Student Advisor)
Other University Committees
2009-ongoing Member, CIRMMT Executive Committee2007-ongoing Co-chair, Multimodal Immersive Systems research axis, CIRMMT2006-2008 Member, CIRMMT Board of Directors2006 Advisory Committee for Dean of Music2004 Tomlinson University Science Teaching Project adjudication2003-2004 Royal Bank Teaching and Learning Innovation Fund adjudication2003 Groupe de travail sur les normes et standards de la formation en ligne. Conference
des recteurs et des principaux des universites du Quebec (CREPUQ), McGill Uni-versity Representative
2002-2003 SC-IST Workgroup on Research Computing2000-2003 SC-IST Workgroup on Classroom Design1999-2004 Engineering Committee on Teaching and Learning1999 SC-IST McGill Machine Project1998 Workgroup on Educational Technology
Fundraising Activities
2002 RoboCup demonstration at McCord museum for Dean’s Circle2002 Corporate fundraising for McGill RoboCup team2001-2002 Intelligent Classroom promotion with the Engineering Class of ’50; helped raise
$274,0002001 Trottier Building research promotion
Other Activities
2007-2010 Promotion of Academic Integrity (see www.degradingmcgill.ca)2001-2002 Design of new Intelligent Classroom systems for ENGMC 3041999-2002 Maintenance of the Intelligent Classrooms, training other faculty in use of the
technology1999 Curriculum development of three new courses in software engineering
38
Professional Activities SERVICE
Professional Activities
Academic and Educational Committees
2010 Participant, NSF/CCC Workshop on Ultra-Large Scale Interaction2010 Voting Member, IEEE Communication Society Multimedia Communications Tech-
nical Committee (IEEE MMTC)2009 Organizer and Chair, AES Workshop on Network Technologies for Audio over IP2005-2006 Organizer, AES Tutorial and Workshop on Human Factors in Audio2004 Founder, AES Technical Committee for Human Factors in Audio Systems2003 Organizer, Workshop on LAN Delivery of Audio for AES2002-2003 Comite Scientifique de Robofolies, Centre Science de Montreal2001 Local Events Organizer, Autonomous Agents Conference, Montreal2001-2009 Chair, AES Technical Committee for Network Audio Systems2000-2004 Scientific Organizer, RoboCup Junior, Montreal2000-2001 Organizing Committee, Robofesta International Robot Games Festival, Japan1999-2000 Member and Webmaster, Canadian Virtualized Reality Working Group1998 Co-organizer, AAAI Symposium on Intelligent Environments
Grant Review
2009 Mathematics of Information Technology and Complex Systems (MITACS)2009 NSERC Strategic Networks (Site Visit Chair)2008 Peer review, NSERC Collaborative Research and Development Grants2008 Peer review, CFI (Canada Foundation for Innovation)2007-2009 Peer review, NSERC Discovery Grants2007-2008 NSERC Industrial Research Chair (Site Visit)2007-2009 Research Grants Council, Hong Kong2005 NSERC Steacie Memorial Fellowship2005-2008 Panel member, NSERC/Canada Council, New Media Initiative2002 Panel member, NSERC/Canada Council, New Media Initiative2001-2004 Peer review, NSERC Discovery Grants2001 Peer review, FCAR/CFI (Canada Foundation for Innovation)
39
Professional Activities SERVICE
Editorial Service
2010 IEEE Transactions on Affective Computing2010 IEEE Transactions on Robotics2010 IEEE Signal Processing Magazine2010 IEEE Transactions on Haptics2008 EURASIP Advances in Signal Processing2008 EURASIP Image and Video Processing2008 Audio Engineering Society (associate editor)2007 IEEE Transactions on Systems, Man, and Cybernetics2006 International Journal of Human-Computer Interaction2006 Springer Virtual Reality2005 Elsevier: Computers and Education2005 Elsevier: Image and Vision Computing2004 IEEE Pervasive Computing2000, 2003 Wiley Journal of Robotic Systems1999 ACM Transactions on Computer-Human Interaction1999 IEEE Transactions on Robotics and Automation1998 IEEE Personal Communications
Program Committees
2011 VRIC Workshop on Haptics for Telepresence, Teleoperation and CollaborativeEnvironments
2010 Graphics Interface2009 IEEE Haptics Symposium2009 International Computer Music Conference2009 Stereoscopic Displays and Applications2008 ACM SIGCHI conference2008 Immersive Medical Telepresence2006 International Conference on Digital Audio Effects2006, 2007 IEEE Workshop on Projector-Camera Systems (part of CVPR)2005-2009 Canadian Conference on Computer and Robot Vision2004, 2009 Graphics Interface2003, 2006 Audio Engineering Society2003 New Interfaces for Musical Expression2002 RoboCup International Symposium2002 IEEE International Conference on Robotics and Automation2001 ACM UbiComp2001 IEEE International Conference on Computer Vision
Other Academic Service
2008 Tenure Portfolio evaluation, York University
40