CoWoOZ - A cloud-based teleoperation platform for social robotics

&R:R2=±$FORXGEDVHGWHOHRSHUDWLRQSODWIRUPIRU

VRFLDOURERWLFV

*HUJHO\0DJ\DU _{3HWHU6LQþiN -iQ0DJ\DU .DRUL<RVKLGD $OHVVDQGUR0DQ]L )LOLSSR&DYDOOR}  _{'HSDUWPHQWRI&\EHUQHWLFVDQG$UWLILFLDO,QWHOOLJHQFH)DFXOW\RI(OHFWULFDO(QJLQHHULQJDQG,QIRUPDWLFV78.RãLFH6ORYDNLD 'HSDUWPHQWRI&RPSXWHUVDQG,QIRUPDWLFV)DFXOW\RI(OHFWULFDO(QJLQHHULQJDQG,QIRUPDWLFV78.RãLFH6ORYDNLD 'HSDUWPHQWRI+XPDQ,QWHOOLJHQFH6\VWHPV.\XVKX,QVWLWXWHRI7HFKQRORJ\.LWDN\XVKX-DSDQ 7KH%LRURERWLFV,QVWLWXWH6FXROD6XSHULRUH6DQW¶$QQD3RQWHGHUD,WDO\}   Abstract²7KLV SDSHU SUHVHQWV RXU FORXGEDVHG WHOHRSHUDWLRQ

SODWIRUP FDOOHG &R:R2= ± &O2XGEDVHG :L]DUG RI 2= ,W GHVFULEHV VLPLODU V\VWHPV VXFK DV 5RERW 0DQDJHPHQW 6\VWHP 506 2SHQ:R= &R:R2=¶V SUHGHFHVVRU 7HOHVFRSH DQG WKH ILUVW YHUVLRQ RI WKH GLVFXVVHG SODWIRUP $ VSHFLDO HPSKDVLV LV JLYHQ WR WKH GHVFULSWLRQ RI QHZ IXQFWLRQDOLWLHV DGGHG WR WKH V\VWHP HJ VFHQDULR PDQDJHPHQW FXVWRP VFULSW EXLOGHU FOLHQW DSSOLFDWLRQ HWF 7KH SDSHU DOVR FRQWDLQV D FRPSDULVRQ RI WKHVH V\VWHPV ZKLFK FDQ KHOS UHVHDUFKHUV WR FKRRVH WKH ULJKW RQH IRU WKHLUZRUN

Keywords—cloud computing, human-robot interaction, teleoperation, Wizard of Oz

, ,1752'8&7,21

6LQFHWKHHDUO\VWKHFORXGFRPSXWLQJSDUDGLJPKDGD JUHDW LPSDFW RQ YDULRXV ILHOGV DQG URERWLFV ZDV QRW DQ H[FHSWLRQ ,Q  -DPHV .XIIQHU DW WKH ,QWHUQDWLRQDO &RQIHUHQFH RQ +XPDQRLG 5RERWLFV LQWURGXFHG WKH FRQFHSW RI µFORXG URERWLFV¶ >@ +H FODLPHG WKDW URERWV XVLQJ FORXG FRPSXWLQJ FRXOG RIIORDG &38KHDY\ WDVNV WR UHPRWH VHUYHUV DQG XVH VPDOOHU RQERDUG FRPSXWHUV 6LQFH WKHQ PDQ\ VWXGLHV XWLOL]HGWKHDGYDQWDJHVRIWKLVSDUDGLJP)RUDFRPSUHKHQVLYH VXPPDU\RIUHVHDUFKGRQHLQUHFHQW\HDUVSOHDVHUHIHUWR>@>@ DQG>@UHVSHFWLYHO\+RZHYHURQHFDQQRWLFHWKDWPDQ\RIWKH DSSOLFDWLRQV ZHUH IRFXVLQJ RQ QDYLJDWLRQ DQG PDQLSXODWLRQ WDVNV 6LQFH RXU ZRUN LV IRFXVHG WRZDUG VRFLDO DQG DVVLVWLYH URERWLFVKHUHZHSURYLGHDVKRUWUHYLHZRISDSHUVGHDOLQJZLWK WKH XVH RI FORXG FRPSXWLQJ LQ KXPDQURERW LQWHUDFWLRQ +5, VFHQDULRV

,Q >@ WKH DXWKRUV XVHG ³FORXGFRQQHFWHG VRFLDO URERWV WR PHDVXUH DQG PRGHO WKH HIIHFW RI /(*2 (QJLQHHULQJ DQG LWV FROODERUDWLYH QDWXUH RQ WKH GHYHORSPHQW RI VRFLDO VNLOOV LQ FKLOGUHQ ZLWK $XWLVP 6SHFWUXP 'LVRUGHU´ $QRWKHU VWXG\ >@ XVHGWKHFORXGLQIUDVWUXFWXUHWRHQKDQFHWKHDIIHFWLYHVNLOOVRID KXPDQRLG URERW ,Q WKLV VHWXS WKH GDWD FROOHFWHG E\ WKH URERW ZHUH SURFHVVHG LQ WKH FORXG HQYLURQPHQW DQG EDVHG RQ WKH UHVXOWV WKH URERW JRW DQ LQVWUXFWLRQ ZKDW LW VKRXOG GR LQ WKH JLYHQVLWXDWLRQ,Q>@WKHURERW.X%R³UHOLHGRQFORXGVHUYLFHV H[WHQGLQJ LWV FDSDELOLWLHV IRU KXPDQ LQWHUDFWLRQ DQG HQYLURQPHQWDO VHQVLQJ WR SURYLGH VHUYLFHV VXFK DV *RRJOH &DOHQGDU*RRJOH6SHHFK5HFRJQLWLRQRU$FDSHOD9DD69RLFH DVD6HUYLFH%HVLGHVWHVWLQJWKHIHDVLELOLW\RIWKHFORXGVHUYLFH WKH JRDO RI WKH H[SHULPHQW ZDV WR KHOS HOGHUO\ ZLWK YDULRXV WDVNV LQ WKHLU KRPH ,Q >@ D FORXGDVVLVWHG SLOORZ URERW ZDV

LQWURGXFHG ZKLFK XWLOL]LQJ FORXG UHVRXUFHV ZDV DEOH WR UHFRJQL]H WKH XVHU¶V HPRWLRQV DQG FRPPXQLFDWH ZLWK RWKHU URERWVRIWKHVDPHW\SH

$OO WKH DERYH PHQWLRQHG VWXGLHV XVHG YDULRXV FORXG VHUYLFHV H[FHSW WHOHRSHUDWLRQ KRZHYHU LW LV D FUXFLDO SDUW RI +5, H[SHULPHQWV WKHVH GD\V 0RVW RI WKRVH  RI SXEOLFDWLRQV DW WKH DQQXDO +5, FRQIHUHQFH LQ WKH ODVW WKUHH \HDUVDFFRUGLQJWR>@XVHVWKH:L]DUGRI2]:R=WHFKQLTXH >@,QJHQHUDOZHFDQVD\WKDWLW³LVDUHVHDUFKH[SHULPHQWLQ ZKLFK VXEMHFWV LQWHUDFW ZLWK D FRPSXWHUURERW V\VWHP WKDW VXEMHFWVEHOLHYHWREHDXWRQRPRXVEXWZKLFKLVDFWXDOO\EHLQJ RSHUDWHG RU SDUWLDOO\ RSHUDWHG E\ DQ XQVHHQ KLGGHQ KXPDQ EHLQJ´>@

7R ILOO WKLV JDS ZH GHYHORSHG &R:R2= D FORXGEDVHG :L]DUGRI2]V\VWHPZKLFKLVLQWHQGHGWREHFRPHDFRPPRQ SODWIRUPIRU+5,UHVHDUFKHUVDSSO\LQJWKH:R=PHWKRGLQWKHLU ZRUN

,, 5(/$7(':25.

$OWKRXJKWKHILHOGRIFORXGEDVHGWHOHRSHUDWLRQLQKXPDQ URERW LQWHUDFWLRQ LV QRW YHU\ EURDG LQ UHFHQW \HDUV PDQ\ V\VWHPV ZHUH GHYHORSHG IRUVLPLODU SXUSRVHV QRW H[FOXVLYHO\ XVLQJFORXGFRPSXWLQJ

A. Robot Management System

)LUVWO\ ZH FDQ PHQWLRQ WKH 5RERW 0DQDJHPHQW 6\VWHP 506SUHVHQWHGLQ>@,QWKHDXWKRUV¶RZQZRUGV³506LV DQ RSHQVRXUFH IUDPHZRUN WKDW DOORZV UHVHDUFKHUV WR TXLFNO\ DQG HDVLO\ LQVWDOO FRQILJXUH DQG GHSOR\ D VHFXUH DQG VWDEOH UHPRWHODERUDWRU\´,WDOVRDOORZVXVHUVWRFUHDWHDFFRXQWVDQG WKLV ZD\ JDLQ DFFHVV WR URERWV DQG SDUWLFLSDWH LQ UHVHDUFK VWXGLHV7KHPDLQJRDOVZKHQFUHDWLQJWKHV\VWHPZHUH

x 5RERWDQGLQWHUIDFHLQGHSHQGHQWGHVLJQ

x 6XSSRUWIRUHDV\FUHDWLRQDQGPDQDJHPHQWRIQHZ LQWHUIDFHV

x 6HFXUHXVHUDXWKHQWLFDWLRQDQGDXWKRUL]DWLRQ x &UHDWLRQ PDQDJHPHQW ORJJLQJ DQG DQDO\VLV RI

PXOWLFRQGLWLRQXVHUVWXGLHV x :HEVLWHFRQWHQWPDQDJHPHQW



)LJ$UFKLWHFWXUHRIWKH5RERW0DQDJHPHQW6\VWHP>@

 7KH V\VWHP ZRUNV ZLWK 5RERW 2SHUDWLQJ 6\VWHP 526 HQDEOHG URERWV ,W ZDV VXFFHVVIXOO\ WHVWHG ZLWK 35 :LOORZ *DUDJH \RX%RW .8.$ DQG 5RYLR :RZ:HH 7KH IHDVLELOLW\ RI WKH V\VWHP ZDV YDOLGDWHG E\ KXPDQ SDUWLFLSDQWV ZKR ZHUH UHPRWHO\ FRQWUROOLQJ D URERW LQ D VHULHV RI REMHFW UHWULHYDOWDVNV

B. OpenWoZ

$QRWKHU H[DPSOH LV 2SHQ:R= E\ * +RIIPDQ >@ ,Q JHQHUDO LW LV D IUDPHZRUN ³GHVLJQHG WR EH XSGDWHG GXULQJ RSHUDWLRQ E\ DQ H[SHUW´ 2SHQ:R= LV LPSOHPHQWHG DV D WKLQ +773 +\SHUWH[W 7UDQVIHU 3URWRFRO VHUYHU UXQQLQJ RQ WKH URERW DQG D FORXGEDFNHG PXOWLSODWIRUP FOLHQW VFKHPD 7KH :R= VHUYHU DFFHSWV 5(67 5HSUHVHQWDWLRQDO 6WDWH 7UDQVIHU UHTXHVWV IURP WKH FOLHQWV VLPXOWDQHRXVO\ VHH )LJ   7KLV IHDWXUHDOORZV WKHDGGLWLRQ RIFRPPDQGVQHZ VHTXHQFLQJRI EHKDYLRUVDQGDGMXVWPHQWRISDUDPHWHUVDOOGXULQJUXQWLPH



)LJ$UFKLWHFWXUHRI2SHQ:R=>@

$VLWZDVPHQWLRQHGEHIRUHWKHFOLHQWVFRPPXQLFDWHZLWK WKH VHUYHU YLD UHTXHVWV (J WKH FRPPDQG /move/wave?speed=.5VHQWWRWKHURERWH[HFXWHVDZDYH PRYHPHQW DW  VSHHG 7KH FRPPDQG /sound/hello?volume=1 PDNHV WKH URERW VD\ ³+HOOR´ DWIXOOYROXPH

7KH V\VWHP ZDV WHVWHG RQ D QHZO\ FRQVWUXFWHG URERW ZLWK FDSDELOLWLHVWRPRYHSOD\DQGUHFRUGVRXQGVDQGGLVSOD\GDWD +RZHYHUQRµFRPPHUFLDO¶URERWZDVFRQQHFWHGWRWKHV\VWHP QHLWKHULWZDVXVHGLQDUHDOZRUOG+5,VFHQDULR

C. Telescope

7KH SUHGHFHVVRU RI &R:R2= ZDV 7HOHVFRSH ZKLFK ZDV GHYHORSHG DW WKH &HQWHU IRU ,QWHOOLJHQW 7HFKQRORJLHV DW WKH 7HFKQLFDO 8QLYHUVLW\ RI .RãLFH DV DVHUYHUEDVHG PRGXODU V\VWHP IRU WHOHRSHUDWLRQ RI FRQQHFWHG GHYLFHV >@ ,Q WKLV FRQWH[W D GHYLFH LV DQ\ HOHFWURQLF DSSOLDQFH ZKLFK FDQ FRPPXQLFDWH RYHU D QHWZRUN DQG FDQ EH DFFHVVHG SURJUDPPDWLFDOO\

:KHQ GHVLJQLQJ WKH V\VWHP D VSHFLDO HIIRUW ZDV PDGH WR PDNH WKH V\VWHP SODWIRUPLQGHSHQGHQW DQG VR DOORZ WKH WHOHRSHUDWLRQ RI GHYLFHV FRQQHFWHG WR D KHWHURJHQHRXV HQYLURQPHQW %\ KHWHURJHQHRXV HQYLURQPHQW ZH PHDQ D V\VWHPFRQVLVWLQJRIGHYLFHVZLWKGLIIHUHQW$3,V$SSOLFDWLRQ 3URJUDPPLQJ,QWHUIDFHSURJUDPPDEOHLQGLIIHUHQWODQJXDJHV RU ZLWK GLIIHUHQW XVHU LQWHUIDFHV 7KLV ZDV VROYHG E\ LQWURGXFLQJ D ZUDSSHU VLPLODU WR D GHYLFH GULYHU ZKLFK WUDQVODWHG7HOHVFRSH¶VFRPPDQGVLQWRDIRUPDWXQGHUVWDQGDEOH E\HDFKGHYLFH6XFKDZUDSSHUZDVGHYHORSHGIRUHDFKW\SHRI GHYLFH ,Q)LJ$UFKLWHFWXUHRI7HOHVFRSHWKHDUFKLWHFWXUHRIWKH V\VWHPLVVKRZQ,WFRQVLVWVRIWKUHHSDUWV  :UDSSHURQWKHGHYLFHV±WKLVEORFNFRQVLVWVRIWKH WHOHRSHUDWLRQDQGWHOHGLDJQRVWLFVPRGXOH7KHILUVW RQH VHUYHV IRU WUDQVODWLQJ FRPPDQGV IRU UHPRWH FRQWURO 7KH ODWWHU LV SURYLGLQJ LQIRUPDWLRQ DERXW WKH RYHUDOO VWDWH RI WKH GLDJQRVWLFV GHYLFH DQG VHQGVWKRVHWRWKHWHOHGLDJQRVWLFVGDWDEDVH  (YHQWDQGGLDJQRVWLFVVHUYHUVDQGGDWDEDVHV±WKH

FRUH RI 7HOHVFRSH ZKLFK HQVXUHV WKH FRPPXQLFDWLRQ EHWZHHQ WKH WHOHRSHUDWRU DQG WKH WHOHRSHUDWHG GHYLFHV ,W LV ZRUWK QRWLQJ WKDW DOO FRPPXQLFDWLRQ ZDV UHDOL]HG XVLQJ ZHEVRFNHWV 7KHGLDJQRVWLFVGDWDEDVHVWRUHGDWDZKLFKVHUYHDV DEDVLVIRUSRVVLEOHHUURUDQGIDXOWGHWHFWLRQ  :HESDJH±DVLPSOHZHESDJHZDVLPSOHPHQWHGDV

D WHOHRSHUDWLRQ LQWHUIDFH DQG IRU YLVXDOL]LQJ GLDJQRVWLFVGDWD



)LJ$UFKLWHFWXUHRI7HOHVFRSH>@

7KH V\VWHP ZDV WHVWHG XVLQJ WKH 1$2 KXPDQRLG URERW 7HOHRSHUDWRUV ZHUH DEOH WR PRYH WKH URERW¶V MRLQWV VHW LWV VWLIIQHVV XVH LWV WH[W WR VSHHFK IHDWXUH DQG ODXQFK SUH SURJUDPPHGEHKDYLRUV,QDGGLWLRQWRWKDW7HOHVFRSHDOORZHG DGGLQJUHPRYLQJDQGVKDULQJGHYLFHVEHWZHHQXVHUVPDNLQJLW SRVVLEOHWRFRQWURORQHGHYLFHE\PXOWLSOHWHOHRSHUDWRUV

,,, &2:22=±&/28'%$6(':,=$5'2)2=

,Q JHQHUDO &R:R2= LV D FORXGEDVHG WHOHRSHUDWLRQ SODWIRUPIRUYDULRXVW\SHVRIURERWVEXLOWRQWRSRI0LFURVRIW $]XUH8QOLNHLWV SUHGHFHVVRU 7HOHVFRSH WKLV V\VWHP XVHV WKH DGYDQWDJHVRIWKHFORXGHQYLURQPHQWVXFKDVVFDODELOLW\RUWKH ODFNRIQHHGWRWDNHFDUHRIDSK\VLFDOVHUYHUVLQFHWKHVHDUH HQVXUHGE\WKHFORXGSURYLGHU

7KH V\VWHP FRQVLVWV RI WZR PDLQ EXLOGLQJ EORFNV WKH IURQWHQGDQGWKHEDFNHQGDVLWLVVKRZQLQ)LJ



)LJ$UFKLWHFWXUHRI&R:R2=>@

7KHIURQWHQGLVUHSUHVHQWHGE\DZHESDJHZKLFKVHUYHVDV DQ LQWHUIDFH IRU WHOHRSHUDWLRQ ,W DOORZV WKH XVHU WR FDUU\ RXW &58'&UHDWH5HDG8SGDWHDQG'HOHWHRSHUDWLRQVRYHUWKH URERWEHKDYLRUVDQGW\SHVDQGDOVRSOD\WKHFKRVHQEHKDYLRUV RQDUHDOURERW

7KHEDFNHQGFRQVLVWVRIWKHIROORZLQJWZRSDUWV

x :RUNHU UROH ZLWK :(%$3, HQVXUHV WKH FRPPXQLFDWLRQEHWZHHQWKHVHUYHUDQGWKHURERWV DQGDOVREHWZHHQWKHVHUYHUDQGWKHZHESDJHYLD +773SURWRFRO

x 7KH GDWDEDVH FRQWDLQV D WDEOH IRU HDFK W\SH RI URERWDQGDEOREFRQWDLQHUD06$]XUHVHUYLFHIRU VWRULQJODUJHDPRXQWVRIXQVWUXFWXUHGREMHFWGDWD WKDWFDQEHDFFHVVHGIURPDQ\ZKHUHLQWKHZRUOG YLD +773 RU +7736 IRU HDFK WDEOH HQWU\ IRU VWRULQJURERWEHKDYLRUV

$IWHUFOLFNLQJWKH³3OD\EHKDYLRU´EXWWRQRQWKHZHESDJH WKHQDPHRIWKHPRYHPHQWDQGWKHURERW¶VW\SHDUHDGGHGWRD GLFWLRQDU\ 7KH ZUDSSHU RQ WKH URERW LV FRQVWDQWO\ VHQGLQJ UHTXHVWV WR WKH FORXG VHUYLFH WR ILQG RXW ZKDW LW VKRXOG GR :KHQDUHTXHVWDUULYHVWRWKHVHUYLFHLWFKHFNVWKHGLFWLRQDU\LI LW FRQWDLQV DQ\WKLQJ ,I VR WKH DSSURSULDWH VFULSW LV VHOHFWHG IURPWKHGDWDEDVHDQGVHQWWRWKHURERW

7KH SDLULQJ PHFKDQLVP EHWZHHQ D VSHFLILF URERW DQG WKH FORXGVHUYLFHLVYHU\VLPSOH2QWKHZHESDJHWKHXVHUDVVLJQV D XQLTXH QXPEHU WR WKH URERW ZKLFK PDWFKHV WKH RQH LQ WKH ZUDSSHUDQGYLFHYHUVD7KLVXQLTXHQXPEHULVDOVRDGGHGWR WKH GLFWLRQDU\ WKLV ZD\ ZH FDQ HQVXUH WKDW WKH FKRVHQ EHKDYLRULVSOD\HGRQWKHULJKWURERW &XUUHQWO\WKHV\VWHPFDQEHXVHGLQWKUHHGLIIHUHQWZD\V  XVHUFRQWUROVURERW  XVHUFRQWUROVQURERWV  QXVHUVFRQWURO &R:R2=FXUUHQWO\VXSSRUWVWKUHHURERWLFSODWIRUPV1$2 6RIWEDQN 5RERWLFV 0LOR +DQVRQ 5RERWLFV DQG 4ER WKH&RUSRUD ([SHULPHQWV IRU PHDVXULQJ WKH UHVSRQVH WLPHV IRUWKHVHSODWIRUPVZHUHFDUULHGRXW7KHUHVXOWVFDQEHIRXQG LQ>@

,9 $'9$1&(')81&7,21$/,7,(62)&2:22=

$OWKRXJKWKHV\VWHPSUHVHQWHGLQ6HFWLRQZDVVXIILFLHQW DV D SURRI RI FRQFHSW RI WHOHRSHUDWLRQ RI URERWV IURP D FORXG HQYLURQPHQWLQRUGHUWRXVHLWLQ+5,UHVHDUFKLWQHHGHGVRPH QHZIHDWXUHV7KHVHZLOOEHIXUWKHUGHVFULEHGLQWKLVVHFWLRQ

A. Web interface

,Q WKH ILUVW YHUVLRQ RI WKH V\VWHP RSHUDWRUV KDG DW WKHLU GLVSRVDOMXVWDOLVWRIQDPHVRIWKHDYDLODEOHEHKDYLRUV,QRUGHU WR PDNH WKHLU OLIH HDVLHU ZH UHFRUGHG WKH PRYHPHQWV DQG FUHDWHGVKRUWDQLPDWLRQV7KHUHVXOWLQJLQWHUIDFHFDQEHVHHQLQ )LJ   3OHDVH QRWH WKDW WKH ZHESDJH¶V GHVLJQ LV VWLOO LQ GHYHORSPHQWDQGLQWKHIXWXUHZLOOEHIXUWKHULPSURYHG



)LJ&R:R2=¶VWHOHRSHUDWLRQLQWHUIDFH

1) Security

$QRWKHULVVXHZKLFKZDVQRWVROYHGLQWKHSUHYLRXVYHUVLRQ ZDV VHFXULW\ DQG PDQDJHPHQW RI XVHU DFFRXQWV 7KH RULJLQDO V\VWHP GLGQ¶W FRQWDLQ DQ\ DXWKHQWLFDWLRQ SURFHVV 6LQFH ZH GLGQ¶WZDQWWRFRPSOHWHO\UHZULWHSDUWVRIWKHV\VWHPZHFKRVH D OHVV LQYDVLYH ZD\ RI XVHU DXWKHQWLFDWLRQ XVLQJ D FXVWRP VROXWLRQ

7KHVHFXULW\RIXVHUORJLQGDWDLVQRZHQVXUHGE\KDVKLQJ DQGVDOWLQJWKHPEHFDXVHZHDOZD\VKDYHWRDVVXPHWKDWXVHUV D\ DQG PRVW OLNHO\ ZLOO XVH WKH VDPH ORJLQ LQIRUPDWLRQ HOVHZKHUH

2) Updated database functionality

&R:R2= DOUHDG\ RIIHUHG EDVLF GDWDEDVH RSHUDWLRQV VXFK DV DGGLQJ EHKDYLRUV RU QHZ W\SHV RI URERWV UHDGLQJ DQG XSGDWLQJWKHPKRZHYHULWODFNHGWKHRSWLRQWRGHOHWHHQWULHV 7KH XVXDO DSSURDFK KDQGOLQJ WKLV SUREOHP LV WR VHW D IODJ PDUNLQJ GHOHWHG FRQWHQW DQG VR ERWK GHOHWLRQ DQG UHVWRUDWLRQ DUHGRQHVLPSO\E\FKDQJLQJWKHIODJ:HVROYHGWKLVLVVXHE\ PRYLQJWKHGHOHWHGHQWULHVWRDQHZWDEOHKHQFHWKH\FDQ¶WEH TXHULHGDQ\PRUHZLWKRXWWKHQHHGWRILOWHUDOOHQWULHVEDVHGRQ IODJV

3) Asynchronous web interface

%HVLGHVWKHLPSURYHPHQWVPHQWLRQHGLQWKHLQWURGXFWLRQRI WKLV VXEVHFWLRQ ZH LQWURGXFHG DV\QFKURQRXV PHWKRG FDOOLQJ 7KLVPHDQVWKDWWKHDSSOLFDWLRQLVQRWUHORDGHGDOOWKHWLPHDQ DFWLRQLVWDNHQEHFDXVHWKHEURZVHUUHPHPEHUVWKHVWDWHRIWKH ZHEDQGUHSODFHVRQO\GHVLUHGHOHPHQWVLIDQ\,QSUDFWLFHLW PHDQV WKDW DIWHU H[HFXWLQJ D PRYHPHQW RQ WKH URERW WKH LQWHUIDFH VWD\V LQ WKH VWDWH LW ZDV ZKHQ WKH PRYHPHQW ZDV VHOHFWHG 7KLV IHDWXUH LV YHU\ FRQYHQLHQW IRU RSHUDWRUV VLQFH WKH\ GRQ¶W KDYH WR ZDLW IRU WKH ZHESDJH WR UHORDG DIWHU HDFK DFWLRQWDNHQ

4) Scenario management

$QRWKHU QHZ UHTXLUHPHQW IRU WKH V\VWHP ZDV D PRUH HIIHFWLYH PDQDJHPHQW RI VFHQDULRV )RU WKLV WKH GDWDEDVH PRGHOZDVUHYLVHG,WQRZHQDEOHVILOWHULQJWKHURERWEHKDYLRUV EDVHG RQ VFHQDULRV URERW W\SHV DQG W\SH RI EHKDYLRU :KHQ XSORDGLQJDQHZEHKDYLRUWKHXVHUPXVW LQGLFDWHLWVSXUSRVH 7KHUH DUH WZR EDVLF FDWHJRULHV PRWLRQ DQG HPRWLRQ 7KH IRUPHUUHSUHVHQWVEDVLFPRYHPHQWVIRUWKHURERWDQGDUHYLWDO LQDFFRPSOLVKLQJWKHGHVLUHGJRDOZKLOHWKHODWWHUDUHSULPDULO\ DLPHG DW LQWHUDFWLRQ (PRWLRQ EHKDYLRUV DUH IXUWKHU GLYLGHG EDVHG RQ WKH HPRWLRQV RQ 3OXWFKLN¶V ZKHHO RI HPRWLRQV MR\ WUXVWIHDUVXUSULVHVDGQHVVDQWLFLSDWLRQDQJHUDQGGLVJXVW

7KH GDWDEDVH VWUXFWXUH DOVR HQDEOHV EHKDYLRU VKDULQJ EHWZHHQXVHUVEXWWKHIXQFWLRQDOLW\LV\HWWREHLPSOHPHQWHG,W PDNHVLWSRVVLEOHIRUV\VWHPXVHUVWRPDNHWKHLUWHQWDWLYHURERW EHKDYLRUVSULYDWHRUDGGWKHPLQWRDSXEOLFOLEUDU\FUHDWLQJDQ HQYLURQPHQWIRUHIIHFWLYHFRRSHUDWLRQEHWZHHQLQVWLWXWLRQV

7KH SULPDU\ QDYLJDWLRQ VWUXFWXUH LV EDVHG RQ VFHQDULRV ZKLFKUHSUHVHQWVDQ+5,VHVVLRQDQGLWFRQWDLQVHYHU\EHKDYLRU D URERW PLJKW QHHG GXULQJ WKDW LQWHUDFWLRQ7KH V\VWHP¶V XVHU FDQ DGG URERW EHKDYLRUV IURP WKHLU FRPSXWHU RU IURP WKH V\VWHP¶VOLEUDU\RIEHKDYLRUV0RUHXVHUVFDQKDYHDFFHVVWRD JLYHQVFHQDULRDQGWKH\FDQDVVLJQURERWVWRWKHVFHQDULR7KLV FUHDWHVDQHDV\WRXVHLQWHUIDFHIRUVFHQDULRPDQDJHPHQW  )LJ7KHXSGDWHGGDWDEDVHVWUXFWXUH %HKDYLRUVFDQEHSOD\HGRQWKHURERWVDFFHVVLEOHIURPWKH VFHQDULRGLUHFWO\IURPWKHV\VWHP7KHV\VWHPZDVGHVLJQHGLQ D ZD\ WKDW LW VKRXOG EH DEOH WR GHWHUPLQH ZKLFK URERWV DUH RQOLQH DQG RIIHU WKH XVHU D OLVW RI DYDLODEOH RQHV EXW WKLV IXQFWLRQDOLW\KDVQ¶WEHHQDGGHG\HW

B. Thin client

:KLOHWKHZHESDJHSURYLGHGDJUHDWZD\WRFRQWUROURERWV UHPRWHO\ LW KDG VRPH OLPLWDWLRQV ZKHQ FRQWUROOLQJ PXOWLSOH URERWVE\RQHXVHU,QWKLVFDVHWKHRSHUDWRUZDVRQO\DEOHWR VHQGWKHVDPHLQVWUXFWLRQWRDOOFRQQHFWHGURERWV7RRYHUFRPH WKLV GLIILFXOW\ ZH GHFLGHG WR GHYHORS D FXVWRPWDLORUHG WKLQ FOLHQW

1) Design

7KH WHOHRSHUDWLRQ FHQWHU IRU ZKLFK WKLV FOLHQW ZDV PHDQW FRQVLVWV RI D VLQJOH FRPSXWHU ZLWK  PRQLWRUV SODFHG LQ D ODERUDWRU\ZLWK,3FDPHUDV+RZHYHULWLVIXOO\IXQFWLRQDOLQ DQ\RWKHUVHWXS7KHWKLQFOLHQWZDVGHVLJQHGWRRIIHUWKHIXOO IXQFWLRQDOLW\ RI WKH ZHE SRUWDO LQ DGGLWLRQ WR FDPHUD VWUHDPV GLUHFWFRQWURORIWKHURERWDQGDVFULSWEXLOGHUIRUFUHDWLQJRZQ VFULSWV

7KH LQWHQGHG XVDJH RI WKH FOLHQW LV WR KDYH RQH RI WKH VFUHHQV XVHG IRU WKH PDLQ LQWHUIDFH XS WR IRXU RFFXSLHG E\ FDPHUDV DQG WKH UHPDLQLQJ PRQLWRUV DPRXQW GHSHQGV RQ DFWXDO FDPHUD XVDJH XQXVHG E\ WKH FOLHQW DOORZLQJ WKH WHOHRSHUDWRUWRUXQRWKHUDVVLVWLYHSURJUDPVVLPXOWDQHRXVO\

,Q)LJWKHPDLQZLQGRZRIWKHFOLHQWFDQEHVHHQZKHQD 1$2 URERW LV FRQQHFWHG2Q WKH OHIW WKH URERW¶V W\SH DQG LWV XQLTXH LGHQWLILHU FDQ EH VHW DQG DOVR LQIRUPDWLRQ DERXW WKH URERW¶VEDWWHU\OHYHODQGSURFHVVRUWHPSHUDWXUHLVGLVSOD\HG,Q WKHPLGGOHXVHUVFDQVWDUWWKHVWUHDPRIWKH,3FDPHUD2QWKH ULJKW WKH DFWLRQV IURP WKH FORXG GDWDEDVH IRU WKH FRQQHFWHG URERWFDQEHIRXQG



)LJ7HOHRSHUDWLRQLQWHUIDFHRIWKHWKLQFOLHQW

2) Communication with the cloud service

7KH RULJLQDO VROXWLRQ XWLOL]HG VWDQGDUG +773 FRPPXQLFDWLRQZLWKDUHVSRQVHXQVXLWDEOHIRUWKHFOLHQW7KDW¶V ZK\ D QHZ FRQWUROOHU ZDV DGGHG WR WKH V\VWHP ZLWK WZR PHWKRGV 2QH IRU KDQGOLQJ WKH FOLHQW¶V UHTXHVWV DQG WKH RWKHU RQH HQVXULQJ WZRZD\ FRPPXQLFDWLRQ ZLWK WKH URERW GXULQJ GLUHFWFRQWURO7KHPHVVDJHVEHWZHHQWKHFOLHQWDQGWKHVHUYLFH KDYH D -621 -DYD6FULSW 2EMHFW 1RWDWLRQ IRUPDW 2Q ERWK VLGHV RI WKH FRPPXQLFDWLRQ D SDUVHU LV XVHG WR GHFRGH WKH UHFHLYHGPHVVDJH

3) Camera streams

,3 FDPHUDV LQ RXU ODERUDWRU\ DOUHDG\ FRQWDLQHG D ZHE LQWHUIDFHZLWKFRQWUROVLQDGGLWLRQWRWKHYLGHRVWUHDP2XUJRDO ZDVWRLQWHJUDWHLWZLWKWKHFOLHQWZKLFKLVDORFDODSSOLFDWLRQ,W

ZDV GRQH E\ XVLQJ WKH *HFNR); OLEUDU\ ZKLFK LPSOHPHQWV D )LUHIR[EURZVHULQWRD:LQGRZV)RUPVDSSOLFDWLRQ 4) Direct control ,QVRPHFDVHVHVSHFLDOO\LQPRELOHURERWLFVUHVHDUFKLWLV QRWHQRXJKIRUWKHRSHUDWRUWRH[HFXWHSUHGHILQHGVFULSWVRQWKH URERW7KDW¶VWKHUHDVRQZK\ZHLPSOHPHQWHGWKHGLUHFWFRQWURO PRGXOH %\ ZKLFK ZH PHDQ PRYLQJ WKH URERW LQ WKH HQYLURQPHQWLQUHDOWLPH

8QOLNHWKHWHOHRSHUDWLRQGLVFXVVHGVRIDUWKLVPRGXOHLVQRW PHDQW WR ZRUN ZLWK D JURXSRI URERWV ZLWK WKH VDPH ,' DV LW UHPRYHV WKH DFWLRQ IURP WKH GLFWLRQDU\ ZKHQ UHWULHYLQJ LW ,Q RXUILUVWDSSURDFKWKHURERWPRYHGXQWLOLWUHFHLYHGDVLJQDOWR VWRS 7KLV KRZHYHU KDG SURYHQ SUREOHPDWLF GXH WR YDU\LQJ EXWJHQHUDOO\KLJKUHVSRQVHWLPHVUHVXOWLQJLQWKHSRVVLELOLW\ WR GDPDJH KDUGZDUH RU WKH HQYLURQPHQW %HFDXVH RI WKDW ZH PRYHG WR RXU FXUUHQW VROXWLRQ ZKHUH WKH URERW LV DOORZHG WR PRYHRQO\DIHZFHQWLPHWHUVDQGWKHQLWKDVWRFKHFNZKHWKHULW FDQ PRYH IXUWKHU ,I VR WKH SURFHVV UHSHDWV LQVWHDG RI WKH FRQWLQXRXV PRYHPHQW LPSOHPHQWHG ILUVW $V D GRZQVLGH ZH KDYHWRPHQWLRQWKHQHHGRIDQRWKHUZUDSSHUIRUGLUHFWFRQWURO ,QWKHFDVHRIWKH1$2URERWXQOLNHWKHWHOHRSHUDWLRQZUDSSHU ZKLFK UHTXLUHV VWUHDPLQJ RI HDFK DFWLRQ IURP WKH VHUYHU WKH ZUDSSHU IRU GLUHFW FRQWURO KDV SUHSURJUDPPHG DFWLRQV DW LWV GLVSRVDO ZKLFK DUH FDOOLQJ UHOHYDQW PRGXOHV IURP WKH QDRTL OLEUDU\EDVHGRQWKHSDUVHG-621PHVVDJHIURPWKHVHUYHU,Q DGGLWLRQ WR PRYHPHQW WH[W WR VSHHFK SRVWXUHV DUH DOVR DYDLODEOHIRUWKLVW\SHRIURERW

4ERXVHVVLPLODUORJLFEXWWKHWH[WWRVSHHFKIXQFWLRQDOLW\ LVQRWVXSSRUWHG7KHGLUHFWFRQWUROLVDOVROLPLWHGWRPRYHPHQW RIWKHURERWDQGURWDWLRQRILWVKHDG6LQFH4ERLVXVLQJ526 WKH UHVSRQVLEOH 526 WRSLFV DUH FDOOHG ZKLOH EHLQJ GLUHFWO\ FRQWUROOHG

0LOR¶V FRQVWUDLQWV ZLWK PRYHPHQW UHQGHU LW XQVXLWDEOH IRU WKH VDPH W\SH RI FRQWURO DV ZLWK 1$2 RU 4ER VR LWV GLUHFW FRQWURO LV RQO\ EDVHG RQ GLUHFWO\ OLQHG VFULSWV IURP WKH WHOHRSHUDWLRQPRGXOH

5) NAO live status updates

1$2EHLQJRQHRIWKHPRVWXVHGKXPDQRLGURERWVLQ+5, UHVHDUFKZHEHOLHYHWKDWDIHDWXUHSURYLGLQJWKHRSHUDWRUZLWK UHDOWLPHLQIRUPDWLRQDERXWWKHVWDWXVRIWKHURERW¶VKDUGZDUH FDQEHXVHIXO,QSUDFWLFHLWPHDQVWKDWD1$2URERWUXQQLQJD PRGLILHG ZUDSSHU ZLOO UHSRUW GHVLUHG YDOXHV ZLWKLQ HDFK LWHUDWLRQ RI WKH PDLQ ORRS &XUUHQWO\ LW UHSRUWV LWV PRYHPHQW VWDWXV LGOH RU LQ DFWLRQ EDWWHU\ OHYHO DQG SURFHVVRU WHPSHUDWXUH:KHQXVLQJGLUHFWFRQWUROWKLVUHSRUWLVLQFOXGHG ZLWKLQ WKH UHTXHVW IRU LWV QH[W DFWLRQ 7KH OLYH VWDWXV XSGDWH IHDWXUH LV GHVLJQHG WR EH KDQGOHG G\QDPLFDOO\ VR WKH FOLHQW GRHVQ¶WKDYHWREHUHFRPSLOHGWRUHIOHFWWKHFKDQJHVDQGLVDEOH WRZRUNZLWKDQ\URERWZKLFKUHSRUWVLWVVWDWXV

6) Script builder

7KH WKLQ FOLHQW DOVR FRQWDLQV D GHPR LPSOHPHQWDWLRQ RI D VFULSWEXLOGHUFXUUHQWO\VXSSRUWLQJWKH1$2URERWLFSODWIRUP ,WVJRDOLVWRSURYLGHDVLPSOHJUDSKLFDOXVHULQWHUIDFHIRUXVHUV ZKRZRXOGOLNHWRFUHDWHDFXVWRPVFULSWIRUWKHURERWVHH)LJ ,WGRHVVRE\SURYLGLQJWHPSODWHVIRUWKHURERW¶VEHKDYLRU 7KLVDOORZVSHRSOHZLWKRXWDQ\SULRUSURJUDPPLQJNQRZOHGJH WRFUHDWHWKHLURZQVFULSWVIRUWKHVXSSRUWHGURERWLFSODWIRUPV +RZHYHUSURJUDPPHUVZDQWLQJWRDGGPRUHIXQFWLRQDOLW\DUH DEOH WR GR VR E\ VHOHFWLQJ ³FXVWRP´ DQG PDQXDOO\ W\SLQJ WKH VFULSW



)LJ6FULSW%XLOGHU¶VLQWHUIDFH

9&203$5,6212)7+(',6&866('3/$7)2506

7KLV VHFWLRQ FRQWDLQV D FRPSDULVRQ RI WKH IROORZLQJ V\VWHPV 2SHQ:R= 7HOHVFRSH &R:R2= EDVLF YHUVLRQ XSGDWHG &R:R2= EDVHG RQ YDULRXV FULWHULD :H GHFLGHG WR H[FOXGH 5RERW 0DQDJHPHQW 6\VWHP IURP WKH FRPSDULVRQ EHFDXVH LW LV 526EDVHG DQG FDQ¶W EH GLUHFWO\ FRPSDUHG ZLWK WKH RWKHU RQHV 7KH FRPSDULVRQ ZDV GRQH E\ WKH IROORZLQJ FULWHULD

x DUFKLWHFWXUH±PDLQDUFKLWHFWXUHRIWKHV\VWHP x JHQHUDOLW\±ZKHWKHUWKHV\VWHPVXSSRUWVGLIIHUHQW

URERWLFSODWIRUPV

x GLDJQRVWLFV ± ZKHWKHU WKH RSHUDWRU LV LQIRUPHG DERXWWKHFXUUHQWVWDWHRIWKHURERW¶VKDUGZDUH x GLUHFW FRQWURO ± ZKHWKHU WKH URERW FDQ EH

FRQWUROOHG GLUHFWO\ E\ XVLQJ D NH\ERDUG RU D MR\VWLFN

x FRQWURO LQWHUIDFH ± ZKHUH WKH PDLQ FRQWUROOHU LQWHUIDFHLVORFDWHG

x YLGHRVWUHDP±ZKHWKHUWKHSODWIRUPFRPHVZLWKD IHDWXUHIRUVWUHDPLQJYLGHRHLWKHUIURPWKHURERW RUIURPDQH[WHUQDOFDPHUD

x VFHQDULR PDQDJHPHQW ± ZKHWKHU XVHUV FDQ FUHDWH WKHLU RZQ VFHQDULRV ZLWK URERW EHKDYLRUV RI WKHLU FKRLFH

x EXLOGLQJ RZQ VFULSWV ± ZKHWKHU WKH V\VWHP  LV VXLWDEOH IRU FUHDWLQJ QHZ FXVWRP EHKDYLRUV DQG SOD\WKHPRQDURERW

 

7$%/(&203$5,6212)6(/(&7('3/$7)2506

 )URP WKH WDEOH LW LV HYLGHQW WKDW WKH FXUUHQW YHUVLRQ RI &R:R2=KDVWKHPRVWIHDWXUHVFRPSDUHGWRWKHRWKHUV\VWHPV KRZHYHUPDQ\RIWKRVHDUHFXUUHQWO\LQH[SHULPHQWDOSKDVHRU DUHVXSSRUWLQJMXVWWKH1$2URERWLFSODWIRUP

9, &21&/86,21$1')8785(:25.

,QWKLVSDSHUZHGHVFULEHGRXUFORXGEDVHG:L]DUGRI2] V\VWHP &R:R2= DQG WKHQ FRPSDUHG LW ZLWK LWV SUHGHFHVVRU 7HOHVFRSH LWV ILUVW YHUVLRQ DQG WKH 2SHQ:R= V\VWHP 7KH FRPSDULVRQ VKRZV WKDW WKH FXUUHQW YHUVLRQ RI RXU V\VWHP KDV WKH PRVW IXQFWLRQDOLWLHV IURP ZKLFK PDQ\ ZHUH LQWURGXFHG LQ WKH VHFRQG YHUVLRQ :H EHOLHYH WKDW WKHVH QHZ IHDWXUHV FDQ IXUWKHU LQFUHDVH WKH :L]DUG¶V SURGXFWLYLW\ DQG FDQ EH KHOSIXO IRU+5,UHVHDUFKHUV

$OWKRXJKRXUV\VWHPFRYHUVPRVWRIWKHQHHGVRID:L]DUG LQ D VRFLDO +5, VFHQDULR ZH DUH DOZD\V DZDUH RI LWV ZHDNQHVVHV7KHPRVWXUJHQWLVVXHZKLFKKDVWREHDGGUHVVHG LV WKH XVHU LQWHUIDFH 2XU JRDO LV WR ILQG WKH ULJKW EDODQFH EHWZHHQ DHVWKHWLFV DQG IXQFWLRQDOLW\ ZKLOH DOORZLQJ XVHUV WR GHVLJQWKHLURZQLQWHUIDFHVDFFRUGLQJWRWKHVFHQDULRIRUZKLFK WKH\DUHEXLOGLQJLW,QWKHIXWXUHZHDOVRZDQWWRH[WHQGWKH *8, RI WKH WKLQFOLHQW E\ DGGLQJ WKH DQLPDWLRQV LQWR LW FXUUHQWO\WKHVHDUHDYDLODEOHRQO\RQWKHZHESDJH

5HJDUGLQJWKHRWKHUIXQFWLRQDOLWLHVRIWKHWKLQFOLHQWGLUHFW FRQWURODQGOLYHVWDWXVXSGDWHVZHZDQWWRDGGVXSSRUWIRUWKH RWKHUURERWLFSODWIRUPVDVZHOOQDPHO\4ERDQG0LOR$OVR 6FULSW %XLOGHU PXVW EH H[WHQGHG LQ RUGHU WR FUHDWH PRUH FRPSOH[URERWLFEHKDYLRUVDQGQRWRQO\IRU1$2

2XU XOWLPDWH JRDO LV WR HTXLS WKH H[LVWLQJ WHOHRSHUDWLRQ SODWIRUPZLWKOHDUQLQJFDSDELOLWLHVDVLWZDVSURSRVHGLQ >@ :HKDYHDOUHDG\GRQHH[SHULPHQWVIRUSURYLQJWKDWLQWHUDFWLYH UHLQIRUFHPHQW OHDUQLQJ FDQ EH XVHG IRU OHDUQLQJ URERWLF EHKDYLRUIURPWKH:L]DUGLQVRFLDO+5,>@>@:HDOVRKDYH WRQRWHWKDWWKHH[SHULPHQWVZHUHFDUULHGRXWXVLQJDVLPXODWLRQ RI+5,,QWKHIXWXUHZHSODQWRWHVWWKHV\VWHPZLWKOHDUQLQJ LQDQDVVLVWLYH+5,VFHQDULR $&.12:/('*0(17 7KLVUHVHDUFKZRUNZDVVXSSRUWHGE\WKH6ORYDN5HVHDUFK DQG'HYHORSPHQW$JHQF\XQGHUWKHFRQWUDFW1R$399 DQGUHVHDUFKSURMHFWVXSSRUWHGIURPWR 5()(5(1&(6 

>@ - - .XIQHU ³&ORXGHQDEOHG URERWV´ LQ ,(((5$6 ,QWHUQDWLRQDO &RQIHUHQFHRQ+XPDQRLG5RERWLFV

>@ . *ROGEHUJ % .HKRH ³&ORXG URERWLFV DQG DXWRPDWLRQ $ VXUYH\ RI UHODWHGZRUN´LQ((&6'HSDUWPHQW8QLYHUVLW\RI&DOLIRUQLD%HUNHOH\ 7HFK5HS8&%((&6

>@ % .HKRH HW DO ³$ VXUYH\ RI UHVHDUFK RQ FORXG URERWLFV DQG DXWRPDWLRQ´ LQ ,((( 7UDQVDFWLRQV RQ $XWRPDWLRQ 6FLHQFH DQG (QJLQHHULQJYROQRSS

>@ &ORXG URERWLFV DQG DXWRPDWLRQ >RQOLQH@ KWWSJROGEHUJEHUNHOH\HGXFORXGURERWLFV

>@ - $OER&DQDOV HW DO ³0RGHOOLQJ VRFLDO VNLOOV DQG SUREOHP VROYLQJ VWUDWHJLHV XVHG E\ FKLOGUHQ ZLWK $6' WKURXJK FORXGFRQQHFWHG VRFLDO URERWV DV GDWD ORJJHUV )LUVW PRGHOOLQJ DSSURDFK´ LQ &RQIHUHQFH 3URFHHGLQJV 1HZ )ULHQGV  7KH VW_{ ,QWHUQDWLRQDO &RQIHUHQFH RQ}

6RFLDO5RERWVLQ7KHUDS\DQG(GXFDWLRQSS

>@ < 0D HW DO ³&ORXGDVVLVWHG KXPDQRLG URERWLFV IRU DIIHFWLYH LQWHUDFWLRQ´LQQG_{,QWHUQDWLRQDO&RQIHUHQFHRQ&RQWURO$XWRPDWLRQDQG}

5RERWLFV,&&$5SS

>@ $ 0DQ]L HW DO ³'HVLJQ RI D FORXG URERWLF V\VWHP WR VXSSRUW VHQLRU FLWL]HQV7KH.X%RH[SHULHQFH´LQ$XWRQRPRXV5RERWVSS >@ 0 &KHQ HW DO ³&SURERW &ORXGDVVLVWHG SLOORZ URERW IRU HPRWLRQ VHQVLQJ DQG LQWHUDFWLRQ´ LQ ,QWHUQDWLRQDO &RQIHUHQFH RQ ,QGXVWULDO ,R7 7HFKQRORJLHVDQG$SSOLFDWLRQVSS

>@ 3 %D[WHU HW DO ³)URP FKDUDFWHULVLQJ WKUHH \HDUV RI +5, WR PHWKRGRORJ\DQGUHSRUWLQJUHFRPPHQGDWLRQV´LQ7KHWK_$&0,(((

,QWHUQDWLRQDO &RQIHUHQFH RQ +XPDQ5RERW ,QWHUDFWLRQ SS  

>@ /'5LHN³:L]DUGRI2]VWXGLHVLQ+5,$V\VWHPDWLFUHYLHZDQGQHZ UHSRUWLQJJXLGHOLQHV´LQ-RXUQDORI+XPDQ5RERW,QWHUDFWLRQYROQR 

>@ % +DQQLQJWRQ 0 %HOOD ³8QLYHUVDO PHWKRGV RI GHVLJQ  ZD\V WR UHVHDUFK FRPSOH[ SUREOHPV GHYHORS LQQRYDWLYH LGHDV DQG GHVLJQ HIIHFWLYHVROXWLRQV5RFNSRUW3XEOLVKHUV

>@ 5 7RUMV ' .HQW 6 &KHUQRYD ³7KH URERW PDQDJHPHQW V\VWHP $ IUDPHZRUN IRU FRQGXFWLQJ KXPDQURERW LQWHUDFWLRQ VWXGLHV WKURXJK FURZGVRXUFLQJ´ LQ -RXUQDO RI +XPDQ5RERW ,QWHUDFWLRQ YRO  QR  

>@ * +RIIPDQ ³2SHQ:R= $ UXQWLPHFRQILJXUDEOH :L]DUG RI 2] IUDPHZRUN IRU KXPDQURERW LQWHUDFWLRQ´ LQ  $$$, 6SULQJ 6\PSRVLXP6HULHV

>@ /0L]HQNRHWDO³7HOHVFRSH6\VWHP2YHUYLHZ´LQ'HYHORSPHQWVLQ 9LUWXDO5HDOLW\/DERUDWRU\IRU)DFWRU\RIWKH)XWXUHSS >@ 7&DGULNHWDO³&ORXGEDVHGURERWVDQGLQWHOOLJHQWVSDFHWHOHRSHUDWLRQ

WRROV´ LQ 5RERW ,QWHOOLJHQFH 7HFKQRORJ\ DQG $SSOLFDWLRQV  SS  

>@ *0DJ\DU09LUFLNRYD³/HDUQLQJIURPWKH:L]DUGRI2]RQFORXGLQ VRFLDO KXPDQURERW LQWHUDFWLRQ 3URSRVDO´ LQ ,((( WK_{ ,QWHUQDWLRQDO}

&RQIHUHQFHRQ,QWHOOLJHQW(QJLQHHULQJ6\VWHPVSS >@ *0DJ\DU09LUFLNRYD36LQFDN³,QWHUDFWLYH 4OHDUQLQJIRUVRFLDO

URERWVWKDWOHDUQIURPWKH:L]DUG$SLORWVWXG\´LQ3URFHHGLQJVRIWKH  ,((( ,QWHUQDWLRQDO &RQIHUHQFH RQ 6\VWHPV 0DFKLQH DQG &\EHUQHWLFV

>@ * 0DJ\DU 0 9LUFLNRYD 3 6LQFDN ³,QFUHDVLQJ WKH URERW¶V OHYHO RI DXWRQRP\ LQ VRFLDO KXPDQURERW LQWHUDFWLRQ WKURXJK LQWHUDFWLYH UHLQIRUFHPHQW OHDUQLQJ´ LQ 1HZ )ULHQGV  QG_{ ,QWHUQDWLRQDO}

&RQIHUHQFHRQ6RFLDO5RERWVLQ7KHUDS\DQG(GXFDWLRQ