Generating TV Summaries for CE-devices
Gerhard Mekenkamp,
Mauro Barbieri
Philips Research Prof. Holstlaan 4, 5656 AA, Eindhoven, The Netherlands+31 40 27 44491 {gerhard.mekenkamp, mauro.barbieri}@philips.com
Benoit Huet
Itheri Yahiaoui
Bernard Merialdo
Institut Eurécom 06904 Sophia-Antipolis, France +33 0493002679 {huet, yahiaoui, merialdo}@eurecom.frRiccardo Leonardi
Universitá degli Studi diBrescia Piazza Mercato 15, 25121 Brescia, Italy +39 030 3715434 leon@ing.unibs.it
Michael Rose
Technical University of Denmark Anker Engeelundsvej 1 DK 2800, Kgs Lyngby, Denmark +45 4525 5172 rose@cti.dtu.dk$%675$&7
$XWRPDWLFDOO\ JHQHUDWHG VXPPDULHV RI 79 FRQWHQW DUH LQGLVSHQVDEOHIRUFRQWHQWVHOHFWLRQDQGQDYLJDWLRQLQ&(GHYLFHV :H VKRZ WZR GLIIHUHQW W\SHV RI VXPPDULHV 6KRUW YLGHR WUDLOHUV DQG YLVXDO RYHUYLHZV FRQVLVWLQJ RI UHSUHVHQWDWLYH IUDPHV 7KH GHPR GRHV QRW RQO\ VKRZ WKH IHDVLELOLW\ RI WKH SURSRVHG DOJRULWKPV EXW DOVR VKRZV KRZ GLIIHUHQW W\SHV RI JHQHUDWHG VXPPDULHVFDQEHXVHGLQIXWXUH&(GHYLFHV
&DWHJRULHVDQG6XEMHFW'HVFULSWRUV
+>,QIRUPDWLRQ6WRUDJHDQG5HWULHYDO@ &RQWHQW$QDO\VLVDQG ,QGH[LQJ±DEVWUDFWLQJPHWKRGV*HQHUDO7HUPV
$OJRULWKPV([SHULPHQWDWLRQ.H\ZRUGV
&RQWHQWDQDO\VLVYLGHRVXPPDULHV,1752'8&7,21
7KH DPRXQW RI GLJLWDO FRQWHQW VWRUHG LQ WKH KRXVH LV UDSLGO\ LQFUHDVLQJ %HVLGHV VWRUDJH RQ &'V DQG '9'V KDUG GLVNV DUH QRZ ILQGLQJ WKHLU ZD\ LQ FRQVXPHU SURGXFWV +DUG GLVN EDVHG SHUVRQDOYLGHRUHFRUGHUVZLOOFKDQJHWKHZD\ZHZDWFKWHOHYLVLRQ PDLQO\ GXH WR WKH RSWLRQ WR SDXVH OLYH 79 E\ VLPXOWDQHRXVO\ UHFRUGLQJDQGSOD\LQJEDFNWKHVDPHSURJUDPPH(DV\UHFRUGLQJ IXQFWLRQV ZLOO PDNH VXUH WKDW WKHUH LV DOZD\V VRPHWKLQJ QLFH WR ZDWFK $XWRPDWLF UHFRUGLQJ DJHQWV FDQ VHOHFW SURJUDPPHV IRU UHFRUGLQJ EDVHG RQ D XVHU SURILOH 7KLV ZD\ WKH DPRXQW RI SURJUDPPHV WKDW DUH VWRUHG RQ WKH GLVN FDQ EH TXLWH ODUJH $ *E\WH KDUG GLVN FDQ DOUHDG\ VWRUH VRPH KRXUV RI 79 SURJUDPPHVLQEURDGFDVWTXDOLW\ 0ELWVVHF :LWKWKHKDUG GLVN FDSDFLW\ GRXEOLQJ HYHU\ \HDU DQG WKH LQWURGXFWLRQ RI QHZ HIILFLHQWYLGHRFRPSUHVVLRQDOJRULWKPVVRRQKXQGUHGVRIKRXUVRI YLGHR FDQ EH VWRUHG 7KLV UHTXLUHV DGYDQFHG IXQFWLRQDOLW\ IRU EURZVLQJDQGQDYLJDWLQJWKURXJKYLGHRFRQWHQWPDNLQJLWHDVLHU
WR ILQGVSHFLILFLQIRUPDWLRQRUWRKHOSGHFLGHZKDWWRZDWFK 7KH DPRXQW RI DYDLODEOH SURFHVVLQJ SRZHU LV ODUJH HQRXJK WR MXVWLI\ WKH XVH RI FRQWHQW DQDO\VLV WHFKQLTXHV ,Q WKH 6SDWLRQ 6HUYLFHV3ODWIRUPVDQG$SSOLFDWLRQVIRU7UDQVSDUHQW,QIRUPDWLRQ 0DQDJHPHQWLQDQLQKRPH1HWZRUN SURMHFW>@ZHDSSO\FRQWHQW DQDO\VLV WHFKQLTXHV WR DOORZ HDV\ DFFHVV WR WKH ODUJH DPRXQW RI GLJLWDO FRQWHQW WKDW ZLOO EH VWRUHG LQ WKH KRXVH %HVLGHV ODUJH VWRUDJH FDSDFLWLHV LQ &(GHYLFHV ZH DOVR H[SHFW GHYLFHV WR EHFRPH LQWHUFRQQHFWHG 8VLQJ KDQGKHOG GHYLFHV WKDW FRQQHFW ZLUHOHVVO\ WR YDULRXV GHYLFHV LQ WKH KRXVH LW ZLOO EH SRVVLEOH WR VHDUFK UHWULHYH DQG QDYLJDWH WKURXJK FRQWHQW VWRUHG RQ PDQ\ GHYLFHVLQWKHKRPH
,Q WKLV GHPR ZH IRFXV RQ WKH DXWRPDWLF JHQHUDWLRQ RI YLGHR VXPPDULHV XVLQJ FRQWHQW DQDO\VLV WHFKQLTXHV DQG VKRZ LWV DSSOLFDWLRQ LQ D KRPH V\VWHP $ 3HUVRQDO 9LGHR 5HFRUGHU DQDO\VHV UHFRUGHG 79 SURJUDPPHV DQG JHQHUDWHV VXPPDULHV $ KDQGKHOGGHYLFHLVXVHGWRZLUHOHVVO\EURZVHWKURXJKWKHFRQWHQW VWRUHGRQWKH395¶VKDUGGLVNDQGVHOHFWJHQHUDWHGVXPPDULHV
7<3(62)*(1(5$7('6800$5,(6
7KH ODUJH VWRUDJH FDSDFLW\ DYDLODEOH LQ IXWXUH SHUVRQDO YLGHR UHFRUGHUVFUHDWHVWKHQHHGIRUDXWRPDWLFDOO\JHQHUDWHGVXPPDULHV :H GLVWLQJXLVK EHWZHHQ WZR GLIIHUHQW DSSURDFKHV LQ FUHDWLQJ VXPPDULHV 7KHILUVWLVDYLGHRWUDLOHU:KLOHDVXPPDU\VKRXOGFDSWXUHWKH HVVHQFHRIWKHFRQWHQWDVZHOODVSRVVLEOHDWUDLOHULVXVHGWRKHOS WKH XVHU GHFLGH WR ZDWFK WKH 79 SURJUDPPHRUQRW$WUDLOHULV JHQHUDWHGE\DQDO\VLQJWKHFRQWHQWDQGVHOHFWLQJFOLSVIRFXVLQJRQ HQWHUWDLQPHQWUDWKHUWKDQDFFXUDF\7KHVHFOLSVDUHFRQFDWHQDWHG DQGSOD\HGDVDYLGHRWUDLOHU7KLVZD\WKHXVHUFDQTXLFNO\VHH ZKDWLQWHUHVWLQJSURJUDPPHVDUHDYDLODEOHZKLOHVWLOOVWD\LQJZLWK WKHSDVVLYHOHDQEDFNZDUGPRGHRIZDWFKLQJ79 $ VHFRQGW\SHRIVXPPDU\WKDWZHJHQHUDWHUHSUHVHQWVWKHFRQWHQW E\ VHOHFWLQJ UHSUHVHQWDWLYH IUDPHV DQG GLVSOD\LQJ D QXPEHU RI GRZQVFDOHGYHUVLRQVRIWKHVHIUDPHVVLPXOWDQHRXVO\8VLQJVXFK DQ RYHUYLHZWKHXVHUFDQTXLFNO\VHHZKDWWKHFRQWHQWLVDERXW :KHQPXOWLSOHVFUHHQVZLWKLPDJHVDUHDYDLODEOHWKHXVHUFDQIOLS WKURXJKWKHVHVFUHHQVDWKLVRZQUDWH7KXVSURYLGLQJDQHIILFLHQW ZD\WRFKHFNZKHWKHULWLVZRUWKZDWFKLQJWKHSURJUDPPHRUWR GHFLGHZKHWKHURUQRWKHVDZWKHSURJUDPPHDOUHDG\ ,QRXUGHPRQVWUDWLRQZHZLOOVKRZERWKW\SHVRIWUDLOHUVDOORZLQJ WRFRPSDUHWKHDSSURDFKHV 3HUPLVVLRQWRPDNHGLJLWDORUKDUGFRSLHVRIDOORUSDUWRIWKLVZRUNIRU SHUVRQDORUFODVVURRPXVHLVJUDQWHGZLWKRXWIHHSURYLGHGWKDWFRSLHVDUH QRW PDGH RU GLVWULEXWHG IRU SURILW RU FRPPHUFLDO DGYDQWDJH DQG WKDW FRSLHVEHDUWKLVQRWLFHDQGWKHIXOOFLWDWLRQRQWKHILUVWSDJH7RFRS\ RWKHUZLVH RU UHSXEOLVK WR SRVW RQ VHUYHUV RU WR UHGLVWULEXWH WR OLVWV UHTXLUHVSULRUVSHFLILFSHUPLVVLRQDQGRUDIHH
&RQIHUHQFH¶0RQWK&LW\6WDWH &RS\ULJKW$&0«
9,'(26800$5<$33/,&$7,216
*HQHUDWHGVXPPDULHVFDQKHOSWKHXVHUWRGHFLGHZKDWWRZDWFK WR GHFLGHZKHWKHURUQRWWRGHOHWHDSURJUDPPHWRILQGDFHUWDLQ VFHQHWRUHPHPEHUKDYLQJZDWFKHGWKHSURJUDPPHEHIRUHRUWR GHFLGHGRZQORDGLQJLW7KHVHIHDWXUHVDUHLQGLVSHQVDEOHIRUKDUG GLVNEDVHGSHUVRQDOYLGHRUHFRUGHUVFDSDEOHRIVWRULQJKXQGUHGV RI KRXUV RI YLGHR 7KH KDUG GLVN FDQ DOVR VHUYH DV D FDFKH WR EURZVHWKURXJKDSHUVRQDOYLGHRFROOHFWLRQVWRUHGRQ'9'V7KDW ZD\LWLVSRVVLEOHWRZDWFKVXPPDULHVRI'9'VDQGGHFLGHZKLFK RQH WR ZDWFK :KHQ VXPPDULHV DUH VWRUHG RQ WKH KDUG GLVN EURZVLQJFDQEHIDVWDQGHDV\:KHQDQLFHSURJUDPPHLVIRXQG WKHFRUUHVSRQGLQJ'9'FDQEHLQVHUWHG:KHQ ZDWFKLQJ D QXPEHU RI VXPPDULHV WKH XVHU VKRXOG EH DOORZHG WR VWRS SOD\EDFN RI D VXPPDU\ DQG VHH WKH QH[W RQH 2IWHQLWLVSRVVLEOHWRGHFLGHQRWWRZDWFKDSURJUDPPHLQMXVWD IHZVHFRQGVVLPLODUWR]DSSLQJWKURXJK79FKDQQHOV
,QVWHDGRIZDWFKLQJWKHJHQHUDWHGVXPPDULHVRQ79LWLVSRVVLEOH WR GRZQORDGWKHVXPPDULHVWRDKDQGKHOGGHYLFH7KLVZD\LWLV HJ SRVVLEOH WR YLHZ VXPPDULHV ZKLOH WUDYHOOLQJ 3UHIHUDEOH WKH OHQJWKRIWKHJHQHUDWHGVXPPDULHVLVXQGHUXVHUFRQWURO3HUKDSV WR NLOO VRPH WLPH GXULQJ WUDYHOOLQJ WKH XVHU ZRXOG SUHIHU VRPHZKDW ORQJHU WUDLOHUV 'XUDWLRQV RI VHFRQGV WR PLQXWHV VHHPWREHDUHDVRQDEOHUDQJH)RUSLFWXUHEDVHGVXPPDULHVWKH QXPEHURIVHOHFWHGUHSUHVHQWDWLYHIUDPHVFDQEHVHWKLJKHU
9,'(275$,/(56
7R EH DEOH WR LPSOHPHQW DXWRPDWLF JHQHUDWLRQ RI WUDLOHUV LQ &( GHYLFHV WKH DOJRULWKPV VKRXOG SHUIRUP WKH QHFHVVDU\ FRQWHQW DQDO\VLVLQUHDOWLPHDQGVKRXOGEHFRQWHQWLQGHSHQGHQW
'XULQJUHFRUGLQJORZOHYHOFRQWHQWGHVFULSWRUVDUHH[WUDFWHGIURP WKH FRQWHQW 7KLV LQFOXGHV SDUVLQJ WKH YLGHR VWUHDP XVLQJ VFHQH FKDQJHGHWHFWLRQDQGFRPSXWLQJVLPSOHVWDWLVWLFVVXFKDVWKHELW UDWHWKHDPRXQWRIPRWLRQWKHDPRXQWRIGHWDLOLQDVFHQHWKH DXGLR YROXPH HWF ,Q >@ ZH KDYH VKRZQ WKDW ORZOHYHO FRQWHQW GHVFULSWRUV FDQ EH H[WUDFWHG LQ UHDO WLPH XVLQJ H[LVWLQJ 03(* HQFRGHUFKLSV
6WDWLVWLFDOLQIRUPDWLRQRIWKHHQWLUH79SURJUDPPHDUHDQDO\VHG DIWHUUHFRUGLQJ7KHVHOHFWLRQRIDQDFWLRQVFHQHIRUH[DPSOHFDQ WKHQ EH EDVHG RQ WKH QXPEHU RI GHWHFWHG DFWLRQ VFHQHV LQ WKH HQWLUH SURJUDPPH 6LQFH WKH PDMRULW\ RI WKH DQDO\VLV ZRUN ZDV GRQH GXULQJ UHFRUGLQJ WKH VHOHFWLRQ RI FOLSV E\ DQDO\VLQJ WKH VWDWLVWLFDOGDWDUHTXLUHVOLWWOHWLPH
:H SURSRVH WR XVH PDQ\ ORZOHYHO VWDWLVWLFDO IHDWXUHV WR UHGXFH WKHGHSHQGHQF\RQWKHW\SHRIFRQWHQW$QDGGLWLRQDODGYDQWDJHLV WKDWWKHPRUHGLIIHUHQWIHDWXUHVDUHH[WUDFWHGWKHORZHUWKHQHHGHG DFFXUDF\ RI WKH H[WUDFWLRQ DOJRULWKP RI HDFK IHDWXUH )RU VRPH FDVHV DGGLWLRQDO HYHQW GHWHFWRUV FDQ EH KHOSIXO )RU H[DPSOH GHWHFWLQJ DQ H[SORVLRQ D FDU FKDVH D JRDO LQ D VRFFHU PDWFK ODXJKWHUDSSODXVHHWF+RZHYHUWKHQXPEHURIVSHFLDOHYHQWVWR GHWHFWFDQEHFRPHTXLWHODUJHDQGWKHHYHQWPLJKWKHDYLO\GHSHQG RQWKHW\SHRISURJUDPPH3UREOHPVZLWKVXFKDQDSSURDFKLQD SURGXFW DUH FOHDU &RQVLGHU UXQQLQJ DQ DOJRULWKP WKDW ZDV GHVLJQHGWRGHWHFWJRDOVLQDVRFFHUPDWFKRQDWHQQLVPDWFKRUD PRYLHE\PLVWDNH ,QWKHGHPRZHVKRZWKHUHVXOWVRIDQDOJRULWKPWKDWXVHVORZ OHYHOVWDWLVWLFDOGDWDWRFRQVWUXFWVKRUWWUDLOHUVIURPDUELWUDU\79 SURJUDPPHV
3,&725,$/6800$5,(6
$ VHFRQGW\SHRIYLGHRVXPPDULHVFRQVLVWVRISLFWRULDORYHUYLHZV FUHDWHG E\ VHOHFWLQJ UHSUHVHQWDWLYH IUDPHV >@ >@ 'XULQJ WKH UHFRUGLQJ D IUDPHWRIUDPH GLIIHUHQFH LV FRPSXWHG EDVHG RQ UHJLRQ FRORXU GLVWULEXWLRQ :KHQ WKH GLIIHUHQFH EHWZHHQ WZR LPDJHV LV ODUJH HQRXJK LW LV VHOHFWHG DV D FDQGLGDWH IRU IXUWKHU DQDO\VLV6HOHFWHGNH\IUDPHVWDNHSDUWLQIXUWKHUDQDO\VLVZKLFK FRQVLVWV RI D FOXVWHULQJ DSSURDFK WKDW LV SHUIRUPHG DIWHU WKH UHFRUGLQJ,PDJHVDUHFOXVWHUHGEDVHGRQWKHLUFRORXUGLVWULEXWLRQ VLPLODULW\2XU REMHFWLYH LV WR EXLOG D VXPPDU\ ZKLFK DOORZV WKH LGHQWLILFDWLRQRIWKHRULJLQDOYLGHRDIWHUYLHZLQJRQO\DUDQGRPO\ VHOHFWHG H[FHUSW RI WKH YLGHR ,Q RUGHU WR VDWLVI\ WKLV PD[LPXP UHFDOO FRQGLWLRQ WKH FRQVWUXFWLRQ SURFHVV LV RQH ZKHUH ERWK WKH IUHTXHQF\DQGORFDWLRQRIRFFXUUHQFHRIWKHIUDPHDUHHPSOR\HG VLPXOWDQHRXVO\ WR LGHQWLI\ WKH RSWLPDO IUDPH 7KLV ZD\ UHSUHVHQWDWLYHIUDPHVDUHVHOHFWHGLQDZD\WKDWFDSWXUHVDVPXFK LQIRUPDWLRQDVSRVVLEOHIURPWKHRULJLQDOYLGHR
'(6&5,37,212)7+('(02
7KHGHPRVKRZVDSHUVRQDOYLGHRUHFRUGHUFDSDEOHRIJHQHUDWLQJ YLGHR VXPPDULHV IURP 03(* GLJLWDO YLGHR EURDGFDVW VWUHDPV 8VLQJDKDQGKHOGGHYLFHWZRGLIIHUHQWW\SHVRIVXPPDULHVFDQEH VHOHFWHG7KHILUVWW\SHVKRZVDJHQHUDWHGVXPPDU\LQWKHIRUPRI D VKRUW YLGHR WUDLOHU 7KH VHFRQG W\SH VKRZV D VHOHFWLRQ RI WKH SURJUDPPH¶V PRVW UHSUHVHQWDWLYH IUDPHV )XUWKHUPRUH WKH VXPPDULHV FDQ EH YLHZHG RU VWRUHG RQ WKH KDQGKHOG GHYLFH DV ZHOODVGLVSOD\HGRQD79VFUHHQ7KLVGHPRZLOOVKRZWKHXVHU LQWHUIDFH LVVXHV LQYROYHG LQ YLHZLQJ VXPPDULHV RQ 3'$¶V DV RSSRVHGWRGHVNWRS3&¶VRU79¶V
7KLV GHPR GRHV QRW RQO\ VKRZ WKH IHDVLELOLW\ RI WKH SURSRVHG DOJRULWKPV EXW DOVR VKRZV KRZ GLIIHUHQW W\SHV RI JHQHUDWHG VXPPDULHVFDQEHXVHGLQIXWXUH&(GHYLFHV
$&.12:/('*(0(176
7KLVZRUNZDVFRQGXFWHGDVSDUWRIWKH6SDWLRQSURMHFW 6HUYLFHV SODWIRUPV DQG $SSOLFDWLRQV IRU WUDQVSDUHQW LQIRUPDWLRQ PDQDJHPHQW LQDQLQKRPH1HWZRUN 6SDWLRQVSRQVRUHGE\WKH (XURSHDQ8QLRQXQGHUWKH,67SURJUDP:HZRXOGOLNHWRWKDQN WKHSDUWQHUVLQWKHSURMHFW3KLOLSV5HVHDUFK(XUpFRP8QLYHUVLW\ RI%UHVFLD8QLYHUVLW\RI'HQPDUNDQG7RPRUURZ)RFXV
