資源描述:
《issues for corpus-based multimodal generation》由會員上傳分享,免費在線閱讀,更多相關(guān)內(nèi)容在教育資源-天天文庫。
1、IssuesforCorpus-BasedMultimodalGenerationMaryEllenFosterRoboticsandEmbeddedSystemsGroupFacultyofInformatics,TechnicalUniversityofMunichBoltzmannstra?e3,85748Garching,Germanyfoster@in.tum.deAbstractInrecentyears,data-drivenmethodshavebecomeincreasinglypopularinnatu
2、rallanguagegeneration.Multimodalgenerationcanalsobene?tfromusingcorpusdatadirectly;however,thereareseveralissuesthatarisewhenusingcorporaformultimodalgenerationthatdonotoccurintheunimodalcase,andthatmeanthatexistingmultimodalcorporaareoftennotsuitableforbeingdirec
3、tlyusedinagenerationsystem.1IntroductionInrecentyears,therehasbeenanincreasingamountofinterestinthecollection,annotation,anduseofmultimodalcorpora—recordedcollectionsofmultimodalhumanbehaviour,labelledandannotatedforuseintaskssuchasanalysisandsummarisation.Another
4、growing?eldofresearchisdata-drivenmethodsfornaturallanguageprocessing;thisbeganwithtaskssuchasparsingandmachinetranslation,butmorerecentlyresearchersinnaturallanguagegenerationhavebeguntotakeadvantageofthesedata-drivenmethodsaswell.Combiningtechniquesanddatafromth
5、esetwofast-growing?eldstoimplementmultimodalcorpus-drivengenerationaddsextrarequirementsthatdonotariseineachoftheindividualresearch?elds:corpus-basedtechniquesfortextgenerationdonotnecessarilyapplydirectlytothemultimodalcase,whilegeneral-purposemultimodalcorporaar
6、enotalwayssuitableforuseinagenerationsystem.Thispaperdiscussesseveraloftheissuesthatmustbetakenintoconsiderationifthetworesearchareasaretobecombined.Thepaperisstructuredasfollows.InSection2,we?rstsummarisethestateoftheartonmultimodalcorporaandtheuseofcorporainnatu
7、rallanguagegeneration.InSection3,wenextdescribethegenerationtaskonwhichthemostcorpus-drivenworkhasbeendone:generatingnon-verbalbehaviourforanembodiedconversationalagent.Afterthat,wesummariseinSection4severalissuesthatmustbetakenintoconsiderationwhendesigningacorpu
8、s-basedgenerationsystem,usingspeci?cexamplesfromtheconversational-agenttask.Finally,inSection5,wegivesomeconclusionsandrecommendations.2StateoftheArtIno