|
Hi, I'm a student from Vietnam. I'm not clearly understand how to evaluate single text summarization system using ROUGE. I mean, I have a data set include a source text, a model file and a system file (generated by my system), and I don't know how to evaluate my system using this data set with ROUGE. I tried follow http://kavita-ganesan.com/rouge-howto but the result is all 0.00000 (you can see in the image below). I think maybe I have something wrong. So please help me to evaluate summarization using ROUGE. Thanks. Dataset: https://www.dropbox.com/sh/h3qdsppvlmzezua/TDHNdRoSMz/DataSet.zip My evaluate case: https://www.dropbox.com/sh/h3qdsppvlmzezua/cIM-Sh73OP/EvaluateCase.zip The Result:
|
|
Hey Nguyen Viet Anh, I got the same problem. Did you figure out a way to solve this? Best, Benjamin |
|
Look at previous answer on a similar question posted on this forum: Rouge for single document summarization Hope you find it helpful. |
