64th Day Of Lockdown

Maharashtra54758169541792 Tamil Nadu177289342128 Delhi152577264303 Gujarat148297139915 Rajasthan76804341172 Madhya Pradesh70243689305 Uttar Pradesh67243824177 West Bengal40091486283 Andhra Pradesh3117206558 Bihar300680014 Karnataka240576245 Punjab2106191840 Telangana1991128457 Jammu and Kashmir175983324 Odisha15937337 Haryana130582416 Kerala9645426 Assam683634 Jharkhand4261534 Uttarakhand400644 Chhatisgarh360790 Chandigarh2781874 Tripura2321650 Himachal Pradesh223634 Goa67280 Puducherry49170 Manipur3940 Meghalaya20121 Nagaland900 Arunachal Pradesh210 Mizoram110 Sikkim100
Technology Other News 15 Jul 2019 No more spoilers, al ...

No more spoilers, all thanks to this new AI tool

ANI
Published Jul 15, 2019, 11:14 am IST
Updated Jul 15, 2019, 11:14 am IST
The tool the researchers developed could be used to build a browser extension to shield people from spoilers.
The reviews were collected from Goodreads, a social networking site that allows people to track what they read, and share thoughts and reviews with other readers.
 The reviews were collected from Goodreads, a social networking site that allows people to track what they read, and share thoughts and reviews with other readers.

Researchers have developed an AI-based system that can figure out spoilers in online reviews of books and TV shows.

"Spoilers are everywhere on the Internet and are very common on social media. As Internet users, we understand the pain of spoilers, and how they can ruin one's experience," said one of the paper's senior authors, Ndapa Nakashole.

 

Some websites allow people to manually flag their posts with tags that serve as 'spoiler ahead' warning signs. But this doesn't always happen. So researchers, who presented the study at Association for Computational Linguistics, wanted to develop an artificial intelligence tool powered by neural networks to automatically detect spoilers. They named the tool SpoilerNet.

On a theoretical level, researchers want to better understand how people write spoilers and what kind of linguistic patterns and common knowledge mark a sentence as a spoiler.

The tool the researchers developed could be used to build a browser extension to shield people from spoilers. To train and test SpoilerNet, researchers went looking for large datasets of sentences containing spoilers. Spoiler alert! They found none. So they created their own by collecting more than 1.3 million book reviews annotated with spoiler tags by book reviewers.

The tags encompass sentences that include spoilers and hide them behind a "view spoiler" link in the text. The reviews were collected from Goodreads, a social networking site that allows people to track what they read, and share thoughts and reviews with other readers.

"To our knowledge, this is the first dataset with spoiler annotations at this scale and at such a fine-grained granularity," said the paper's first author, Mengting Wan.

Researchers found that spoiler sentences tend to clump together in the latter part of reviews. But they also found that different users had different standards to tag spoilers, and neural networks needed to be carefully calibrated to take this into account.

In addition, the same word may have different semantic meanings in different contexts. For example, 'green' is just colour in one book review, but it can be the name of an important character and a signal for spoilers in another book. Identifying and understanding these differences is challenging, Wan said.

Researchers trained SpoilerNet on 80 per cent of the reviews on Goodreads, running the text through several layers of neural networks. The system could detect spoilers with 89 to 92 per cent accuracy.

They also ran SpoilerNet on a dataset of more than 16,000 single-sentence reviews of about 880 TV shows. The accuracy of the tool to detect spoilers was 74 to 80 per cent.

Most of the errors came from the system getting distracted by words that are usually loaded and revelatory for example murder or killed.

Looking forward, the Goodreads dataset can be used as a powerful tool to train algorithms to detect spoilers in different types of content said tweets containing spoilers.

Click on Deccan Chronicle Technology and Science for the latest news and reviews. Follow us on Facebook, Twitter

...




ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT