Reddit SFW Plugin





Reddit SFW Plugin

 

 

Motivation

Reddit is an online social media platform where people can read and share posts from various topics ranging from News, politics, Science, Dark humour etc. There are many posts and subReddits which are Not Safe For Work and you would not like them to popup when you are with family or in public. The main motivation behind our project was to create an SFW plugin for Reddit which let’s the user create multiple profiles (like Home, Family, Work) and choose what kind of posts he would like to see when that profile is on. We want the user to provide the user the freedom to browse Reddit safely without the fear of an NSFW or a controversial post coming up when they want which may make him feel uncomfortable with others.

               

Functionality

There a few posts on Reddit which are implictly marked as Controversial/NSWF by Reddit itself according to their upvote ratio, comments etc. But there are still a lot of posts which are not marked as NSFW/Controversial by Reddit but may have the potential to be one. So for such kinds of posts, we offer the user to classify them as one and filter these out for him.

Finally our Reddit SFW plugin offers the following functionalities-
○ You can create/destroy a profile
○ In each profile you can add Subreddits into a blacklist/whitelist of a profile.
○ You can switch Safesearch on/off. If it is on then our plugin will run the spacy model on the backend for the comments of each post. It classifies each post into Top/NSFW/Controversial for those which are not explicitly marked by Reddit.
○ You can load the profile and correspondingly choose blacklist/whitelist to follow

This is the UI of our plugin. It offers the create a new profile, select a profile, select blacklist & whitelist. The current chosen profile is home which has whitelist selected which contains r/news, r/politics, r/AskReddit. As you can see in figure2, only posts from these subReddits are there in the feed.
                        

 Approach

The approach that we use is as follows- We first Collect top, controversial and NSFW posts from Reddit which are already marked as such. We extract their comments data using the Reddit API PRAW. There are a lot of posts on Reddit which don’t have text but images or links. So for these posts we scrape their comments and analyse them to classify them. We collected 100K comments from each of the categories(Top, Controversial, NSFW) and use these as the dataset to train our classifer model.

We collected NSFW posts from some famous NSFW SubReddits like r/nswf, r/porn, r/morbidreality. SubReddits used for top as well as controversial posts were r/funny, r/AskReddit, r/news, r/politics. These subReddits are followed by a large number of a people and have a variety of posts that can be used to build a good enough dataset spanning over multiple kinds of features. These are the subReddits that define Reddit itself.

For our current training approach we used Spacy’s TextCategorizer model to train on the extracted data. It is a CNN based model which assigns positive/negative vector to each word in the document. The document tensor is then summarized by concatenating max and mean pooling. Multilayer perceptron is then used to predict an output vector of length Number of Classes.

We acheived pretty good results with an F-score of 0.65 after 15 epochs of training. Considering that the dataset was not human annotated but just based on the belief that the comments of the post can accurately identify it as NSFW or controversial, the results are quite remarkable.

Demo


We also have the demo for our plugin here. Though in the final plugin we collapse the NFSW and controversial posts from the feed if safe search is on, for demo purposes we have just tagged it(in RED on top right). The post “ Trump retweets... ‘for treason’ ” has been marked as Controversial.We also have a post from Statue gropers where a man is groping a statue of Wonder Woman which has been marked as NSFW. These posts are not explicitly marked by Reddit but our model feels they have potential to be controversial and NSFW respectively after analysing their comments.






Gallery and Video

 


 

 

 

 

                              

 


Comments

Post a Comment

Popular posts from this blog

Hate Speech Analysis on Gab

Image
Introduction Our project deals with the social media website Gab, which rose to prominence recently when Pittsburgh synagogue shooter, Robert Bowers, was found to be an active user of the social media website. But, what is Gab? Gab is basically a Twitter clone, and just like Twitter, it allows users to read and write multimedia messages of up to 300 characters, called "gabs". The major difference in the two websites is the guidelines governing them. Unlike Twitter, Gab has a small set of rules: No threats/terrorism, No illegal pornography, Legal pornography is allowed(but must be marked NSFW), and No doxxing Due to Gab's very limited set of rules rules (along with poor enforcement), it has become a breeding ground for conservative, libertarian, nationalists and populist internet users. Data Using Gab's API, we crawled the website and collected a total of 18562 gabs, around 10000 user profiles, 600 trending topics and 7500 trendi
Read more

LinkIt

Image
Introduction Our world today revolves largely around the internet, especially social media. With the advent of internet giants like Facebook, Twitter, Google, the internet has become a hub for a large part of the human population. Naturally, a large amount of personal data exists within the “secure” databases of these giants. Just how much about a person can be inferred from this treasure trove of personal data on these databases? That is exactly what we decided to figure out with this project. What is LinkIt? LinkIt is a project of the Privacy and Secirity in Online Social Media Course that aims to create awareness about the consequences of accepting requests from unknown people on online social media platforms. Aim We attempt to analyze the statistics of a group of people across multiple social networks like Facebook, Instagram, and Twitter to gauge the following Emotional band Popularity Level of activity and active hours What their broad interests are (based
Read more

Authenticity of Linkedin Profiles

Image
Authenticity of Linkedin Profiles poster Webapp demo webapp Problem Lot of people put false work experience and other information on Linkedin in order to gain attention of the recruiters. Given a linkedin profile, determine the evidence of authenticity of information present on the user's linkedin profile from publicly available information about that user on other social networks (for example facebook). Data Collection Approach : Given a username on linkedin, we scrape the information on the profile (such as work experience, education etc). From the personal information such as name, age, city etc, we then go to facebook and search for similar profiles. We try to find the most similar profile from the search result. We then scrape the timeline of the user and compare that information with the information on linkedin profile. Method : Linkedin does not provide any API to get the user profile information. Wrote a scraper using selenium to
Read more