Reddit
Exploring the Stream

Stream, Hose, The Source, New Submissions
Whatever you want to call it.

The Raw Data Stream

I pulled the 2qr--- data.
Reddits with the ID of 2qr000 thru 2qrzzz.

46,656 potential data points.
44,997 posts successfully pulled.

Time from first post to last: 05:25:58
or about a five and a half hours.

Stream rate 2.3 posts a second,
which is equivalent to +/- 8,250 posts/hour.

I collected data on:
   id
   author
   over_18
   time
   domain
   subreddit
All of which except id being explored below


Submissions by Author

44,997 Raw Values
29,902 Authors
7,533 Posts with No Author Value

Number of Posts by the Top Ten Authors
[137, 136, 78, 77, 73, 68, 58, 56, 51, 49]
Many of these appeared to be bots

Average Number of Posts All Authors: 1.25
Average Number of Posts Authors with 'bot' in Name: 5.60
Ave Num Posts with 'bot' or similar in name: 4.23

Looks, like bots post more than humans across the board.
For all Authors with under ten posts
Overall Average: 1.17
'bot' in Name Ave: 1.43

Within the 5:25:58 timespan reviewed
26,486 Authors had 1 Post
2,469 Authors had 2 Posts
469 Authors had 3 Posts
160 Authors had 4 Posts
85 Authors had 5 Posts
42 Authors had 6 Posts
34 Authors had 7 Posts
23 Authors had 8 Posts
17 Authors had 9 Posts
13 Authors had 10 Posts
11 Authors had 11 Posts
15 Authors had 12 Posts
9 Authors had 13 Posts
5 Authors had 14 Posts
2 Authors had 15 Posts

Of the top 5 posters, 3 were clearly bots
Of the top 10 posters, 7 were deemed to be bots
In total,
265 Bots Were Deemed to Make 1120 Posts
Or almost 3% of the total (2.99%)

Want a prediction?
50% of traffic will be by bots within five years.
Users won't like it, so it will drop to 10-25%.
But that drop will be misleading:
As Bots will have gotten better and harder to detect
And within 10 years,
bots will account 95% of the content/comments on reddit.


Submission by NSFW

Because, you know, Science

Pie Graph showing ratio of NSFW posts
44,997 Posts
3,708 NSFW
8.24% of the Total

And that's all I have to say
About that.


Submissions by Time

The Front Page Waits for no redditor
(or something like that).


Of the posts this page refers:
Start Time: 2014-12-29 21:43:00
Finis Time: 2014-12-30 03:08:58
Time Span: 5:25:58 (hour, min, seconds)
Bar Graph showing Average Submission Rate to Reddit per Second
A nice and even normal distribution
centred around 2.3 submissions per second


Submission by Domain

The Internet is the Domain of reddit.
I mean, it is the front page, after all.

Lots of graphs with tons of small (albeit legible if enlarged) print.
But there's a table at the end, so no need to squint.

Top 100 Reddit Domains - The Raw Data Top 100 Domains from which content was posted
This is the Raw Data

I wouldn't spend too much time with any of these.
The data gets refined further along.

Top 20 Reddit Domains - Close Up on the Raw Data Same thing, top 20

Reddit Domains - Condensed Version - Smalls and Like, lumped together A Condensed Version
Singles: condensed into a group called 'Ones'
The same for Two through Ten
i.imgur.com lumped with imgur.com
youtu.be.com lumped wiht youtube.com

I wouldn't spend too much time with these.
Things change further along.

Reddit Domains - Condensed Version - Smalls Removed As per above, except low values (singletons, etc) removed rather than lumped together.

Reddit Domains - Condensed Version - Smalls Removed - Top 20 Top 20 after all cleansing operations.


And then, below the top 100 in table form.
Note, self means reddit; so typically, text that is original content made specifically for reddit.


And, um, clearly, I didn't do that good of a job condensing Domains.
So, this too gets revised again.
I guess I just hate throwing stuff out.
Or, you know, feel free to compare this to the next to see if you agree with how I chopped it down.

Top 100 Domains Posts
self 24,800
imgur 8,600
youtube 3199
gfycat.com 212
soundcloud.com 187
twitter.com 150
np.reddit.com 84
40.media.tumblr.com 79
flickr.com 70
41.media.tumblr.com 69
getandroidapp.org 56
theguardian.com 54
en.wikipedia.org 53
38.media.tumblr.com 53
nytimes.com 51
twitch.tv 50
amazon.com 50
baindaily.com 49
facebook.com 48
washingtonpost.com 46
livememe.com 46
33.media.tumblr.com 46
redd.it 44
instagram.com 44
hiddenlolcdn.com 44
vimeo.com 41
flibusta.net 40
bbc.com 37
amren.com 36
steamcommunity.com 35
copy.com 35
bbc.co.uk 35
reuters.com 34
36.media.tumblr.com 32
huffingtonpost.com 31
economico.sapo.pt 31
cdn.awwni.me 29
ibtimes.com 27
vine.co 25
jornaldenegocios.pt 25
puu.sh 24
imgflip.com 24
gifsound.com 24
timesofindia.indiatimes.com 23
hardmob.com.br 23
theverge.com 22
xhamster.com 21
news.yahoo.com 20
telegraph.co.uk 19
medium.com 19
housefengshui.net 19
gyazo.com 19
dailymail.co.uk 19
pbs.twimg.com 18
news.google.com 18
farm8.staticflickr.com 18
espn.go.com 18
elperiodico.cat 18
31.media.tumblr.com 18
rt.com 17
okcupid.com 17
wsj.com 16
vid.me 16
upload.wikimedia.org 16
prettyblackcamgirls.tumblr.com 16
latimes.com 16
cloud-4.steampowered.com 16
upi.com 14
sputniknews.com 14
pornhub.com 14
play.google.com 14
lospaziobianco.tumblr.com 14
github.com 14
en.m.wikipedia.org 14
docs.google.com 14
buzzfeed.com 14
rawstory.com 13
makeameme.org 13
independent.co.uk 13
i.gyazo.com 13
farm9.staticflickr.com 13
cnn.com 13
cbc.ca 13
businessinsider.com 13
xvideos.com 12
wcvb.com 12
vidble.com 12
vdare.com 12
npr.org 12
arstechnica.com 12
archive.today 12
yayanimalpix.tumblr.com 11
scmp.com 11
nydailynews.com 11
google.com 11
girl-cross-zone.blogspot.com 11
boston.barstoolsports.com 11
abc.net.au 11


Final Domain

The short version


Reddit Domains - Final Condensed Version - Smalls Removed - Top 10 The Top 10 Sources of Content for reddit.
NOTE: reddit self posts are Number 1.

And here, the Top 100

Top 100 Domains Posts
self 24,939
imgur 8,600
youtube 3,199
tumblr 338
gfycat.com 212
soundcloud.com 187
twitter.com 150
wikipedia 83
flickr.com 70
google 57
getandroidapp.org 56
theguardian.com 54
nytimes.com 51
twitch.tv 50
amazon.com 50
baindaily.com 49
facebook.com 48
washingtonpost.com 46
livememe.com 46
instagram.com 44
hiddenlolcdn.com 44
vimeo.com 41
flibusta.net 40
bbc.com 37
amren.com 36
steamcommunity.com 35
copy.com 35
bbc.co.uk 35
reuters.com 34
huffingtonpost.com 31
economico.sapo.pt 31
cdn.awwni.me 29
ibtimes.com 27
vine.co 25
jornaldenegocios.pt 25
puu.sh 24
imgflip.com 24
gifsound.com 24
timesofindia.indiatimes.com 23
hardmob.com.br 23
theverge.com 22
xhamster.com 21
news.yahoo.com 20
telegraph.co.uk 19
medium.com 19
housefengshui.net 19
gyazo.com 19
dailymail.co.uk 19
pbs.twimg.com 18
farm8.staticflickr.com 18
espn.go.com 18
elperiodico.cat 18
rt.com 17
okcupid.com 17
wsj.com 16
vid.me 16
latimes.com 16
cloud-4.steampowered.com 16
upi.com 14
sputniknews.com 14
pornhub.com 14
github.com 14
buzzfeed.com 14
rawstory.com 13
makeameme.org 13
independent.co.uk 13
i.gyazo.com 13
farm9.staticflickr.com 13
cnn.com 13
cbc.ca 13
businessinsider.com 13
xvideos.com 12
wcvb.com 12
vidble.com 12
vdare.com 12
npr.org 12
arstechnica.com 12
archive.today 12
scmp.com 11
nydailynews.com 11
girl-cross-zone.blogspot.com 11
boston.barstoolsports.com 11
abc.net.au 11

Sure, I could reiterate the process and condense flickr and steam, but I'm not going to.

And this might not surprise you, but I'd never considered reddit as a source of music before starting this project. So, I would have never expected the 6th most popular feed (I use the term loosely) to be from a music site.

I presume, also, that one could determine the relative popularity of the different news sites based on their rankings in this list, but I shall leave that as an exercise for the reader.

For my purposes, this perhaps (just perhaps), can provide a reasonable roadmap for expansion. It making more sense to put forth effort to follow imgur links (about 100 times more sense) than following flickr link.

Also, if I was employed by FaceBook, I do believe integrating reddit into the feed, would be my first project proposal. I suppose the same could be said for all the rest, as well. Which is to say, for lack of a better description, reddit is sucking content from all of these other sites; returning the favor will likely be the only way to survive. Feed or be fed, if you know what I mean.


Submission by SubReddits

The Initial Impetus
of this entire study,
believe it or not.


Pie Graph of Most Popular SubReddits - Jan 2015
All Subreddits with more than 200 submissions, this range:
a figure specifically chosen to include r/music.

Most Popular Subreddits Posts Out of 44,997
Fireteams 1725
AskReddit 1363
funny 591
GlobalOffensiveTrade 553
leagueoflegends 501
pics 497
videos 373
Showerthoughts 350
buildapc 344
trees 322
dirtypenpals 314
DestinyTheGame 313
aww 295
gaming 286
AdviceAnimals 270
pcmasterrace 259
GlobalOffensive 259
halo 243
news 214
Music 200

Fireteams accounts for 3.83% of the total.
I'm going to have to find out what that's about.

Here's a breakdown of the GiF subreddits

Pie Graph of Most Popular GiF SubReddits - Jan 2015

Significant Subreddits

One of the things I specifically wanted to output when I started this project was a list of the most popular subreddits, so I could enhance my user experience, adding r/'s as desired to my browsing sessions.

So, without any censorship, these are ALL the subreddits with more than 10 posts in the timespan examined.


Fireteams AskReddit funny GlobalOffensiveTrade leagueoflegends pics videos Showerthoughts buildapc trees dirtypenpals DestinyTheGame aww gaming AdviceAnimals pcmasterrace GlobalOffensive halo news Music explainlikeimfive gonewild friendsafari PS4 mildlyinteresting worldnews todayilearned movies FIFA relationships techsupport secretsanta havoc_bot DotA2 betternews dirtykikpals askscience electronic_cigarette wow nfl pokemontrades hearthstone xboxone amiibo WTF teenagers pokemon jailbreak SteamGameSwap r4r spam giftcardexchange personalfinance nba MakeupAddiction Fitness serialpodcast bindingofisaac circlejerk gifs NoFap whowouldwin WritingPrompts SquaredCircle Tgirls hiphopheads smashbros politics Smite dragonage TheLastAirbender Art EliteDangerous sex bolsa TrollXChromosomes photoshopbattles listentothis cats tipofmytongue Kikpals Bitcoin offmychest CFB remove hockey reactiongifs conspiracy tipofmypenis soccer Steam Minecraft Jokes atheism anime Random_Acts_Of_Amazon technology food MaddenUltimateTeam tifu dayz EarthPorn conspiro fatpeoplehate androidfiles Musicthemetime TumblrInAction Pokemongiveaway 2007scape legaladvice GrandTheftAutoV ClashOfClans malefashionadvice ladybonersgw KerbalSpaceProgram tf2 postcards baindaily Sneakers CodAW itookapicture depression MechanicalKeyboards LifeProTips DIY runescape gonewildcurvy SkincareAddiction Android travel Tinder DirtySnapchat CHIBears AskHistorians unusualporn CasualConversation Aggregat0r summonerschool skyrim me_irl cringe hardwareswap redditgetsdrawn lego RandomActsOfBlowJob GetMotivated sports TeamRedditTeams Flibusta AskWomen ultrahardcore nosleep latafanera dirtyr4r TwoXChromosomes PuzzleAndDragons NoStupidQuestions Monstercat Best_Porn_Gifs AskMen streetwear PokemonPlaza NHLHUT AppNana penis apple LiverpoolFC Drugs AskDocs woahdude cringepics Watches WastelandPowers StarWars OkCupid Guitar amiugly PatriotLibrary CasualPokemonTrades raisedbynarcissists mildlyinfuriating listentoremoved skyrimmods nsfw mistyfront TTRStatus RedditLaqueristas BostonRSS supremeclothing summonerswar kohi iOSthemes fakeid NSFWskype Filmmakers BabyBumps vinyl unremovable nottheonion hightestalpha headphones australia Rateme Games CoDCompetitive television subaru relationship_advice promobr new_right montageparodies learnprogramming iphone battlefield_4 MMA KotakuInAction DarkSouls2 Celebs ACTrade starcraft magicTCG india guns gentlemanboners eu4 cars books Warthunder PhotoshopRequest NewTubers Libertarian Guildwars2 Futurology Christianity 49ers space pornID podemos loseit korrasami exmormon dogecoin Starcitizen_trades OldSchoolCool DnD Advice pathofexile longtail listentothat fresh_funny ffxiv buildapcforme b00b3d Yogscast Planetside GoneWildPlus GamerGhazi Eve woodworking science motorcycles crochet comics civ bravefrontier bicycling assassinscreed Wishlist UHCMatches SuicideWatch Seahawks RealGirls Multicopter LetsPlayVideos DarkNetMarkets CoonTown Aquariums vaporents silkysmoothmusic paydaytheheist feedthebeast dogs childfree business boardgames beerporn SteamTradingCards RecruitCS NBA2k ImGoingToHellForThis HITsWorthTurkingFor GreenBayPackers worldpolitics starcitizen fantasyfootball casualiama SubredditDrama Health 4chan wiiu rupaulsdragrace picrequests mindcrack knowyourshit heroesofthestorm MLPLounge Homebrewing yugioh mylittlepony metalgearsolid jobs detroitlions beards ass SuggestALaptop ShinyPokemon RandomActsofMakeup PhxClassWarCouncil Patriots Gonewild_Market GoneMild GifSound DoesAnybodyElse Cooking Assistance writing wicked_edge monkeynewsbot keto gameswap fivenightsatfreddys creepy chicago awwnime asoiaf asmr airsoft Twitch LosAngeles Fallout DeepIntoYouTube 3DS whatisthisthing weekendgunnit web_design tumblr skiing running ravens nocontext hypotheticalsituation gopro bodybuilding PokemonInsurgence NotYourMothersReddit MassiveCock Cricket CrazyIdeas Conservative ApocalypseRising Animesuggest AdoptMyVillager windowsphone trap realtech oneplus oddlysatisfying nyc inthenews firstworldanarchists electronicmusic asktransgender TagPro RandomActsOfMuffDive Pokemontutoring OCPoetry NSFW_GIF CrappyDesign Boobies Anxiety AndroidQuestions xray wowguilds worldbuilding webdev snapchat playstation notinteresting interestingasfuck harrypotter futurebeats conservatism comicbooks carporn canada britishproblems aviation Warframe ThisIsMySubRedditOnly Sexsells PSNFriends HurcleyAdvLog GaybrosGoneWild FoodPorn Dota2Trade wallpapers undeleteWorldNews toronto spaceengineers shittyfoodporn rpg roosterteeth raspberry_pi punchablefaces picsonly photography osugame nsfw_gfys nexus6 investing googlenewsfeed gadgets fantasybball dadjokes creepyPMs WhiteIdentity TopGear Naruto MaddenMobileForums Indiemakeupandmore Entrepreneur youtube xxfitness stopdrinking poker longboarding leafs history ecigclassifieds darksouls cowboys changemyview applehelp TheRedPill SchoolIdolFestival Portland MelissaFumero IndianNewsArchive IceandFirePowers GTAV GCXRep FifaCareers FantasyPL EverythingScience Chromecast BlackGirlCams 195 zelda syriancivilwar slashdiablo sgsflair sexytimechat self see photocritique pcgaming opiates nostalgia mangonewild lesbianstoriesGW knitting knifeclub fatlogic farcry fantasylife dwarffortress dogpictures argentina YouTubeGamers WorldofTanks Nexus5 NHLStreams Metal MensRights HaloPlayers FancyFollicles EDM CrusaderKings Coffee Civcraft BeautifulCelebrities Austin 3Dprinting worldpowers weddingplanning steelers startups powersofarda nintendo neopets mountandblade minnesotavikings manga malehairadvice mac lgbtifm justneckbeardthings hcteams hackernews giveaways gamecollecting fumetti forhire flying environment dontstarve cscareerquestions college beer asstastic SoDB_Ringwraith Seattle SVExchange SSBPM Random_Acts_Of_Pizza RandomKindness Marvel Maplestory AnimeFigures 3dsFCswap youtubehaiku vita vgstreams vegan tmobile thelastofusfactions solaractivity shittyaskscience reddevils randomactsofsteam philosophy oaklandraiders nsfw_gifs nbacirclejerk math knives juicyasians intrusivethoughts indiegameswap femalefashionadvice feet europe disney deathgrips breakingmom boston bestof askgaybros arma WildNews WeAreTheMusicMakers ThatsARepost Terraria TalesFromRetail Silverbugs ShinyPorn ScotchSwap RandomActsOfPizza PKA Metalcore Madden LGG3 JusticePorn Jeep IAmA HomeImprovement GiftofGames GfycatDepot Coilporn Browns Baking AnythingGoesNews whatcarshouldIbuy titanfall theworldnews tattoos shittyreactiongifs russia relaxedpokemontrades panthers ottawa offbeat lotr lewronggeneration letsplay houston hometheater guitarpedals gamedev galaxynote4 firstworldproblems facepalm elMatadero dating_advice cordcutters cock climbing catpictures audiophile asktrp ThisIsOurMusic Pets Pathfinder_RPG Parenting Mindcrackvids LucidDreaming InteriorDesign GameSale Frugal FIFACoins Economics Documentaries CollegeBasketball ClashOfClansRecruit Catholicism Bad_Cop_No_Donut xbox360 unitedkingdom ukraina trashy trance thewalkingdead t0mf spankingvideos socialism seduction rage nothingbutheels netflix needadvice muacirclejerk mflb mexico mechmarket islam gameminer firstimpression elderscrollsonline drunk doctorwho dndnext dataisbeautiful csgobetting counterstrike cosplay chromeos caps boobs beermoney batman audioengineering ar15 androidcirclejerk YayAnimalPix Warhammer40k UsefulWebsites Unexpected TryingForABaby Toontown TAAOfficial Surface SpaceNewsBot Rainmeter MotoX Military MapPorn MUTCoinSelling LongDistance LadyBoners LGBTnews GirlsPicCollection GUDRSPLAYERS FreeKarma Fishing FetishItems EDC Dentistry DCcomics Bandnames AverageJoeAudiophile Autos ArtJunkie webcomics ukpolitics totalwar softwareswap sneakermarket sanfrancisco sandiego redditrequest rawdenim rangers progresspics pitbulls phoneverification penpals oculus newzealand misleadingthumbnails microgrowery lgbt italy gtaonline gtaglitches gardening gamingsuggestions france drawing diablo3 dbz crossdressing computers christmas characterdrawing bodyweightfitness bjj bigh beertrade aves androiddev androidapps actuallesbians UpliftingNews TeraOnline StLouis ShouldIbuythisgame ShadowBan SSBM ProtectAndServe PoliticalTalk PlantedTank OpTicGaming NYGiants MilitaryPorn KeybaseProofs KIKSnaps Gunners GuessTheMovie GameTrade GameDeals Flipping Eberron DenverBroncos Cyberpunk CODClanHQ BostInno AskVet AskScienceFiction

Not Long Enough

Ironically, a list that large (or only of that size) doesn't actually address my needs as many of the most useful subreddits only get intermittent action.
Pie Graph of Subreddits with 'Programming' in Name in TimeSpan Reviewed - Jan 2015 The above in tabular form.
Note: the significant proportion of 1's.

Reddits with 'Programming' in Name Hits
learnprogramming 30
programming 9
iOSProgramming 7
programminghorror 1
futureofprogramming 1
ProgrammingBuddies 1
C_Programming 1
AskProgramming 1


These are Subreddits that I'm already following.

Subreddits Following Hits
Programming 9
Python 3
TheoryOfReddit 0
redditdev 0


Two misses means I'm batting 50%.
I guess I need to do a wider sweep.
which at 2 seconds a post
(reddit's API limit)
could take a while.

In the meantime...
well, I'll think of something.



www.paufler.net

Brett Stuff

© 2015 copyright Brett Paufler
paufler.net@gmail.com
Terms of Use