>>3272 When a single file in a single post can be as big as 32MB, it adds up fast. We also average ~85 posts per hour, every hour, all day, seven days a week. That's 744,000 posts per year.

>>3273 Yeah but half of those are just me arguing with myself.

No, that's only posted files, without duplicates and thumbs (I think).

>>3272 400GB now

>420.77 GB Dude weed lmao

>521.11 GB What the hell? Where is all of this coming from, the porn boards?

>>4467 Them, and retards misusing the "copy image" function, causing the internal system to generate bloated PNG files that weight between 10 and 30MB each.

>>4469 Here are some ways in which this could be dealt with: * That in some way the server is able to differentiate between photographs, scans, drawings, diagrams and screenshots. The first two can be saved as jpg without noticeable loss of quality. * Determine if the image contains many artifacts, which would indicate that it was saved as a jpg before. * Use a quantizer like http://pngnq.sourceforge.net/ to compress the image. * Save them as webp instead of png.

877.70 GB now

>>6718 >The first two can be saved as jpg without noticeable loss of quality. Are you a zillennial, millennial, or some similar low form of life? Imageboards thrive on the ability to use lossless, artifact-free formats. If PNG art started getting compressed with shit artifacts that YOU CAN NOTICE BY THE WAY, even fewer people will post here. >>6718 >Save them as webp instead of png Fuck you doublenigger FUCK YOU. Fuck webp. Nothing on my machine opens them. Eat a bag of nigger dicks immediately and choke on each one and die on the last. Holy fuck you are so STUPID. I really hope you kill yourself immediately upon receipt of this message.

>>6723 >Nothing on my machine opens them. Thats entirely a (You) problem then.

>>4469 >internal system LOL what the fuck are you talking about, nigger? This "internal system" is actually the browser. Internal system....... lmao

>>6721 Considering it's nearly a year later, that seems normal.

>>6718 kill yourself

>>6723 <nOtHiNg On My MaChInE oPeNs ThEm >he doesn't use arch linux

>>6801 Woah anon you are trans too?

>>6718 > Save them as webp instead of png I just came her to say fuck you. webp is fucking cancer.

>>6718 >* Use a quantizer like http://pngnq.sourceforge.net/ to compress the image. It seems to be the most reasonable and easiest option to implement. I was doing some tests with the image of >>6801 and these are my results: Original size: 72.34 KB Size after uploading from clipboard: 1.17 MB Size after compressing the reuploaded image with pngnq: 208.54 KB The only drawback is that the new replies may take a little longer to appear due to the additional processing required by using pngnq. >* Save them as webp instead of png. Beyond the bullshit, it could be useful in certain cases. In this chan it wouldn't make much sense (I think), but if you manage a chan and it runs on a VPS with space limitations, then it would be necessary to save every MB you can. One way to achieve this would be with some option to indicate in which format by default to save the images that come from the clipboard (png, jpg or webp), perhaps along with an explanation of the pros and cons of each. >>6723 >Imageboards thrive on the ability to use lossless, artifact-free formats But that does not mean that it can be used for everything indiscriminately. For example, with https://commons.wikimedia.org/wiki/File:Vienna-big.tif (which weighs 3.94 GB) I got the following when I converted it into these formats: PNG: 2034.84 MB JPG (92% quality): 171.08 MB As you can see, using png is not always ideal. I also wanted to try with the format that makes everyone on this board burn their asses WebP, but the maximum pixel dimensions of a image in this is 16383 x 16383. >Nothing on my machine opens them. I'm just going to leave this here: https://www.youtube.com/watch?v=d4HhLQEc_2o >>6725 >This "internal system" is actually the browser You do know that it refers to the server where the chan is running, right? Or at least I interpret it that way.

>>4467 It's not because of the large migrations of the hispachan and india-indiachan userbase, is it?

>>7713 Not really. Based on the data attached in this answer, the following conclusions can be made: * >>>/delicious/ is the heaviest board with 64.13 GB. * >>>/dpsn/ only weighs 8 KB, which makes it the lightest of the chan. There are also a few boards that have text-only threads or are completely empty. * The data set that I was analyzing only covers 770.21 GB that are from the accessible boards, the rest (approximately 376.67 GB) belong to non-indexed boards. * The Spanish boards (around 30, although most of them were opened after the closure of hispachan.org) weigh together 77.36 GB, while the Indian boards (>>>/india/, >>>/indiachan/ and >>>/aic/) only occupy 2.17 GB. That in total would be a little more than 10%. Below I leave the script in Bash that I made to get the data: # TODO: Get the number of pages of the boards list automatically boards=$({ for pagelist in $(seq 1 5); do # Make an HTTP request to the site's board listing response=$(curl --header 'Cookie: disclaimer=1' --referer "https://8chan.moe" "https://8chan.moe/boards.js?page=$pagelist"); # Extract the board names from the response echo "$response" | grep -oE '<a class="linkBoard" href="/(\w+)/">' | cut -d"/" -f2; done; }) # Use an array to store the name of the boards along with the file sizes of each one declare -A board_sizes; for board in $(echo "$boards"); do # Get the id of the threads from the board catalog printf "Checking %s...\r" $board; threads="$(curl --compressed -s --header 'Cookie: disclaimer=1' --referer "https://8chan.moe" "https://8chan.moe/$board/catalog.json" | jq ".[].threadId")"; # Sum the size of all the files on the board in a variable file_sizes=0; thread_counter=1; total_thread=$(echo "$threads" | wc -l); for thread in $(echo $threads); do printf "Checking %s: %i/%i\r" $board $thread_counter $total_thread; total_thread_size=$(curl --compressed -s --header 'Cookie: disclaimer=1' --referer "https://8chan.moe" "https://8chan.moe/$board/res/$thread.json" | jq ".files[].size, .posts[].files[].size" | awk '{ SUM += $1} END { print SUM }'); # Only sum in $file_sizes if the thread has at least one file if [ -n "$total_thread_size" ]; then ((file_sizes+=$total_thread_size)); fi ((thread_counter+=1)); done; echo; board_sizes[$board]=$file_sizes; done # Display the results in "board,size" format and order by the largest size { for board in "${!board_sizes[@]}" do echo $board,${board_sizes[$board]}; done; } | sort -n -k2 -t"," -r unset board_sizes; And finally the CSV table that I obtained with the previous script: board name,size (in bytes) delicious,68859608227

[Expand Post]

tkr,62327412923 vore1,47622257176 v,42186892948 polarchive,32951047902 co,31766994066 hisrol,31560161344 2dblacked,28824719081 rule34,27564346890 sm,26877721551 interracial,25694040425 abdl,24853986133 wooo,23882836330 pol,21750584919 loli,20244058093 b,19325948490 h,18970808984 fur,18495131685 404,18377139635 av,16959978506 monarchy,16695034644 library,13676022773 zoo,13661323863 fast,12965023104 cyoa,11620351771 ac,10674851421 hispol,10667594550 gts,8743814040 hyper,8219360732 ss,7714598588 edit,7413854218 a,6327439884 vgp,5867545848 k,4843945804 loomis,4612467182 cb,3776929086 vt,3692760417 ita,3628170333 bleached,3188187623 arepa,2987658071 hispachan,2834296144 bane,2484832242 liberty,2477182975 teyvat,2416634912 tot,2117856579 feet,2083659683 ero,1914910101 india,1902616681 wmg,1719243744 arte,1655414735 tf,1622718367 t,1594504588 vhs,1551993859 big,1544164290 ck,1360974060 test,1297614969 drawarchive,1167562578 pe,1159397759 trapshota,1122351589 retard,1079402699 de,1077588261 pdfs,1065548141 u,1064357584 ais,1031294839 site,904453685 clop,785781755 vore,740388375 ns,722330212 cub,709228064 mai,622936532 lang,558976702 bbw,546305789 mex,522717009 kin,463376746 sc,457068789 mlp,456750044 christian,404577451 pol2,403009488 mahodou,390889277 mu,388884019 tikilounge,388207863 vg,383554432 moonman,382523336 tg,369839693 w,343781038 ai,341222789 indiachan,329953360 g,302667186 lit,300362242 sci,299721233 col,280610901 cc,255468823 esp,220398958 hm,208790380 funkg,188920856 pone,170608392 from,159864815 fit,154837882 wg,131808226 vv,126340859 dam,125554156 ebon,124332185 draw,121064126 corona,119706460 vr,118979039 vyt,113273925 drug,107005347 aic,106116972 lb,88310297 wholesome,87424242 web,77479262 random,76372597 goa,75889688 his,73094681 hispua,69355485 hispatec,65349747 nra,65019784 tisa,61679658 tv,60534999 bohemia,57227775 femdom,55897334 s,50333043 slo,48784884 redland,48720107 nido,46989915 islam,44344695 jp,43208607 qos,42731481 leftpol,41284948 mexico,38914495 hikikomori,35891973 cutedeadgirls,34225748 leftypol,34182439 turk,34107486 xxx,26253677 d,25186738 sss,24435477 cwc,23973190 tech,23639074 zoocore,21937940 choroy,21804864 c,21793454 cap,21107315 soy,19708493 hypno,19678763 barndom,19677631 hg,18636156 shitposting,18464815 clang,17908781 egy,17121712 fringe,16362624 sample,15245051 pinoy,14838745 GUP,14388959 brownpill,14362532 agdg,14343283 srb,13156063 enpol,13001602 sunflower,11771924 leftpol23,10831251 V,10498898 2drandom,9690289 2b2t,8733640 ng,8363248 cuts,8165698 paigewoolen,8164208 homophobia,8133132 lain,7862017 whogen,7725844 dmkr,7631529 videos,7549766 voxed,7281738 bb,6431712 germansluts,6405450 fsg,6365461 c7k,6246508 holyholyholy,6170742 monster,5996642 nobody,5738724 autism,5682171 egoism,5662266 doomer,5236431 s8s,4976843 int,4812735 plush,4761600 ask8chan,4710348 reddit,4323293 fdf6c3,4243964 Midor,4156799 hmv,4131766 fascist,3741998 converted,3564646 spam,3380820 sp,3374165 x,3329113 quests,3243642 testboard123,3155552 canny,2946551 retro,2848502 ckn,2822250 newsplus,2799204 uc,2667487 baphomet,2667291 map,2658086 mexi,2586383 eco,2500858 cg,2317204 biz,2272036 voy,2179879 arg,2108997 rpg,2103021 gex,2025327 gc,2002634 ahat,2000949 linuxpure,1885770 cibercafe,1861850 proghack,1856287 posra,1823356 furry,1819374 lies,1762123 drawing,1741891 uncut,1684612 sig,1570956 ad,1396201 advice,1394430 lgbtq,1304435 lg,1270398 rdcr,1239224 fapioh,1158028 12signs,911687 nn,815663 inhelp,738477 si,671829 prog,620176 shit,595087 tulinismo,586487 rbi,539459 marx,524753 loopchandottop,517338 p2p,471845 4chan,470651 code,452256 spank,433315 bandada,408366 ppamp,395090 nigger,379319 bmt,359202 asdadadasdadasd,328012 ob,315497 outside,313469 geekkon,297361 p,292081 mde,286048 mark,246137 asscuntlol,242151 bebemoons,232968 voms,230228 ted,183467 icup,183459 p2ps,167447 pedo,164394 pnw,134605 pkmn,132875 711,122490 ft,119304 pb,115584 dspwon,86552 tf2,81407 meta,68999 v9k,64385 gloves,63374 ada,61597 A,56161 freedom,54454 gurps,34414 webatlas,34303 tust,31453 discussionb,28729 floyd,21634 history,19884 aw,18185 sudpol,11730 dpsn,8587 xeno,0 webblogclub,0 vita,0 vichansoftware,0 vichan,0 torotan,0 test0,0 ru,0 revenge,0 polder,0 phi,0 osiismo,0 needmoneynow,0 nedernatsoc,0 morevore,0 mods,0 misc,0 med,0 lolifox,0 lol,0 lfd,0 lamps,0 kf,0 irc,0 int3l,0 ilpazz5d5f4f89ff21f1d2d5,0 hu3,0 gp,0 girltalk,0 gd,0 gart,0 gamenight,0 fusionms,0 fsjdfziunbfliznbcfkznmizomiskmfk,0 fol,0 farm,0 fa,0 eng,0 dwmoney,0 dwm,0 doz,0 dosdev,0 diy,0 crypto,0 cryptbb,0 cow2,0 cbasky,0 campinensechan,0 c9f9e9f2,0 bp,0 blg,0 Bleached,0 bakemono,0 azop,0 animals,0 andrutorrez,0 8ball,0 4cuck,0