/hydrus/ - Hydrus Network

Archive for bug reports, feature requests, and other discussion for the hydrus network.

Index Catalog Archive Bottom Refresh
Name
Options
Subject
Message

Max message length: 12000

files

Max file size: 32.00 MB

Total max file size: 50.00 MB

Max files: 5

Supported file types: GIF, JPG, PNG, WebM, OGG, and more

E-mail
Password

(used to delete files and posts)

Misc

Remember to follow the Rules

The backup domains are located at 8chan.se and 8chan.cc. TOR access can be found here, or you can access the TOR portal from the clearnet at Redchannit 3.0.

US Election Thread

8chan.moe is a hobby project with no affiliation whatsoever to the administration of any other "8chan" site, past or present.

(44.30 KB 1024x576 1481168675293.jpg)

The Struggle Is Real Anonymous 02/21/2017 (Tue) 04:34:56 Id: 9850fa No. 5187
Hey everybody, this is just a thread to talk about our everyday life with Hydrus. How are you coping with your file hoarding addiction now that you're being enabled? Are you remembering to take some time to tag what you download? You ARE making a monthly backup next week, right? What kinds of files are you saving, and what sorts of tags are you committing to the repo? Right now I'm sorting through the downloads from a few of my NSFW subscriptions pre-tagging. They are all about half stuff I want and half gay shit I don't want, so I put "impure" in their subscription tags and I just go through 100 at a time and purify them. It does tend to break about even with me keeping 50 files out of each 100. Pray for me anons. …AND YOU?
>>5187 Reading this thread it sounds like most hydrus users fall to making ridiculous hoards with auto-downloaders grabbing every image on 12 different boorus. Now I feel like a deviant for only using it to organize my reaction images. I haven't set up any auto-importers except one for a folder on my pc where i will save anime/manga crops or sometimes download images from threads as I browse.
>>7590 I havent enabled auto downloading either. Maybe if I were to set it to auto download some of my favorite artists's work it would be enough but entire boorus of shit of any tag or site is just too much.
>decided to set up porn hydrus some time ago >a bit over 1k pics to tag from my video and pictures folders >now >over 5k pics, only tagged most of them on simplest tags (number of girls, 2D or 3D, etc) >eventually come up with a new combination of tags or artist to download in batches from boorus >haven't even touched gif folder yet >have a bunch of zipped artist folders I got from panda I hate it.
>>7590 Do people actually download all pictures with generic tags? I just use it like a follow on pixiv and have a subscription for each artist I like.
I'm kind of at loss on how to make the whole thing work It's easy enough with the booru tag parser do just drop them in hydrus and feel satisfied that at least they have minimal but proper tagging, when before i had to manually drop it in either the series or artist folder and leave it there forever But i can't seem to get how i want to browse in hydrus, i can't have tidy collections by series or artist, because many images have multiple series or artists and so hydrus makes collections for all those instances Not that it was really in order with folders, but random browsing was a bit easier
>>7748 Hopefully hydrus gets better support for casual browsing in the future, like a tag browser/cloud. It's planned afaik
(200.79 KB 600x448 tenor.png)

TIL you can access raw quality files on tumblr. I have 5k files in lower quality dating back to 2015 and I don't have source url's for any of them. Kill me.
>>7931 I know that feel. If it makes you feel any better, sometimes it's not available. I discovered yandex a few months ago, and binged a few times on how it recommends images of the same pose if you feed it a single image. And a lot of them were tumblr images, but renaming the _1280 or _500 etc. to _raw never provided anything, ever. On twitter the :large can be changed to :orig, too. Imgur is horrible since accessing from mobile gives you _d images that are scaled down, and I once managed to have an original filename imgur image not be the full res. Wasn't able to recreate it, though. These systems and their lack of communication just want to fuck people.
>>7931 It's not really available for anything pre ~2013 >>7933 I can't even get access to the regular image on imgur from mobile. It always redirects to their mobile version and gives me shit thumbnails. Also converts my pngs to jpgs half the time. I hate imgur more than mootles hates Australians.
really hoping we get user made gallery parsers soon, so many pictures in sites that have no downloaders that i want to save.
>>7931 >>7933 I made a stupid little :large to :orig twitter script a while ago. Works the same as that greasyfork tumblr one, and converts images both on desktop and mobile. // ==UserScript== // @name Twitter Image URL Redirect // @description Redirects Twitter Image URLs to the :orig version // @version 1.0 // @author whatever // @include *pbs.twimg.com* // @run-at document-start // ==/UserScript== if(window.location.href.indexOf( "?format=" ) > 0) { window.location = window.location.href.replace( /\?format=(jpg|png).*/, ".$1:orig" ); } if(window.location.href.indexOf( ".jpg" ) > 0 && window.location.href.indexOf( ":orig" ) < 1) { window.location = window.location.href.replace( /.jpg.*/, ".jpg:orig" ); } if(window.location.href.indexOf( ".png" ) > 0 && window.location.href.indexOf( ":orig" ) < 1) { window.location = window.location.href.replace( /.png.*/, ".png:orig" ); } Just save as a .user.js and import it. Have fun.
>>7610 >almost two months since post >less than 100 pics fully tagged on all old tags >almost double on the tags I plan on using >almost done deleting all unwanted pics >11.5k pics and I still have folders upon folders of yet to import content All I wanted was to tag my one thousand porn pics. I never asked for this.
>>5267 >almost exactly 1 year since post >decided to put an old pool of files back into inbox to re-check them for quality and filter them into my newer (ratings-based) processing queues >write new subscription system that allows better handling of mass subscriptions >improve how import folders work >write better thread watchers that only stop checking when the files run out >write nested pages so I can have more importers working at once >increase page limit so more pages can be open at once >reduce CPU load of mass importers so more can run at once >500-1000 new files a day >inbox and all subsidiary queues spiral out of control >the scale of the problem completely eclipses my understanding, I can only keep digging away at the coal face, praying for salvation >the situation is literally in every possible way my own fault I just wanted to play video games. Its ok though, because when the downloader overhaul is done, many new sites will be supported.
>>8163 >many new sites will be supported Any plans for Ebaum's world? :^)
(43.95 KB 640x539 1b9.jpg)

>>8163 >500-1000 new files a day >600,533 inbox >131,919 archive What exactly are you doing?
>>8171 >not almost doubling your 10k files in a day by importing from a folder you think it's mostly duplicates except it isn't and after deleting shit files and duplicates you're still left with 18k files >not doing a md5 gelbooru search on said 18k pics for tags only for it to still being ongoing after more than 24 hours and oh god I don't know how many are even left What the fuck do you use your hydrus for? 3 pictures and a gif?
>>8177 >not doing a md5 gelbooru search on said 18k pics for tags only for it to still being ongoing after more than 24 hours and oh god I don't know how many are even left how did you automate this?
>>8178 Nigger riggered python script. I posted it on the Q&A thread a while back. Just ctr+f for "podracing"
>>8177 Finally done downloading all the tags. Took fucking 72 hours. Now onto organizing this shit.
>>7587 >In my gross tech ignorance, I once day just felt I'd found a porn image I really, unironically liked. Wasn't sure how to sort it beyond my broadly-named ~5 porn folders. So I created a specific folder for it, and put a shortcut to the image in it. And that started my really inefficient sorting method. Ok. So this post was me. It was actually horrifying converting this sorting method to Hydrus, since Hydrus couldn't fetch target images from a shortcut fed to it. I opened a folder full of shortcuts in Irfanview, but it saw nothing. My only recourse as far as I could tell at that point was to manually open each and every shortcut in a browser (my choice was Firefox,) and manually resave each and every image. Which was exactly what I did for the first 305 folders, and 9,652 files (shortcuts; I just highlighted everything then looked at Windows properties for this number). Until I asked for help in 4chan /g/'s /sqt/ thread, and an anon replied saying he'll take a crack at it. It was like that scene in Bleach, where that asshole character offered to save Rukia, but seconds later said he was joking, so Rukia lost resolve she never knew she still had, and she screamed in anguish on the spot. I basically didn't want to do this anymore after this anon showed up. I had 62 folders left, and 4,107 files (shortcuts) left, since I was going chronologically reversed order, so the older ones were more dense with sorting, and poor sorting. MAKE BACKUPS BEFORE ATTEMPTING ANY OF THE FOLLOWING Anon told me to run the following in powershell: https://archive.rebeccablacktech.com/g/thread/65734824/#65747352
#must be run from admin prompt as it modified the registry
Set-ExecutionPolicy RemoteSigned;
And then run the following in powershell as well*: (*note: "Set $simulate = $false when you want to actually run it, $simulate = $true will just output the actions it will take." He says this alongside an earlier draft of the following script) https://archive.rebeccablacktech.com/g/thread/65747475/#65747990
$simulate = $true;
$directory = "D:\inc\test shortcuts";

$shortcuts = gci -Path $directory -Recurse -Filter *lnk;
$shell = New-Object -ComObject WScript.Shell;
foreach ($shortcut in $shortcuts) {
$link = $shell.CreateShortcut($shortcut.FullName);
echo "copy $($link.TargetPath) $($shortcut.Directory.FullName)";
echo "rm $($shortcut.FullName)";
if ($simulate -ne $true) {
try {
copy -LiteralPath $link.TargetPath $shortcut.Directory.FullName -ErrorAction Stop;
rm -LiteralPath $shortcut.FullName;
} catch {
write-host -ForegroundColor Red "Error replacing shortcut, skipping.`n$($_.Exception)";
}
}
}
This works perfectly for turning shortcuts into their original target files, provided the shortcuts aren't broken. The original targets are still left intact, so I was able to use his earlier script, give feedback of it failing, to which he amended it, and I was able to run the better script without problems. The only thing is the shortcuts folder itself is overwritten, and any broken shortcuts are lost, hence why you should make a backup before attempting this, so the data is not lost forever. I realize literally no one in the history of time will ever sort things this way, but just for archival purposes I wish to share it, since I googled for literally an hour- the archives there tell the tale- and I found no answer for my situation. In the end, Hydrus might one day undermine this problem, so even my unique case will have extreme ease converting to Hydrus. Today, though, I needed this script. Also, full disclosure, I am the anon from the Q&A thread >>8720 who delayed switching to Hydrus for four months, since 4chan's /g/ introduced me to it, and their elitist bullying attitude made me try extremely hard to make sure I wouldn't fuck up on my own, since they would be so apprehensive to helping me if I needed help. I'm too shy to read the reply I got in that thread. I'm too shy, also, to read anon's reply to my thanking him for the script working on /g/, since others seeing my autistic folder names for my shortcut sorting (which I slightly shared to him) makes me cold sweat. I'm a ball of anxiety, really. Thanks for your tolerating me, if you do.
>>8179 How do I run this in Hydrus, I see code but where would I plug it in? Sorry for not really understanding, I'm just trying to optimize my porn collection in every way possible.
(1.04 MB 2500x1213 1507046780099.jpg)

>>5267 in about 10 years if storage becomes huge and affordable we should attempt The Great Merge where you can opt in to starting a new database and have all your files and tags P2P distributed with everyone else
>>8885 actually that's probably a bad idea since even if you can blacklist tags people will still manage to dox themselves
(18.60 KB 284x300 downhill.jpg)

>need to tag 250 images from two and a half months ago >keep getting distracted >keep importing more files >400 in inbox I need to cut off my internet and sort this shit before I end up with thousands of images with only 1 or 2 tags
>>8744 Wait, you had folders for various tags, and if an image fit into multiple tags, you would have the actual image in one folder, and then you would have shortcuts in the other folders? Wow I am impressed honestly, I never thought of something like that. I used to just put them in the folder I thought was the best match, then eventually gave up and literally dumped everything into one big folder. It worked kinda well honestly, I would sort it by date created and then recent porn would be at the top, and as I went down it would show me older stuff. But I had to remember how far down to scroll for particular porn. Anyway my system:everything is 107,970. Almost completely untagged. The good news is I mostly collect loli, so it doesn't grow too fast. I just need to do a ton of Gelbooru searches to rip all the tags.
I've been using Hydrus for a year and I don't see the point at all. I thought it would tag images I add automatically but it's only doing it when directly downloading from boorus. So the majority of my images are just sitting there unorganized and I'll never have the time to tag them all myself. Am I missing something?
>>9843 Most of your images are not the original but duplicate of various type from the image boards. AKA iqdb and saucenao all of them, welcome to hell.
>>9846 But is there any ways to at least tell the program to look for the images' md5 or something so it automatically find the tags?
>>9847 Did you connect your database to the public tag repository? That's how you get tags for existing images.
>>9849 I read that in the guide but the key didn't work. I'm also worried about how secure this is, especially when I didn't understand what that would get me exactly. Does it really allow the hydrus to tag my collection? Is there a key that works somewhere?
>>9864 Yes if the md5 of your files is in the PTR they will get tags. Go to the help menu > I don't know what I'm doing > just set up some repositories for me, and hydrus will set up the PTR for you. It will take a long time to sync, so instead of waiting I'd recommend you download the update files from here: https://cuddlebear92.github.io/Quicksync/ Then you can import them with services > import repository update files. It is secure because you download all the tags, even for files you don't have, so no one knows what files you have. Unfortunately because of that your database will increase in size a lot, to about 10GB. The PTR mainly uses a booru tagging style, but it should be noted it is currently kind of messy with some useless/bad tags. But you can set up tag censorship/sibling rules to get rid of those if it bothers you.
>>9868 Thank you
I know I've been gone a while, but… Don't forget your backup, anon
(227.10 KB 384x356 ClipboardImage.png)

>the archived stuff isn't even tagged yet >nothing is
(219.56 KB 503x487 ClipboardImage.png)

>>7574 An update on my progress nearly a year later, with 2945 untagged files.


Forms
Delete
Report
Quick Reply