/hydrus/ - Hydrus Network

Archive for bug reports, feature requests, and other discussion for the hydrus network.

Index Catalog Archive Bottom Refresh
Name
Options
Subject
Message

Max message length: 12000

files

Max file size: 32.00 MB

Total max file size: 50.00 MB

Max files: 5

Supported file types: GIF, JPG, PNG, WebM, OGG, and more

E-mail
Password

(used to delete files and posts)

Misc

Remember to follow the Rules

The backup domains are located at 8chan.se and 8chan.cc. TOR access can be found here, or you can access the TOR portal from the clearnet at Redchannit 3.0.

Uncommon Time Winter Stream

Interboard /christmas/ Event has Begun!
Come celebrate Christmas with us here


8chan.moe is a hobby project with no affiliation whatsoever to the administration of any other "8chan" site, past or present.

(135.42 KB 1510x594 aaaaa.jpg)

Tag parser script Anonymous 01/29/2016 (Fri) 04:09:28 Id: d175d6 No. 1914
Here's something I did to make copying individual booru tags easier. hydrus is good with booru browser but its page downloader doesn't read tags. And sometimes you just wanna quickly add tags to an individual image. So this tamper/greasemonkey script will add a button and a key bind to booru posts and the Illustration2Vec demo site to copy all tags on the page including their schemas and rating. Then you can just right click your image in hydrus > manage file tags > paste tags > apply. The whole process takes about 5 seconds. github.com/JetBoom/boorutagparser
Nice, is there a list of which boorus are supported, or does it just work for all?
>>1916 It works on a "catch-all with exceptions" basis. So any site that matches *booru.*/ will work. Sites with weird names like rule34.xxx are manually added to the @include list. Also, different boorus use different css so I need to add new selectors if some booru doesn't work. Most do work though because most use the same css as gelbooru or booru.org or danbooru. The script auto-updates from github so if something doesn't work, make an issue/pull request and I'll make it work for that site without you having to do anything.
Illustration2Vec(neural network) is nice concept in theory, but it's still too young for me to consider full deployment. However I could still potentially have uses for it. Is it possible to make the script only copy tags that have a confidence rating of 70% or above? It's just i'd rather have no tags than incorrect ones
>>1918 I have it set to 20%. You can change it on line 32. var iv2_confidence_rating = 70.0; I'm gonna just put in an options menu or something soon.
Sankaku has some images the others don't, but the script doesn't work on it.
>>1936 Update 1.0.4: All sites and their tag schemas on the hydrus booru list now work.
>>1938 1.0.5: added options menu for iv2 confidence rating and copy sound url.
>>1938 Thanks.
Does anyone know of an option somewhere to automatically add the preferred tag instead of spawning dialogs when pasting multiple tags, by the way?
(188.76 KB 1529x658 106.jpg)

I put in nhentai for 1.0.6. They have a nice json page so it also works when viewing individual images.
(221.05 KB 1221x797 boorutagparser-server.jpg)

1.1.0 is here with a real nifty feature: the ability to download an image and its tags to a bulk import folder. So you can now press a button (or a hotkey, I set it to backslash by default) and it will download the full-size image and its tags to your disk. Then you can just drag the entire folder on to hydrus and it will import every image and their tags at one time. It saves A LOT of time so instead of 5 seconds per image wasted it's more like 5 seconds total at the end of your browsing session. This utilizes the new r194 ability to parse image.jpg.txt files. The feature requires a separate sort of daemon server to be ran in the background made in node.js (web addons have real limited access to your disk). There's instructions that even a retard can understand if you want to get that working. https://github.com/JetBoom/boorutagparser https://github.com/JetBoom/boorutagparser-server
>>2170 Holy shit bro, you are a lifesaver. Before this, my process of downloading an individual image involved getting its md5 and then searching "md5:<hash>" on hydrus's downloads page.
>>2183 And I just realized that Hydrus' automatic import folders doesn't yet support txt file imports. I'll need to either figure out a quick way to export the images with their md5 filenames, or just redownload everything.
>>2170 So, im too retarded to map the shortcut properly because of problems with the different layout. Is it possible to change the key?
>>2214 Holy shit, im really retarded. i just had to look into the script.
>>2170 Great tool! Thank for supporting paheal as well, however "download with tags" doesn't work there because the doDownload function isn't able to find the link to the image. In case anyone is interested in a fix, with my very limited coding knowledge I managed to do it. I added this line, directly under the first query in the doDownload function: if (!a) var a = document.querySelector('img[src*="/_images/"]');
I don't suppose there's a way to shortcut "paste tags" and "accept" to get this down to keystrokes only essentially? Otherwise, I'll just make an AHK script and do it a dirty way.
>>2248 Use the server he links to download the image and its tags in in a .txt file. Setup the import folder as an import folder in hydrus. Then you can avoid having to manage tags within hydrus itself, for the most part
>>1914 Ever thought about using pm2 to have the server run in the background instead of a constantly-open command window?
>>2249 Nifty, but I needed what I mentioned for existing files in Hydrus that were untagged. The way I'm doing it now is reverse image searching and AHKing the tags in, the server method would create duplicates.
The "download with tags" button doesn't work on some boorus (http://vidyart.booru.org/ as an example). I think it's because they don't have a download button and just post the original file.
>>2246 >>2261 Fixed these in 1.1.2
>>2273 Thanks for the fix!
(31.42 KB 134x127 face.png)

( ˇωˇっ)3
(2.00 MB 500x578 1440819090172-tech.gif)

>>2170 Do you know how I might go about getting boorutagparser-server running in Arch?
>>2323 # pacman -S npm
$ npm install boorutagparser-server
$ node node_modules/boorutagparser-server
This will install boorutagparser-server in the present working directory into a folder named node_modules along with all it dependencies hence the final command. There's probably a way to add node_modules to path or something but I'm not familiar enough with node.
(139.33 KB 518x632 1458296718827-1.png)

>>2324 Thanks.
would it be possible to add more configurations to where downloaded files are sent based on url? For instance, instead of one large to_import folder, it might be nice to send downloaded images to a folder matching the website they're from. That way, I can easily configure hydrus to add a furry tag to everything from e621, and so on.
>>2492 Look for the 'explicit tags' button in the import options - tags panel on subscriptions and downloader pages. This lets you add specific tags to everything that comes in through that stream. You can set site-specific default values for these as well, under file->options->default tag import options. Let me know if it doesn't work for you.
>>2502 Sorry, I already know about that. This has to do with the downloader script OP made, not hydrus.
How do I make it not copy the rating of files?
Could the tag script be updated to include support for downloading tags from derpibooru.org? I managed to edit the script myself a little and got it to read the tags (though I'm not sure if it works 100%) with this code: // derpibooru-like insertTags(tags, 'span.dropdown.tag > a', ''); I am at a loss on how to edit the script to download the images too, the script seems to be latching onto this url: https://derpibooru.org/images/[imageID#]/tag_changes and just creates a text file.
The script doesn't seem to pull the original/png versions of images from yande.re, it only gets the larger jpg version.
>>3221 Here is an updated / fixed script from another thread that works with derpibooru. It should grab all tags regardless of user setting (watch, spoiler, hide). You can remove those lines if you want to not grab those tags. http://pastebin.com/69ruSKTv Credits to this anon for creating a working script: https://8ch.net/hydrus/res/2231.html#3220
For some reason the download with tags/copy tags buttons aren't showing up in chromium reliably. They seem to show up after several minutes sitting on the page, but tampermonkey says nothing is wrong. Chrome doesn't have this problem though, it loads immediately.
Here's two changes I made that many people might find useful 1. Don't download original image if over 3 MB https://ghostbin.com/paste/8oncf 2. Don't redownload existing images https://ghostbin.com/paste/sf6jx
I can't seem to copy tags/download pics from nhentai.net. When I click the buttons nothing happens. Does this happen for anyone else?
I notice that the tag parser script can't download webms (or presumably other video files) from sites like e621 and others or I broke my script from being able to do this. Could someone fix up or post the original code needed to get the tag parser script to grab webms from these sites? Thanks!
>>4707 Find the doDownload() function and replace the line beginning with "var a =" with this: http://pastebin.com/5y9mWYNe That should fix it.
>>4711 That worked! Thank you anon :D
>>4711 I updated the script on gh. I don't check this thread really ever but merging pull requests are like 3 taps on my phone if people have an account.
>>4336 nhentai doesn't work for me either. It would be great to get it working again.
Holy balls this is amazing, it helps so much, thank you!
Threadfix
Script wasn't working for me on paheal. Looks like it's finding the button for the source before the actual image. Managed to fix it by changing var href = a.src || a.href; to var href = a.src || a.href || a.action; I guess the other way to fix it would be to remove the "\_images\" query and go by id or exclude forms in the search
(268.02 KB 492x442 krishna toot.png)

I get >562 files were parsed successfully, but 527 had unsupported mimes when importing the import_me folder and none of the imported pictures have tags when i check in manage, am i doing something wrong here?
>>6802 Sorry i'm retarded there's a checkbox i didn't click.
derpibooru broke again because they changed the title of the image download link. Find "a[href*="/img/download"][title="whatever it was before I changed it"]" and change to "a[href*="/img/download"][title="Download (short filename)"] "
>>8454 Aaand they changed it again: "title="Download (no tags in filename)". Jesus how many times do they need to fuck with this?
demo.illustration2vec.net seems pretty dead, is there a mirror around?
Is there any way to change the output filnename of the downloaded file & accompaning txt? For example could i make it grab the post number as the filename based on the site? Like, from Sankaku it would be "S ####", Danbooru "D ###", Yandere "Y ###", or is it just not possible?
>>9703 Sure it's possible, but you'd have to edit the script. I did some minor changes myself but I'm not too familiar with the code/language so I couldn't do it for you without some effort.
>>9780 Do you perhaps know how to at least make it download the original filename? My idea of grabbing the post number was probably overkill, with danbooru and yande.re it'd just be fine to have the original name, but i have no idea how do edit the script to tell it to stop the renaming function I mean, i think i've even found the line in the script with "var filename", but i don't know what to do with it
Tag parser doesn't get meta tags currently, any plans for this?


Forms
Delete
Report
Quick Reply