/hydrus/ - Hydrus Network

Archive for bug reports, feature requests, and other discussion for the hydrus network.

Index Catalog Archive Bottom Refresh
Name
Options
Subject
Message

Max message length: 12000

files

Max file size: 32.00 MB

Total max file size: 50.00 MB

Max files: 5

Supported file types: GIF, JPG, PNG, WebM, OGG, and more

E-mail
Password

(used to delete files and posts)
Misc

Remember to follow the Rules

The backup domains are located at 8chan.se and 8chan.cc. TOR access can be found here, or you can access the TOR portal from the clearnet at Redchannit 3.0.

Uncommon Time Winter Stream

Interboard /christmas/ Event has Begun!
Come celebrate Christmas with us here

8chan.moe is a hobby project with no affiliation whatsoever to the administration of any other "8chan" site, past or present.
(4.03 KB 480x360 _0WUHPMSwjw.jpg)

Version 330 hydrus_dev 11/14/2018 (Wed) 23:38:18 Id: 58a2c9 No. 10656
https://www.youtube.com/watch?v=_0WUHPMSwjw windows zip: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.Windows.-.Extract.only.zip exe: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.Windows.-.Installer.exe os x app: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.OS.X.-.App.dmg tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.OS.X.-.Extract.only.tar.gz linux tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v330/Hydrus.Network.330.-.Linux.-.Executable.tar.gz source tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v330.tar.gz I had a great week. There are some more login scripts and a bit of cleanup and speed-up. The poll for what big thing I will work on next is up! Here is the thread: >>10654 login stuff The new 'manage logins' dialog is easier to work with. It now shows when it thinks a login will expire, permits you to enter 'empty' credentials if you want to reset/clear a domain, and has a 'scrub invalid' button to reset a login that fails due to server error or similar. After tweaking for the problem I discovered last week, I was able to write a login script for hentai foundry that uses username and pass. It should inherit the filter settings in your user profile, so you can now easily exclude the things you don't like! (the click-through login, which hydrus has been doing for ages, sets the filters to allow everything every time it works) Just go into manage logins, change the login script for www.hentai-foundry.com to the new login script, and put in some (throwaway) credentials, and you should be good to go. I am also rolling out login scripts for shimmie, sankaku, and e-hentai, thanks to Cuddlebear (and possibly other users) on the github (which, reminder, is here: https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts/tree/master/Download%20System ). Pixiv seem to be changing some of their login rules, as many NSFW images now work for a logged-out hydrus client. The pixiv parser handles 'you need to be logged in' failures more gracefully, but I am not sure if that even happens any more! In any case, if you discover some class of pixiv URLs are giving you 'ignored' results because you are not logged in, please let me know the details. Also, the Deviant Art parser can now fetch a sometimes-there larger version of images and only pulls from the download button (which is the 'true' best, when it is available) if it looks like an image. It should no longer download 140MB zips of brushes! other stuff Some kinds of tag searches (usually those on clients with large inboxes) should now be much faster! Repository processing should also be faster, although I am interested in how it goes for different users. If you are on an HDD or have otherwise seen slow tag rows/s, please let me know if you notice a difference this week, for better or worse. The new system essentially opens the 'new tags m8' firehose pretty wide, but if that pressure is a problem for some people, I'll give it a more adaptable nozzle. Many of the various 'select from a list of texts' dialogs across the program will now size themselves bigger if they can. This means, for example, that the gallery selector should now show everything in one go! The manage import/export folder dialogs are also moved to the new panel system, so if you have had trouble with these and a small screen, let me know how it looks for you now. The duplicate filter page now has a button to edit your various duplicate merge options. The small button on the viewer was too-easily missed, so this should make it a bit easier! full list - login: - added a proper username/password login script for hentai foundry–double-check your hf filters are set how you want in your profile, and your hydrus should inherit the same rules - fixed the gelbooru login script from last week, which typoed safebooru.com instead of .org - fixed the pixiv login 'link' to correctly say nsfw rather than everything, which wasn't going through last week right - improved the pixiv file page api parser to veto on 'could not access nsfw due to not logged in' status, although in further testing, this state seems to be rarer than previously/completely gone - added login scripts from the github for shimmie, sankaku, and e-hentai–thanks to Cuddlebear and any other users who helped put these together - added safebooru.donmai.us to danbooru login - improved the deviant art file page parser to get the 'full' embedded image link at higher preference than the standard embed, and only get the 'download' button if it looks like an image (hence, deviant art should stop getting 140MB brush zips!) - the manage logins panel now says when a login is expected to expire
[Expand Post]- the manage logins dialog now has a 'scrub invalidity' button to 'try again' a login that broke due to server error or similar - entering blank/invalid credentials is now permitted in the manage logins panel, and if entered on an 'active' domain, it will additionally deactivate it automatically - the manage logins panel is better at figuring out and updating validity after changes - the 'required cookies' in login scripts and steps now use string match names! hence, dynamically named cookies can now be checked! all existing checks are updated to fixed-string string matches - improved some cookie lookup code - improved some login manager script-updating code - deleted all the old legacy login code - misc login ui cleanup and fixes - . - other: - sped up tag searches in certain situations (usually huge inbox) by using a different optimisation - increased the repository mappings processing chunk size from 1k to 50k, which greatly increases processing in certain situations. let's see how it goes for different users–I may revisit the pipeline here to make it more flexible for faster and slower hard drives - many of the 'select from a list of texts' dialogs–such as when you select a gallery to download from–are now on the new panel system. the list will grow and shrink depending on its length and available screen real estate - . - misc: - extended my new dialog panel code so it can ask a question before an OK happens - fixed an issue with scanning through videos that have non-integer frame-counts due to previous misparsing - fixed a issue where file import objects that have been removed from the list but were still lingering on the list ui were not rendering their (invalid) index correctly - when export folders fail to do their work, the error is now presented in a better way and all export folders are paused - fixed an issue where the export files dialog could not boot if the most previous export phrase was invalid - the duplicate filter page now has a button to more easily edit the default merge options - increased the sibling/parent refresh delay for 1s to 8s - hydrus repository sync fails due to network login issues or manual network user cancel will now be caught properly and a reasonable delay added - additional errors on repository sync will cause a reasonable delay on future work but still elevate the error - converted import folder management ui to the new panel system - refactored import folder ui code to ClientGUIImport.py - converted export folder management ui to the new panel system - refactored export folder ui code to the new ClientGUIExport.py - refactored manual file export ui code to ClientGUIExport.py - deleted some very old imageboard dumping management code - deleted some very old contact management code - did a little prep work for some 'show background image behind thumbs', including the start of a bitmap manager. I'll give it another go later next week I have about eight jobs left on the login manager, which is mostly a manual 'do login now' button on manage logins and some help on how to use and make in the system. I feel good about it overall and am thankful it didn't explode completely. Beyond finishing this off, I plan to continue doing small work like ui improvement and cleanup until the 12th December, when I will take about four weeks off over the holiday to update to python 3. In the new year, I will begin work on what gets voted on in the poll.
hydrus_dev Board Owner 11/14/2018 (Wed) 23:51:30 Id: 58a2c9 No. 10657
Someone is telling me the e-hentai login script I have put in here may not work well. If you are interested in that, please check the github later this week for an updated version! I will roll any better versions into v331.
Anonymous 11/15/2018 (Thu) 06:35:01 Id: 7b47b9 No. 10662
>>10652 Yea, my sub is a bit autistic, wont lie about that, but the main aspect of it is the low end where a 5 gap can have 10-20 results easily, could probably try a 50 or 100 gap and see if that has any major differences or if that decides to stop looking which is the main thing I want to avoid. I'll have to look into that. as for the show new files, would it be possible to have that one's set specifically to show new files and the other one shows user preference?
Anonymous 11/15/2018 (Thu) 15:33:30 Id: 7b47b9 No. 10664
Ok updated and had a look at the login, had a specific hentai foundry I wanted to look up Set it up so I think I log in tested it worked then went to download the program was logging in, but it went ahead with downloading anyway. 3 downloaded, of the 36 images they had on the second download. I think you need to stager downloading a bit from logging in.
Anonymous 11/15/2018 (Thu) 18:44:38 Id: 2c2a2c No. 10666
Is >>10385 fixed yet?
Anonymous 11/15/2018 (Thu) 21:36:34 Id: a9081f No. 10672
Three more versions until trips, l/a/ds! I can't wait, to be honest. How should it be celebrated?
Anonymous 11/17/2018 (Sat) 05:33:27 Id: 7b47b9 No. 10686
>>10662 Ok, have enough data now from a smaller list, each of the subs that have more then 15 images constantly have a 'we seen 5 similar images, were done now' problem. granted, this will be solved once a derpi log in script happens and I can catch more then 50 images a look up
best Admin Anonymous 11/17/2018 (Sat) 07:39:39 Id: fc6450 No. 10688
Hi master chief baraa272 could you please look at your email ? all love and respect though <3
Anonymous 11/17/2018 (Sat) 10:25:57 Id: 77893d No. 10690
>>10688 Oy who you?
Anonymous 11/17/2018 (Sat) 15:06:23 Id: ba5c70 No. 10691
(236.38 KB 393x575 1425519042965.png)

yo hydev, do you think it'd be possible to make a user gallery downloader for https://beta.furrynetwork.com/ and weasyl.com like its been done for inkbunny and FA? cheers to you.
Anonymous 11/17/2018 (Sat) 18:14:47 Id: 9e1e8f No. 10693
>>10691 Learn 2 Write Scripts like https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts
hydrus_dev Board Owner 11/17/2018 (Sat) 22:46:48 Id: 58a2c9 No. 10697
>>10662 I am very sorry, I still do not understand what 'show new files' vs 'shows user preference' means. Can you give me an example of the workflow you are going for here? >>10657 That's odd–any request on the domain is supposed to wait for the login process to finish. Could it be possible that the old requests maybe thought they were still logged in with the old click-through HF login? Let me know if you experience other unusual HF behaviour or missed files.
hydrus_dev Board Owner 11/17/2018 (Sat) 22:47:59 Id: 58a2c9 No. 10698
>>10666 Not yet. I have it in my list. I got it started, but I'll first have to add some faster db sibling fetching/lookup code before I can actually fold in the additional sibling results.
hydrus_dev Board Owner 11/17/2018 (Sat) 23:00:27 Id: 58a2c9 No. 10699
>>10691 I am afraid I am trying not to put time into making new parsers. I made the new download system completely user-editable to spread the load a bit, as I was getting overwhelmed with the infinite list of new sites to deal with. I will post your request to the hydrus discord at https://discord.gg/3H8UTpb . If you are comfortable with discord, you are welcome to join and talk to the parser writers there, who can also help you add downloaders if you are uncertain how to do it. Those look like big sites, so I am sure it will get a parser eventually on the github at >>10693 . If you are familiar with html, you may be able to help out as well! If you are experienced, here is the help on writing your own: https://hydrusnetwork.github.io/hydrus/help/downloader_intro.html
Anonymous 11/18/2018 (Sun) 11:32:23 Id: 5f58fd No. 10711
(4.38 KB 512x110 weasyl tag search.png)

>>10691 Here's one for ya, working on the other
Anonymous 11/18/2018 (Sun) 12:59:44 Id: 7b47b9 No. 10712
(2.40 KB 1046x26 client_2018-11-18_06-50-37.png)

(4.04 MB 2002x2021 client_2018-11-18_06-53-06.png)

>>10697 Ok, generally when I open up a watcher, I want to see the images the thread gave me, such as… lets use this one as an example as it illustrates it best. https://boards.4chan.org/trash/thread/19470741 https://desuarchive.org/trash/thread/19470741/#19470741 4chan link and the archive link in case you don't see it fast enough. these threads are fun to go through see if I win the games with the least compromises With the ability to show new files counts in the watcher list, i can easily see it has 60 new images as of this post, If I right click it and have it open in its own window I get 117 image, or what the watcher has in total but if I change the settings to only show new images, ill get the reduced count and i can easily see if there are any updated games, of which there are few. Now, the process to only show new, or show all while simple, is cumbersome to keep going back and forth, which is why i'm wondering if there is a way to hard code an only new filter alongside the whatever the user has set filter.
Anonymous 11/18/2018 (Sun) 13:02:53 Id: 7b47b9 No. 10713
(3.53 MB 2002x2021 client_2018-11-18_06-52-58.png)

>>10712 bah the third image did not upload
hydrus_dev Board Owner 11/18/2018 (Sun) 19:37:50 Id: 58a2c9 No. 10720
>>10711 Top stuff, thank you for figuring this out. >>10691 Save this png and then drop it onto Lain under network->downloaders->import downloaders. >>10713 >>10712 I see, thanks for explaining! I will figure out a right-click menu entry or something for this.
Anonymous 11/19/2018 (Mon) 06:54:25 Id: 7b47b9 No. 10728
>>10720 I dont think its menitoed here yet, but 4chan is apparently splitting itself to family friendly domain and the adult domain. as of now everything is the same, besides some boards being able to be hosted under 4channel.org instead of 4chan.org probably want to update the watcher to take in 4channel along with 4chan
Anonymous 11/19/2018 (Mon) 10:34:13 Id: a73707 No. 10729
>>10728 >4chan is apparently splitting itself to family friendly domain and the adult domain. Seems fucking retarded, what's wrong with just having blue boards?
Anonymous 11/19/2018 (Mon) 12:32:11 Id: 7b47b9 No. 10730
>>10729 the problem is gook moot wants to monetize 4chan, and passes aren't good enough for him. He constantly tries to look for ways to guilt people into buying passes and considered ways to monetize, some of which are so questionable people decided domain culling was required for 4chan going forward. If he splits 4chan off from blueboards and adult ones, it will appeal to more advertisers then just the weeb porn ones. Apparently 4chan itself will still work the same way it always has, but the blue boards will be under a different domain. for me, I use a custom header so that has no real change to me, I have a pass and I ad block, so nothing will change there, and for the most part I dont like the blue boards because 4chan has went from a place where nigger and faggot were the go to insults to saying someone is a moron and disagreeing with them will get you a 4 day suspension. only reason I have a pass at all are the boards I go to and am active on, I got so sick of captchas that I said fuck it and went pass.
Anonymous 11/19/2018 (Mon) 19:18:18 Id: be0786 No. 10732
WARNING:root:pafy: youtube-dl not found; falling back to internal backend. This is not as well maintained as the youtube-dl backend. To hide this message, set the environmental variable PAFY_BACKEND to "internal". Traceback (most recent call last): File "/opt/hydrus/client.pyw", line 20, in <module> from include import ClientController File "/opt/hydrus/include/ClientController.py", line 14, in <module> import ClientCaches File "/opt/hydrus/include/ClientCaches.py", line 5, in <module> import ClientRendering File "/opt/hydrus/include/ClientRendering.py", line 2, in <module> import ClientImageHandling File "/opt/hydrus/include/ClientImageHandling.py", line 3, in <module> import cv2 ImportError: No module named cv2 looks like opencv update on Arch makes hydrus unable to boot, 3.4.3-5 -> 3.4.4-1
Anonymous 11/20/2018 (Tue) 04:54:59 Id: 0e7d2f No. 10735
>>10729 >Seems fucking retarded, what's wrong with just having blue boards? He has done the same thing to 2ch. His explanation was like this. If something wrong occurs in an adult board like someone uploading CP and law enforcement will shuts down 2ch entirely. But as far as 2ch and adult boards called pink server separated and we treat these two as complete different sites. At least 2ch is kept safe.
hydrus_dev Board Owner 11/20/2018 (Tue) 23:08:12 Id: 58a2c9 No. 10737
>>10732 Thanks. I found this after a bit of searching: https://bugs.archlinux.org/task/60855 https://github.com/opencv/opencv/issues/13202 So I guess those are some places to watch? If the python bindings for cv got messed up in the new version, I should think reverting is the simplest solution for now. OpenCV is critical to Hydrus's drawing, so I'm afraid there isn't much I can easily do on my end.
hydrus_dev Board Owner 11/20/2018 (Tue) 23:09:54 Id: 58a2c9 No. 10738
>>10728 Thank you for reminding me of this. I made a new url class, rolling out tomorrow, that seems to add complete support. (we'll see if after the official split if sfw content/api is still stored on 4cdn domain, which the current watcher goes to)
Anonymous 11/21/2018 (Wed) 18:27:28 Id: 7b47b9 No. 10745
>>10730 >>10729 learned a new thing since posting that. 4chan lost stripe, you cant buy passes with credit cards, this is the reason for the split.
Index Catalog Archive Top Reply
1
Forms
Delete
Report
Quick Reply