/hydrus/ - Hydrus Network

Archive for bug reports, feature requests, and other discussion for the hydrus network.

Index Catalog Archive Bottom Refresh
Name
Options
Subject
Message

Max message length: 12000

files

Max file size: 32.00 MB

Total max file size: 50.00 MB

Max files: 5

Supported file types: GIF, JPG, PNG, WebM, OGG, and more

E-mail
Password

(used to delete files and posts)

Misc

Remember to follow the Rules

The backup domains are located at 8chan.se and 8chan.cc. TOR access can be found here, or you can access the TOR portal from the clearnet at Redchannit 3.0.

Uncommon Time Winter Stream

Interboard /christmas/ Event has Begun!
Come celebrate Christmas with us here


8chan.moe is a hobby project with no affiliation whatsoever to the administration of any other "8chan" site, past or present.

(22.95 KB 480x360 QM6JUHp3OZI.jpg)

Version 396 Anonymous 05/06/2020 (Wed) 22:26:46 Id: ae3b32 No. 14208
https://www.youtube.com/watch?v=QM6JUHp3OZI windows zip: https://github.com/hydrusnetwork/hydrus/releases/download/v396/Hydrus.Network.396.-.Windows.-.Extract.only.zip exe: https://github.com/hydrusnetwork/hydrus/releases/download/v396/Hydrus.Network.396.-.Windows.-.Installer.exe macOS app: https://github.com/hydrusnetwork/hydrus/releases/download/v396/Hydrus.Network.396.-.macOS.-.App.dmg linux tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v396/Hydrus.Network.396.-.Linux.-.Executable.tar.gz source tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v396.tar.gz I had a good week. The client now has better file 'notes' support. There are several database updates this week. Users with large databases can expect the first boot to take a few minutes. notes A long time ago, I added prototype 'notes' to files. You can access it under a media right-click->manage->notes. It was a bit hacky, functioning just like a plain .txt attached to files, but some users really picked it up. This week it becomes more mature. Firstly, files can now have multiple notes, each with their own name. Existing notes will get the simple default name of 'notes'. Also, files that have notes now show a notes icon on their thumbnails and in the media viewer top-right hover window. Clicking the hover window icon quickly opens the edit notes dialog. And to find files with notes, there is now 'system:number of notes'. Its panel has a couple of quick buttons for finding files with any notes or no notes. Notes are stored in a faster and more space-efficient way, so this should work fairly quickly for most situations. The next step here is to add note parsing to the downloader system. The main thought is to get artist post text and similar imported with nice 'blah gallery artist comment' style names as you download files. I had hoped to figure something out for this this week, but I didn't have time to do it properly, so I focused on polishing the above. I would like to fold parsing in in upcoming normal weekly work. The new storage system for notes also builds a fast search cache for their text. It will not be extremely difficult to add some sort of 'system:note has text xxxxx' in future as well, if you want to search for parsed mega links or whatever else. Beyond that, I'd love some note 'preview' on the media viewer and comprehensive import/export/Client API support for notes. unusual tag searches I am really happy with the new tag autocomplete system. It is so much nicer to work on now it is all unified. This week I fixed a bunch of unusual searches. A good example is '/f/', which according to hydrus 'special character' rules also matches 'f'. Short text queries like 'f' and '/f/' that do not do full lookups will now match all special character results, including if they have a namespace, so all combinations of 'board:/f/' and '/f/' and 'board:f' and so on will now match 'board:/f/'. Also, wildcards are now unified. 'Complex' wildcards that have inserted *, like 's*s ara*', are now treated logically the same way as 'simple' ones that only have an * on the end like 'sam*', and should more reliably return all the correct results. They ~also~ support the special character rules as above, so 'int*fies' should match '[intensifies]'. And wildcard file search predicates, where you might search for 'character:samus* (wildcard search)' to return all files that have any tag that matches that wildcard, now support the special character rules in all cases. When you include special characters in the wildcard text, such as 'e*mple-tag*', that '-' character is now preserved (previously, it was being replaced with space, which is behind-the-scenes hydrus technical trickery). A new tag search cache supports and speeds up these logical improvements. Users with large databases can expect the first boot into 396 to take a few minutes. the rest I fixed the sort in the tag suggestion boxes! You can now click the 'inbox' icon in a media viewer top-right hover window to archive a file. The file->shortcuts dialog now has descriptive, sorted names for the reserved shortcut sets. 'system:dimensions' now has some quick-click buttions for common ratios and resolutions.
[Expand Post] 'system:known url' is better about fetching both www and non-www versions of URLs. full list - notes: - the file notes system is more mature. files now store multiple named notes - the edit notes ui is now a tabbed window with add/edit_name/delete buttons - media results now load with their notes, so note access is instant - thumbnails now show a notes icon when they have notes - the media viewer top-right area shows a notes icon when the current file has notes - clicking the media viewer top-right notes icon opens edit notes - the edit notes menu entry now lists the number of current notes if there are notes - added a 'system:number of notes' predicate. it has easy 'has/no notes' buttons for quick filtering - the file notes database table will be updated on update, it shouldn't take long. existing notes will get the default 'notes' name - duplicate notes now share the same storage space in the database - in prep for a future search expansion, notes are now cached in the database for fast text search - in prep for note parsing, wrote a 'note import options' object. it doesn't do anything in the program yet, but it supports multiple note conflict resolutions, note extension detection, and global and specific note renaming - wrote unit tests for the new note import options - . - some tag search stuff: - hydrus now maintains an internal mapping of direct 'searchable' versions of tags to the tags themselves, which allows it to now do fast exact-match (short search) and complicated wildcard lookups of tags with unusual characters. 'f' and '/f/' will now return '/f/' and 'board:/f/' quickly, 'board:f' and 'board:/f/' will return 'board:/f/' quickly, and 'te*a*' will correctly return 'test-tag' - it will take a few minutes to regenerate this new cache on update - complex wildcards like 's*m*' are now treated the same as simple ones like 'sam*' and should match unusual subtag characters in all cases - wildcard tag file search predicates are now plugged into the new cache, so the search preds '/f/*', 'board:/f/', 'board:/f/ast;', 'b*d:/f/' and 'b*d:/f/*' now all match files with 'board:/f/', as do wildcards that include replacement characters, so the same should be true above for 'f' instead of /f/' in all cases - new wildcard search preds do not collapse their characters for their presentation string, so 'date:2*-01-01' now renders like that, not 'date:2* 01 01' - wildcard file search predicates are now faster for simple (just an asterisk on the end) subtag wildcards - the fts search cache is moved from 'master' to 'caches' db this week, it will take a few moments on update - the 'repopulate tag search cache' db regen job now repopulates the fts cache, the new 'searchable' cache, and the integer tag cache - the database repair code now checks for the fts cache and new 'searchable' cache on boot and, if they are missing, warns the user and creates empty tables - . - improvements: - fixed the unsorted tags in tag suggestion boxes - clicking the inbox icon in the top-right hover window now archives the file - system:dimensions now has quick buttons for 16:9, 9:16, 4:3, 1:1, 1080p, 720p, and 4k - system:known url searches are now better about fetching www and non-www urls for the domain or url class - the edit shortcut sets panel now has nicer english names for reserved shortcut sets, and also sorts them in a more logical way - you no longer have to be in advanced mode to copy file hashes from thumbnails - users in advanced mode can copy the internal file_id of files from the thumbnail/viewer copy menus (this is most useful for the client api) - system num_frames, num_words, and num_notes now display alternate 'has/no xxx' labels when they search for =0 or >0 - you can now search for 0 with system:num_frames - . - fixes: - users who could restore from system tray using the menu but had trouble with clicking _should_ now have better luck with clicking - fixed some instances where fps could be calculated as 0, which would lead to other problems down the line. now a missing or 0 fps is remapped to 1 - fixed system:framerate for '<' queries - the status bar cells now get expanded tooltips to describe what they do - fixed some media result caching code that could in rare cases cause an error in content update processing when the result disappeared from the cache during processing - the 'hard-replace siblings and parents' button on 'manage tags' now makes a submenu so its actions' long labels show better - fixed a handful of tables that were not starting sorted - a variety of credential parse and other server failures that were formerly returning 403 now properly return 400 and 409 - in order to improve default 'open externally' behaviour on Linux/macOS, if the environment variable XDG_DATA_DIRS is not preserved through a hydrus build launch env, hydrus now sets a simple 'default' value for this before running xdg-open - if the client is booted from a windows shortcut to a built release, the program restart command is slightly more reliable - . - misc: - cleaned up some db update error reporting code, it should now more reliably make an english-friendly popup text box before splurging technical info - refactored some media object code, cleaned some class definitions, and added typing hints - misc code cleanup - the 'getting started' help files now have anchor definitions, so their sections can now be #linked to - added several links in the 'getting started' help to the user-created video guides here: https://github.com/CuddleBear92/Hydrus-guides thank you for making these! - added a link to the help for the user-made 'other archiving software' guide here: https://github.com/CuddleBear92/Hydrus-Presets-and-Scripts/wiki/0-Alternative-Programs-and-Resources#software thank you for making this! - fixed link to AUR package in the help - updated cloudscraper in all builds to 1.2.36 - updated windows mpv to a significantly newer dll, it now reports api version 1.108 - included libgpg-error.so.0 in Linux build, which will improve some Linux situations (more reports from Ubuntu 20.04 or others about missing/conflicting .so files are welcome) next week Next week is a small jobs week. I want to catch up on bugs, see if I can move notes parsing forward, and also (as part of that) improve our text match/transform tools so complicated texts and filenames are a bit easier to parse. The new IPFS daemon is also broken for hydrus, so I will also be looking at that.
Your continued and consistent work is appreciated! :D
(5.56 KB 171x270 3cguPPF.png)

I love you hydrusdev, but my tag sort in manage tags is still broken. In case it's not just me, could we get a hotfix release?
(3.78 KB 283x132 ClipboardImage.png)

im having a little problem where the tag 'pointer' defaults to the tag at the bottom of the list while the list is loading. its not really an issue with long tags but it throws me off balance when im typing tags fast and mashing enter.
As someone who uses the notes function a lot, I'm really excited to see it getting improved! Will it be possible to import and export notes to and from text files in the future? I have thousands of text files containing notes for files that I've since imported into Hydrus, but I'd rather not have to copy and paste them over manually. Having to export and re-import the files with the filename:tag to get this to work would be an acceptable inconvenience. :)
>using something as terrible as discord I can't even join because the invite URLs are always expired
(16.17 KB 691x90 Untitled.png)

I gotta ask… what is the point of this? It just adds extra clicks and makes the menu slower to use. I haven't been wanting to complain too much but changes like this has been happening all over the program and it just makes your workflow slower for no reason. A bit annoying. Please consider workflow over "neatness" when designing the menus.
>>14219 Can you elaborate? In this specific case, I think the sub-menu adds a little protection against mis-clicks with an operation that chould screw things up badly, but I feel like I have seen other things that felt "in the way".
(10.61 KB 1406x348 Untitled.png)

>>14221 It's just annoying that something that took a second to do now takes 3, and an extra click. Misclicking isn't a problem because it always asks you to accept in a popup window. As for the normal right click menu, some of the commonly used functions have been moved into submenus making them slower to use.
Make new invites to your discord server.
>>14231 Yeah, I can't get in either. Did the server get nuked?
>>14223 Ah, yeah; I see. Why don't we just have the menus customizeable? Then everyone can autism their own way.
>>14209 Thanks m8, keep on pushing. >>14210 Ah, thank you. As it happens, my test machine only had three tags there, and they happened to sort by accident. The old manual sort call must have been lost in the rewrite. I'll sort them using the normal lexicographic sort there for 397. >>14214 Thank you. I have several reports on this now. It is always the bottom for some reason, even on long lists. I will fix this for 397.
>>14216 That's the hope. It'd be nice to have some sort of .txt import/export, and mass import/export with an external Hydrus Notes Archive and a new 'notes migration' panel, and Client API access for notes. I hope to slowly push on this in future normal weekly work. >>14217 >>14231 >>14243 The server is still up. Some weird dude got upset and started spamming TOS-violation stuff to the server along with some friends, so the old invite url got turned off. Assuming the users who run the discord server are ok at that point about putting a new invite up, I'll fold the new on into 397 and all my help links. >>14219 >>14223 >>14246 Thanks. I agree. The reason for that sibling hard-replace change was because the text on those menu items was too long, and it was getting text…elided in a way where you couldn't see the difference between the two options. I split it up as a quick patch so users (particularly new users) could actually read the difference. And I totally agree on the super nested thumbnail menus. There are an increasing number of commands in hydrus now, and for things like the duplicates system the available menus are flexible depending on the thumb or selection status, so you can get annoying stuff like in your image with a submenu with only one submenu item, just wasting space and time. I am happy that that big thumbnail menu is now listed essentially by verb, so it isn't the hacked-together mess that it was, but now it lists many common actions at the same depth as uncommon. My current plans are: 1) Improve shortcut action support, so if you want to do something often, you can map a key to it and bypass the menu entirely. 2) Clean up my menu code so it is less hardcoded and more unified, modular, and dynamic, so it is less work for me simply to work on it. 3) Hang more options and layout options on the menu code so users in advanced mode get different and briefer labels and layouts. 4) Once it is really modular, start work on actual menu customisation, as >>14246 says, so I can have a complicated options panel somewhere where you can turn menu items on and off and manage submenus and so on. I can't do this now, as most menus are hardcoded, and complete customisation would be a hellscape to implement. This stuff is often difficult for me to notice, especially as different users use different actions to me just in normal usage. Simple feedback on what works and what doesn't is really helpful. For that parent/siblings hard-replace, I can think of a couple of options: I could collapse the menu into a single 3/4 high one, with a non-functional title label: hard-replace sibs and add parents (label, maybe in bold, does nothing) - just for this service for all services Or I could skip the menu entirely and launch a mini-dialog from the button with the explainer text and two buttons for single/all. As someone who uses this a lot, what do you think you would like? Do you have another idea? What other menus do you find annoying?
>>14248 >As someone who uses this a lot, what do you think you would like? Either would work, but since it already shows a confirmation window with suggested changes maybe a description and single/all could be integrated into it? >What other menus do you find annoying? Mainly things in the thumbnail menu that used to be easy accessible in older versions being moved into submenus and lower on the menu, for example "remove > selected" "manage > tags" and "open > in external program". And when you right click a tag "copy > x". Maybe it's because I learned the older layouts first that it was annoying for me. The menu is better organized now and a little more cumbersome, but perhaps better for new users. I just learned to use shortcut keys instead where possible. Menus aren't great in other places but it's less of an issue there since it's not ones you use often.
>>14208 >Beyond that, I'd love some note 'preview' on the media viewer and comprehensive import/export/Client API support for notes. Does that mean there's a chance that we could get something similar to how it works on Danbooru or am I misunderstanding? I don't know if that's feasible but it would be amazing. I'm talking about stuff like this: https://danbooru.donmai.us/posts/3900728
I had an ok week. I fixed some bugs, improved some quality of life, and added a new system predicate to search for notes by name. The release should be as normal tomorrow.


Forms
Delete
Report
Quick Reply