>>18393
Lycoris is a blanket term to mean LoCon, LoKR, IA3, DyLoRA, and LoHa. On a general case, the only useful ones are LoHa and LoCon. Kohya themselves support LoCon as well as LoRA and DyLoRA.
DyLoRA is just effectively training a lora that is multiple dims so that it can dynamically decide what dim size each layer needs to be, but due to how long it takes to train, is fairly useless.
My personal "these are worth it" list is, in order of usefulness:
LoCon, LoRA, LoHa
The rest I generally consider trash for various reasons.
IA3: fails to work on models too far from the base... in entirety, doesn't really learn much in general, has had exactly 0 made that wasn't a pure dumpster fire.
LoKR: similar issues to IA3, less problematic overall though, and
could see some use if it weren't for the fact that it generally speaking needs stupid high dims to learn anything useful, and even then it suffers a lot of the same high dim issues as LoRA.
DyLoRA: as mentioned above, takes forever to train, because you are effectively training multiple LoRA, or LoCon at one time. It's not
bad per se, it's just generally not worth the extra time spent for what amounts to what is pretty much just a normal lora.
LoHa: this is a bit if an odd one because it shines greatly with complexity. As in, if you want to train 40 characters into one lora, make it a loha. That's pretty much its best use case. I wouldn't use it for other things.