Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lora: Partial LyCORIS support (tucker decomposition for LoCon + LoHa + LoKr) #577

Merged
merged 6 commits into from
Feb 22, 2025

Conversation

stduhpf
Copy link
Contributor

@stduhpf stduhpf commented Jan 22, 2025

This should increase LoRA compatibility.

Technical details: https://github.com/KohakuBlueleaf/LyCORIS/blob/main/docs/Algo-Details.md#lora-for-convolution-with-tucker-decomposition

I'm not 100% sure I'm doing everything right but it looks like it's working fine...

Implements the changes from #575 too

@stduhpf stduhpf changed the title Lora: support tucker decomposition (Lycoris / LoCon) Lora: Partial Lycoris support (tucker decomposition for LoCon + LoHa) Jan 25, 2025
@stduhpf stduhpf changed the title Lora: Partial Lycoris support (tucker decomposition for LoCon + LoHa) Lora: Partial LyCORIS support (tucker decomposition for LoCon + LoHa) Jan 25, 2025
@stduhpf stduhpf changed the title Lora: Partial LyCORIS support (tucker decomposition for LoCon + LoHa) Lora: Partial LyCORIS support (tucker decomposition for LoCon + LoHa + LoKr) Jan 26, 2025
@leejet
Copy link
Owner

leejet commented Feb 22, 2025

Thank you for your contribution.

@leejet leejet merged commit 1be2491 into leejet:master Feb 22, 2025
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants