Not Lain's picture

Building on HF

Not Lain

not-lain

chonkie-ai

·

https://not-lain.github.io

AI & ML interests

custom AI models with HF integration, HuggingFace fellow 🤗

Recent Activity

upvoted a paper 1 day ago

ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning

reacted to SeanLee97's post with 🚀 1 day ago

Our lab recently released a paper where we introduce ShadowPEFT, a new Parameter-Efficient Fine-Tuning (PEFT) paradigm tailored for edge computing scenarios. Unlike traditional approaches such as LoRA and its variants, which inject trainable parameters directly into the weights of Transformer, requiring tight coupling with the backbone. ShadowPEFT instead enhances the frozen large base model by adding a lightweight, centralized, pretrainable, and detachable Shadow network. This shadow network operates in parallel with the base model, delivering learned corrections to each decoder layer. Because the shadow module is architecturally decoupled from the backbone, it can be independently trained, stored, and deployed, benefiting edge computing scenarios and edge-cloud collaboration computing. - HF Paper: https://huggingface.co/papers/2604.19254 - GitHub: https://github.com/ShadowLLM/shadow-peft - HF Collection: https://huggingface.co/collections/shadow-llm/shadow-peft-models

reacted to SeanLee97's post with 🔥 1 day ago

Our lab recently released a paper where we introduce ShadowPEFT, a new Parameter-Efficient Fine-Tuning (PEFT) paradigm tailored for edge computing scenarios. Unlike traditional approaches such as LoRA and its variants, which inject trainable parameters directly into the weights of Transformer, requiring tight coupling with the backbone. ShadowPEFT instead enhances the frozen large base model by adding a lightweight, centralized, pretrainable, and detachable Shadow network. This shadow network operates in parallel with the base model, delivering learned corrections to each decoder layer. Because the shadow module is architecturally decoupled from the backbone, it can be independently trained, stored, and deployed, benefiting edge computing scenarios and edge-cloud collaboration computing. - HF Paper: https://huggingface.co/papers/2604.19254 - GitHub: https://github.com/ShadowLLM/shadow-peft - HF Collection: https://huggingface.co/collections/shadow-llm/shadow-peft-models

View all activity

Organizations

not-lain 's models 83

not-lain/matanyone2

Updated Mar 12 • 2

not-lain/finetuned_deepseek_ocr

Text Generation • 3B • Updated Oct 30, 2025 • 2 • 1

not-lain/Quotes_Generator

Updated Oct 26, 2025 • 1

not-lain/cube

2B • Updated Mar 30, 2025 • 5

not-lain/GR00T-N1-2B

Robotics • 2B • Updated Mar 26, 2025 • 4 • 1

not-lain/gr00t_policy_1

2B • Updated Mar 26, 2025 • 4

not-lain/matanyone

Updated Mar 9, 2025

not-lain/araclip

Updated Mar 8, 2025 • 5 • 1

not-lain/matanyone-files

Updated Mar 3, 2025

not-lain/BEN2

Mask Generation • Updated Feb 5, 2025

not-lain/mermaid-test

Updated Feb 2, 2025

not-lain/swarmformer-base

Updated Jan 25, 2025 • 5

not-lain/MAT-CelebA-HQ_512

Image-to-Image • Updated Jan 25, 2025 • 2

not-lain/test

Updated Dec 30, 2024

not-lain/BiRefNet

Image-to-Image • 0.2B • Updated Dec 6, 2024 • 65

not-lain/isnet_is

Image Segmentation • Updated Oct 12, 2024 • 6 • 1

not-lain/styletts2-HF

Text-to-Speech • Updated Sep 23, 2024 • 4 • 3

not-lain/TEED-BIPED

Updated Sep 23, 2024

not-lain/padoru-lora

Updated Sep 21, 2024 • 1

not-lain/smol-gec-orpo

Text Generation • 0.1B • Updated Sep 16, 2024 • 1

not-lain/smol-gec-dpo

Text Generation • 0.1B • Updated Sep 16, 2024 • 1

not-lain/smol-gec-sft

Text Generation • 0.1B • Updated Sep 16, 2024 • 1

not-lain/TonicNet

Updated Aug 24, 2024 • 3 • 1

not-lain/outputs

Updated Jul 27, 2024 • 5

not-lain/my_mnist_model

Image Classification • Updated Jul 21, 2024 • 4

not-lain/BiRefNet-massive

Updated Jul 15, 2024 • 5 • 1

not-lain/test_unsloth

Updated Jul 5, 2024

not-lain/mayo

Text Generation • 1B • Updated Jun 28, 2024 • 5

not-lain/my_tq_model

Updated Jun 24, 2024

not-lain/Depth-Anything-V2-Base

Depth Estimation • Updated Jun 23, 2024 • 5