Skip to content

Adding Support for Qwen3.5#43830

Open
bozheng-hit wants to merge 20 commits intohuggingface:mainfrom
bozheng-hit:qwen3_5
Lines changed: 6808 additions & 1 deletion
Open

Adding Support for Qwen3.5#43830
bozheng-hit wants to merge 20 commits intohuggingface:mainfrom
bozheng-hit:qwen3_5

Conversation

@bozheng-hit
Copy link
Contributor

@bozheng-hit bozheng-hit commented Feb 8, 2026

This PR adds the support of codes for the upcoming Qwen3.5 series models. For information about Qwen, please visit:
👉https://qwen.ai

Special thanks to @JJJYmmm for helping complete the code in this PR. We also appreciate the valuable feedback and thorough review provided by @vasqu and @ArthurZucker ! 🙏

bozheng-hit and others added 17 commits February 7, 2026 12:08
rebase main
ee87021
@JJJYmmm
remove redundant init
6a3eefd
fix
23cd36a
@JJJYmmm
remove qwen3vlmoe mapping since resolved
1f11b92
@JJJYmmm
add auto image processor
e21067a
fix
d943dd3
fix
42bda8a
@JJJYmmm
update qwen3_next_style rmsnorm
e445155
@JJJYmmm
update text config check
a697579
@JJJYmmm
simplify vision model
fdc63c2
@JJJYmmm
simplify vision config
87fc89b
@JJJYmmm
inherit pretrainedmodel and qwen3next decoder layer forward
645ba10
@JJJYmmm
simplify config
32d8d68
fix apply_rotary_pos_emb import
b047ea1
@JJJYmmm
move to latest main, update vision output and fix rope validation

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode
a5ea9fc
@JJJYmmm
fix text-only model loading

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode
Loading
Loading status checks…
91ace4c
fix config
Loading
Loading status checks…
34f7964
@YurkoHoshko YurkoHoshko mentioned this pull request Feb 8, 2026
Open
4 tasks
@johnmai-dev johnmai-dev mentioned this pull request Feb 8, 2026
Open
1 task
@fpshuang
Copy link

fpshuang commented Feb 8, 2026 •
edited
Loading

Merge this PR only after Feb 23th, PLEASE! WE NEED A FINE SPRING FESTIVAL

@MrHills-rs MrHills-rs mentioned this pull request Feb 8, 2026
Open
4 tasks
@vasqu
quick fixes
Loading
Loading status checks…
fd9d530
@github-actions
Copy link
Contributor

github-actions bot commented Feb 8, 2026

[For maintainers] Suggested jobs to run (before merge)

run-slow: auto, qwen3_5

vasqu added 2 commits February 8, 2026 14:07
@vasqu
fix rope ignore keys
Loading
Loading status checks…
8b34f99
@vasqu
oops
Loading
Loading status checks…
ba0c456
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

None yet

4 participants

@bozheng-hit @fpshuang @JJJYmmm @vasqu