Skip to content

refine awq, bugfix - #2115

Open
WeiweiZhang1 wants to merge 14 commits into
intel:mainfrom
WeiweiZhang1:refine_awq
Open

refine awq, bugfix#2115
WeiweiZhang1 wants to merge 14 commits into
intel:mainfrom
WeiweiZhang1:refine_awq

Conversation

@WeiweiZhang1

@WeiweiZhang1 WeiweiZhang1 commented Jul 31, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Description

refine awq alg, add smooth seqlen, add skip_moe option, add ignore_layers config support for awq mapping, logging bugfix, refine docs

Type of Change

Bug fix

Related Issues

Fixes or relates to #

Checklist Before Submitting

  • My code has been tested locally.
  • Documentation has been updated as needed.
  • New or updated tests are included where applicable.
  • The CUDA CI has passed. You can trigger it by commenting /azp run Unit-Test-CUDA-AutoRound.

@WeiweiZhang1
refine awq alg, add smooth seqlen, bugfix, refine docs
e1eeff7 
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
@WeiweiZhang1
check mapping for mixed_config setting
b457c3a 
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
@WeiweiZhang1 WeiweiZhang1 removed the WIP label Aug 7, 2026
WeiweiZhang1 and others added 4 commits August 7, 2026 14:49
@WeiweiZhang1
Merge remote-tracking branch 'origin/main' into refine_awq
59a87bb 
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>

# Conflicts:
#	auto_round/compressors/entry.py
#	docs/step_by_step.md
#	docs/step_by_step_CN.md
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
f4dd0e4 
for more information, see https://pre-commit.ci
@WeiweiZhang1
refactor: simplify AWQ block mapping lookup
409874f 
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
@WeiweiZhang1
Merge remote-tracking branch 'fork/refine_awq' into refine_awq
5c05195
@WeiweiZhang1

WeiweiZhang1 commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

azure-pipelines Bot commented Aug 7, 2026

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@WeiweiZhang1
WeiweiZhang1 requested review from n1ck-guo and wenhuach21 and removed request for wenhuach21 August 7, 2026 08:03
@WeiweiZhang1
Merge remote-tracking branch 'origin/main' into refine_awq
ecc99c2 
# Conflicts:
#	test/unit/test_cpu/algorithms/test_awq.py
@WeiweiZhang1

WeiweiZhang1 commented Aug 10, 2026

Copy link
Copy Markdown
Contributor Author

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

azure-pipelines Bot commented Aug 10, 2026

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

wenhuach21
wenhuach21 reviewed Aug 11, 2026
View reviewed changes
Comment thread docs/step_by_step.md
wenhuach21
wenhuach21 reviewed Aug 11, 2026
View reviewed changes
Comment thread docs/step_by_step.md Outdated
wenhuach21
wenhuach21 reviewed Aug 11, 2026
View reviewed changes
Comment thread docs/step_by_step.md Outdated
@wenhuach21

wenhuach21 commented Aug 11, 2026

Copy link
Copy Markdown
Contributor

What's the bug? If the bug affects accuracy, please update the accuracy results accordingly.

If there are currently no accuracy results, please add some in this PR or a follow-up PR. This will make it easier for users to decide which algorithm best fits their needs.

It would also be helpful to include the quantization cost.

@WeiweiZhang1 WeiweiZhang1 added this to the 0.15.0 milestone Aug 11, 2026
@WeiweiZhang1
refine step doc of awq algo
0d5d642 
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
@WeiweiZhang1

WeiweiZhang1 commented Aug 12, 2026

Copy link
Copy Markdown
Contributor Author

What's the bug? If the bug affects accuracy, please update the accuracy results accordingly.

If there are currently no accuracy results, please add some in this PR or a follow-up PR. This will make it easier for users to decide which algorithm best fits their needs.

It would also be helpful to include the quantization cost.

bug mainly means layer config and logging aspects and has no impact on accuracy.
will update related accuracy and time cost infos on follow-up PR

wenhuach21
wenhuach21 reviewed Aug 12, 2026
View reviewed changes
Comment thread auto_round/cli/algorithms.py Outdated
wenhuach21
wenhuach21 approved these changes Aug 12, 2026
View reviewed changes
Comment thread auto_round/cli/algorithms.py Outdated
Comment thread docs/step_by_step.md
Comment thread docs/step_by_step.md Outdated
Comment thread docs/step_by_step.md Outdated
Comment thread docs/step_by_step.md Outdated
wenhuach21
wenhuach21 reviewed Aug 12, 2026
View reviewed changes
Comment thread auto_round/cli/algorithms.py Outdated
@WeiweiZhang1
rename awq_seqlen, refine docs
f07d977 
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
@WeiweiZhang1
Merge branch 'main' into refine_awq
29a19ad
@WeiweiZhang1

WeiweiZhang1 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor Author

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

azure-pipelines Bot commented Aug 13, 2026

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@chensuyue

chensuyue commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

azure-pipelines Bot commented Aug 13, 2026

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

1 similar comment
@azure-pipelines

azure-pipelines Bot commented Aug 13, 2026

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@WeiweiZhang1
align awq args naming style, refine doc
0457516 
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
@WeiweiZhang1

WeiweiZhang1 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor Author

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

azure-pipelines Bot commented Aug 13, 2026

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@WeiweiZhang1

WeiweiZhang1 commented Aug 13, 2026

Copy link
Copy Markdown
Contributor Author

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

azure-pipelines Bot commented Aug 13, 2026

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@wenhuach21 wenhuach21 wenhuach21 approved these changes
@n1ck-guo n1ck-guo Awaiting requested review from n1ck-guo

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

0.15.0

Development

Successfully merging this pull request may close these issues.

3 participants

@WeiweiZhang1 @wenhuach21 @chensuyue