Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Dev] Disable Block reduction for int8 by default #140

Merged
merged 186 commits into from
Aug 13, 2024
Merged

[Dev] Disable Block reduction for int8 by default #140

merged 186 commits into from
Aug 13, 2024

Conversation

LeiWang1999
Copy link
Contributor

This pull request includes updates to a submodule and a conditional check in the bitblas module to enhance functionality and compatibility.

Submodule Update:

  • 3rdparty/tvm: Updated the submodule commit to the latest version.

Code Enhancement:

  • bitblas/gpu/matmul_analysis.py: Modified the check_last_trait function to include a condition that only supports float16 data type when checking for dequantize_info attribute.

@LeiWang1999
Refactor BatchMatMulEmitter and BatchMatMulSelector for improved read…
d8884e6 
…ability and maintainability
@LeiWang1999
Refactor import statements for improved readability and maintainability
fc84173
@LeiWang1999
Refactor import statements for improved readability and maintainability
02f64de
@LeiWang1999
disable failure email for ci
397eee6
@LeiWang1999
remove email notifications.
20f6ad1
@LeiWang1999
move relax pass from testing to mlc_llm
b93c394
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into main
ba6a6df
@LeiWang1999
Refactor scripts with se check_eual_ref_scripts_with_emitter function
257693a
@LeiWang1999
Lint Fix
9bb7f49
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into main
39e7614
@LeiWang1999
Refactor scripts with se check_eual_ref_scripts_with_emitter function
93eb5a5
@LeiWang1999
bug fix in test
aa66a90
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
ae14a53
@LeiWang1999
lint fix.
79b08e4
@LeiWang1999
test cuda i4 kernel
86fd036
@LeiWang1999
Refactor copyright notice in i4matmul.hpp
6b73a21
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
0ba90c1
@LeiWang1999
Refactor BitBLASLinear test module for improved readability and maint…
086d208 
…ainability
@LeiWang1999
refactor test as version below python 3.9 cannot handle int32 overflow.
47a3abd
@LeiWang1999
format lint for test
024b247
@LeiWang1999
Refactor test_int4b_fp16_convert.py for improved readability and main…
bfedeaa 
…tainability
@LeiWang1999
remove unused design file
e672a23
@LeiWang1999
move tile device from package to base
21e5430
@LeiWang1999
dummy impl for codegen
fd11940
@LeiWang1999
Refactor file structure for ladder_permutate module
9ccfa85
@LeiWang1999
Refactor backend class and fix typos in comments
7c7d73e
@LeiWang1999
Deep refactor Lib related code.
47d5fc5
@LeiWang1999
remove ci pull.
53dd0dd
@LeiWang1999
LintFix
d58ac43
@LeiWang1999
refactor builder for whl build
37cb07c
LeiWang1999 and others added 29 commits August 6, 2024 17:32
@LeiWang1999
lint fix
907d434
@LeiWang1999
case fix
e7c805a
@LeiWang1999
bug fix
7a16e5a
@LeiWang1999
fix for legalize
8c666ac
@LeiWang1999
bug fix
ce79943
@LeiWang1999
chore: Clear global operator cache before running tests
e6c5eec
@LeiWang1999
revert optimize_stratety into SingleBatchDecodeOnly
4e8ab23
@LeiWang1999
typofix
8177e2f
@LeiWang1999
update benchmark scripts
113e485
@LeiWang1999
chore: Refactor benchmark scripts and fix typos
46b2d7d
@LeiWang1999
fix for testing
9ecbb48
@LeiWang1999
lint fix
fb128ed
@LeiWang1999
fix import.
9b5e106
@LeiWang1999
typo
54b4044
@LeiWang1999
operator benchmark
23f88b7
@LeiWang1999
optimize
bcffc49
@LeiWang1999
always with shared.dyn
8b5f083
@LeiWang1999
optimize cache.
54b5d3f
@LeiWang1999
dsl fix
4289d7b
@LeiWang1999
Merge branch 'main' into update_transform
72a1863
@LeiWang1999
tqdm
2327e14
@LeiWang1999
Merge branch 'update_transform' of https://github.com/LeiWang1999/MSB…
40a9b04 
…itBLAS into update_transform
@LeiWang1999
chore: Add serialize_results method to benchmark_matmul_strategies.py
a16ee62
@LeiWang1999
fix performance issue for dynamic async copy
63fc654
@LeiWang1999
chore: Refactor benchmark_matmul_strategies.py for improved performan…
d37d09f 
…ce and code readability
@LeiWang1999
bug fix
d4d4603
@LeiWang1999
update readme
1816526
@LeiWang1999
disable block reduce for int8
b81a3a8
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into upda…
9cde970 
…te_transform
@LeiWang1999 LeiWang1999 merged commit fcf3f63 into microsoft:main Aug 13, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@LeiWang1999