Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

use cifar10 as dataset and update dataloader format #3

Merged
merged 3 commits into from
Feb 18, 2024
Merged

use cifar10 as dataset and update dataloader format #3

merged 3 commits into from
Feb 18, 2024

Conversation

oahzxl
Copy link
Collaborator

@oahzxl oahzxl commented Feb 18, 2024

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

@oahzxl oahzxl merged commit a6c4787 into master Feb 18, 2024
@oahzxl oahzxl deleted the dataloader branch February 18, 2024 16:08
oahzxl added a commit that referenced this pull request Aug 5, 2024
@Jinxiaolong1129 @oahzxl
implement mlp broadcast (#150)
c1438c7 
* init commit (#3)

* update diffusion

* polish

* update structure

* embed

* update ref

* update ref

* udpate opensora init

* remove

* update

* update name

* fix v1

* update ignore

* update stdit2

* update v2 infer

* support v2 infer

* update script

* polish code

* update script

* update script and rename

* fix cross

* update code for temporal and cross

* update base script

* remove layernorm for infer

* update

* add readme (#4)

* update default setting (#5)

* Spatial attention (#6)

* update prompt

* update spatial

* update code control

* Merge (#7)

* update diffusion

* polish

* update structure

* embed

* update ref

* update ref

* udpate opensora init

* remove

* update

* update name

* fix v1

* update ignore

* update stdit2

* update v2 infer

* support v2 infer

* update script

* polish code

* update script

* update script and rename

* fix cross

* fix some bugs

* optimize attn

* add latte

* update

* update opensora sample

* remove useless arg

* Update save_dir path in opensora sample configs

* update test

* seed

* update opensora plan

* update opensora plan

* update yaml

* remove useless

* update opensora plan

* update doc

* update script

* update data

* update code

* update usage

* update

* add attn skip for latte and opensoraplan (#8)

* add block

* fix

* update latte

* update

* add latte args (#9)

* fix latte argparse (#10)

* add kw

* fix arg

* add eval

* update ignore

* Opensorav1.2 (#11)

* add opensorav1.2

* update final

* udpate mgr

* support opensora skip (#12)

* update opensora yaml

* add shard

* update opensora skip

* update config for other models (#13)

* finish opensora-plan and latte

* Sp (#14)

* update latte shard

* rename arg

* update license

* update lincense file

* update dynamic sp for opensoraplan and latte

* Update STDiT3Block and STDiT3 classes in stdit3.py

* finish opensora

* code refine

* code refine

* final code clean

* update skip_diffusion_timestep function to handle more than 1 step skip

* update skip config (#16)

* udpate range for all

* update opensora plan

* update code

* polish code

* polish print

* update default value

* update verbose

* finish latte eval generate function

* update gitignore

* finish eval
TODO:
BUG check whether center crop is correct
TODO original video size< generated videos, how to resize?

* update eval save

* update mlp skip

* update

* parse mlp skip

* update

* update

* update

* update test mlp mse

* update

* update

* update

* update skip s t

* update

* update

* update

* update

* update latte

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update finish skip function

* delete and change file name to clean code

* update

* update

* clean code finish

* delete mse code and clean code finish

* delete and clean code

* clean eval code

* delete asset

* update

* polish code

* polish

* update rflow

---------

Co-authored-by: Xuanlei Zhao <[email protected]>
Co-authored-by: Jinxiaolong1129 <[email protected]>
oahzxl added a commit that referenced this pull request Aug 23, 2024
@Jinxiaolong1129 @oahzxl
implement mlp broadcast (#150)
994a348 
* init commit (#3)

* update diffusion

* polish

* update structure

* embed

* update ref

* update ref

* udpate opensora init

* remove

* update

* update name

* fix v1

* update ignore

* update stdit2

* update v2 infer

* support v2 infer

* update script

* polish code

* update script

* update script and rename

* fix cross

* update code for temporal and cross

* update base script

* remove layernorm for infer

* update

* add readme (#4)

* update default setting (#5)

* Spatial attention (#6)

* update prompt

* update spatial

* update code control

* Merge (#7)

* update diffusion

* polish

* update structure

* embed

* update ref

* update ref

* udpate opensora init

* remove

* update

* update name

* fix v1

* update ignore

* update stdit2

* update v2 infer

* support v2 infer

* update script

* polish code

* update script

* update script and rename

* fix cross

* fix some bugs

* optimize attn

* add latte

* update

* update opensora sample

* remove useless arg

* Update save_dir path in opensora sample configs

* update test

* seed

* update opensora plan

* update opensora plan

* update yaml

* remove useless

* update opensora plan

* update doc

* update script

* update data

* update code

* update usage

* update

* add attn skip for latte and opensoraplan (#8)

* add block

* fix

* update latte

* update

* add latte args (#9)

* fix latte argparse (#10)

* add kw

* fix arg

* add eval

* update ignore

* Opensorav1.2 (#11)

* add opensorav1.2

* update final

* udpate mgr

* support opensora skip (#12)

* update opensora yaml

* add shard

* update opensora skip

* update config for other models (#13)

* finish opensora-plan and latte

* Sp (#14)

* update latte shard

* rename arg

* update license

* update lincense file

* update dynamic sp for opensoraplan and latte

* Update STDiT3Block and STDiT3 classes in stdit3.py

* finish opensora

* code refine

* code refine

* final code clean

* update skip_diffusion_timestep function to handle more than 1 step skip

* update skip config (#16)

* udpate range for all

* update opensora plan

* update code

* polish code

* polish print

* update default value

* update verbose

* finish latte eval generate function

* update gitignore

* finish eval
TODO:
BUG check whether center crop is correct
TODO original video size< generated videos, how to resize?

* update eval save

* update mlp skip

* update

* parse mlp skip

* update

* update

* update

* update test mlp mse

* update

* update

* update

* update skip s t

* update

* update

* update

* update

* update latte

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update finish skip function

* delete and change file name to clean code

* update

* update

* clean code finish

* delete mse code and clean code finish

* delete and clean code

* clean eval code

* delete asset

* update

* polish code

* polish

* update rflow

---------

Co-authored-by: Xuanlei Zhao <[email protected]>
Co-authored-by: Jinxiaolong1129 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@oahzxl