주따님이 배포해주신 https://mega.nz/file/AOM2WaaA#RM7pgtgaw9uC0Psncynv2YaV_Mph88-78L6pNGPX2V8 설정파일로
진행했으며, 베이스 모델은 noobaiXLNAIXL_epsilonPred11Version
Sample prompts에서 1girl, solo, bikini --n nsfw, chibi --w 832 --h 1216 --d 1 --l 6 --s 28 부분을
style --n nsfw, chibi --w 832 --h 1216 --d 1 --l 6 --s 28로 바꿔줬습니다.
위에 부분만 변경하고 나머지 세팅은 그대로인데, 학습을 못하고 오류가 나고있습니다 ㅠㅜ
혹시 파이썬이나 베이스모델 문제일까요?
17:35:17-572922 INFO Start training Dreambooth...
17:35:23-951077 INFO Validating lr scheduler arguments...
17:35:23-955081 INFO Validating optimizer arguments...
17:35:23-957079 INFO Validating D:/AI/ai_trainning/log existence and writability... SUCCESS
17:35:23-958080 INFO Validating D:/AI/ai_trainning/model existence and writability... SUCCESS
17:35:23-960079 INFO Validating C:/Users/VIC/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.safetensors existence... SUCCESS
17:35:23-961079 INFO Validating D:/AI/ai_trainning/Image existence... SUCCESS
17:35:23-963078 INFO Folder 50_brzkdlxh: 50 repeats found
17:35:23-964184 INFO Folder 50_brzkdlxh: 347 images found
17:35:23-965186 INFO Folder 50_brzkdlxh: 347 * 50 = 17350 steps
17:35:23-966187 INFO Regulatization factor: 1
17:35:23-967186 INFO Total steps: 17350
17:35:23-968186 INFO Train batch size: 2
17:35:23-969186 INFO Gradient accumulation steps: 1
17:35:23-970186 INFO Epoch: 1
17:35:23-971186 INFO max_train_steps (17350 / 2 / 1 * 1 * 1) = 8675
17:35:23-972186 INFO lr_warmup_steps = 0
17:35:23-976401 INFO Saving training config to D:/AI/ai_trainning/model\br_style_test_v01_20241209-173523.json...
17:35:23-978401 INFO Executing command: D:\AI\Kohya\kohya_ss\venv\Scripts\accelerate.EXE launch --dynamo_backend no --dynamo_mode default --mixed_precision bf16 --num_processes 1 --num_machines 1 --num_cpu_threads_per_process 2
D:/AI/Kohya/kohya_ss/sd-scripts/sdxl_train.py --config_file D:/AI/ai_trainning/model/config_dreambooth-20241209-173523.toml --log_prefix=xl-loha
17:35:23-998400 INFO Command executed.
2024-12-09 17:35:31 INFO Loading settings from D:/AI/ai_trainning/model/config_dreambooth-20241209-173523.toml... train_util.py:4174
INFO D:/AI/ai_trainning/model/config_dreambooth-20241209-173523 train_util.py:4193
WARNING clip_skip will be unexpected / SDXL学習ではclip_skipは動作しません sdxl_train_util.py:352
2024-12-09 17:35:31 INFO prepare tokenizers sdxl_train_util.py:138
2024-12-09 17:35:32 INFO update token length: 75 sdxl_train_util.py:163
INFO Using DreamBooth method. sdxl_train.py:144
INFO prepare images. train_util.py:1815
INFO found directory D:\AI\ai_trainning\Image\50_brzkdlxh contains 347 image files train_util.py:1762
INFO 17350 train images with repeating. train_util.py:1856
INFO 0 reg images. train_util.py:1859
WARNING no regularization images / 正則化画像が見つかりませんでした train_util.py:1864
INFO [Dataset 0] config_util.py:572
batch_size: 2
resolution: (1024, 1024)
enable_bucket: True
network_multiplier: 1.0
min_bucket_reso: 64
max_bucket_reso: 2048
bucket_reso_steps: 32
bucket_no_upscale: True
[Subset 0 of Dataset 0]
image_dir: "D:\AI\ai_trainning\Image\50_brzkdlxh"
image_count: 347
num_repeats: 50
shuffle_caption: False
keep_tokens: 1
keep_tokens_separator:
caption_separator: ,
secondary_separator: None
enable_wildcard: False
caption_dropout_rate: 0.0
caption_dropout_every_n_epoches: 0
caption_tag_dropout_rate: 0.0
caption_prefix: None
caption_suffix: None
color_aug: False
flip_aug: False
face_crop_aug_range: None
random_crop: False
token_warmup_min: 1,
token_warmup_step: 0,
alpha_mask: False,
is_reg: False
class_tokens: brzkdlxh
caption_extension: .txt
INFO [Dataset 0] config_util.py:578
INFO loading image sizes. train_util.py:911
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 347/347 [00:00<00:00, 26692.77it/s]
INFO make buckets train_util.py:917
WARNING min_bucket_reso and max_bucket_reso are ignored if bucket_no_upscale is set, because bucket reso is defined by image size automatically / train_util.py:934
bucket_no_upscaleが指定された場合は、bucketの解像度は画像サイズから自動計算されるため、min_bucket_resoとmax_bucket_resoは無視されます
INFO number of images (including repeats) / 各bucketの画像枚数(繰り返し回数を含む) train_util.py:963
INFO bucket 0: resolution (768, 1024), count: 3350 train_util.py:968
INFO bucket 1: resolution (1024, 1024), count: 14000 train_util.py:968
INFO mean ar error (without repeats): 0.0 train_util.py:973
INFO prepare accelerator sdxl_train.py:201
accelerator device: cuda
INFO loading model for process 0/1 sdxl_train_util.py:33
INFO load StableDiffusion checkpoint: C:/Users/VIC/stable-diffusion-webui/models/Stable-diffusion/v1-5-pruned-emaonly.safetensors sdxl_train_util.py:74
INFO building U-Net sdxl_model_util.py:198
INFO loading U-Net from checkpoint sdxl_model_util.py:202
Traceback (most recent call last):
File "D:\AI\Kohya\kohya_ss\sd-scripts\sdxl_train.py", line 948, in <module>
train(args)
File "D:\AI\Kohya\kohya_ss\sd-scripts\sdxl_train.py", line 217, in train
) = sdxl_train_util.load_target_model(args, accelerator, "sdxl", weight_dtype)
File "D:\AI\Kohya\kohya_ss\sd-scripts\library\sdxl_train_util.py", line 43, in load_target_model
) = _load_target_model(
File "D:\AI\Kohya\kohya_ss\sd-scripts\library\sdxl_train_util.py", line 82, in _load_target_model
) = sdxl_model_util.load_models_from_sdxl_checkpoint(model_version, name_or_path, device, model_dtype, disable_mmap)
File "D:\AI\Kohya\kohya_ss\sd-scripts\library\sdxl_model_util.py", line 207, in load_models_from_sdxl_checkpoint
info = _load_state_dict_on_device(unet, unet_sd, device=map_location, dtype=dtype)
File "D:\AI\Kohya\kohya_ss\sd-scripts\library\sdxl_model_util.py", line 166, in _load_state_dict_on_device
raise RuntimeError("Error(s) in loading state_dict for {}:\n\t{}".format(model.__class__.__name__, "\n\t".join(error_msgs)))
RuntimeError: Error(s) in loading state_dict for SdxlUNet2DConditionModel:
Unexpected key(s) in state_dict: "input_blocks.11.0.out_layers.0.weight", "output_blocks.11.1.transformer_blocks.0.ff.net.2.bias", "input_blocks.2.1.norm.bias", "output_blocks.9.1.transformer_blocks.0.norm3.weight", "output_blocks.8.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.8.1.proj_in.bias", "output_blocks.7.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.11.1.transformer_blocks.0.attn2.to_k.weight", "input_blocks.10.0.emb_layers.1.weight", "input_blocks.1.1.proj_in.weight", "output_blocks.10.1.transformer_blocks.0.attn1.to_out.0.bias", "output_blocks.9.1.transformer_blocks.0.norm3.bias", "output_blocks.10.1.transformer_blocks.0.attn2.to_v.weight", "input_blocks.1.1.transformer_blocks.0.norm1.weight", "input_blocks.10.0.in_layers.2.weight", "output_blocks.10.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.10.0.in_layers.2.weight", "output_blocks.11.1.transformer_blocks.0.norm1.weight", "output_blocks.7.1.transformer_blocks.0.attn1.to_v.weight", "output_blocks.7.1.transformer_blocks.0.attn2.to_out.0.weight", "output_blocks.9.1.transformer_blocks.0.attn2.to_v.weight", "output_blocks.6.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.9.0.out_layers.3.weight", "output_blocks.11.0.emb_layers.1.bias", "output_blocks.7.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.7.1.proj_out.bias", "output_blocks.9.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.7.1.transformer_blocks.0.ff.net.2.weight", "output_blocks.7.1.transformer_blocks.0.norm1.weight", "output_blocks.2.1.conv.weight", "output_blocks.6.1.transformer_blocks.0.norm3.weight", "input_blocks.1.1.transformer_blocks.0.attn1.to_v.weight", "input_blocks.1.1.norm.weight", "output_blocks.9.0.out_layers.0.bias", "input_blocks.2.1.proj_out.bias", "output_blocks.10.1.norm.weight", "output_blocks.9.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.2.1.conv.bias", "output_blocks.7.1.transformer_blocks.0.norm3.bias", "output_blocks.11.1.proj_out.bias", "output_blocks.10.0.out_layers.0.bias", "output_blocks.8.1.transformer_blocks.0.attn2.to_out.0.weight", "input_blocks.11.0.in_layers.0.bias", "output_blocks.9.0.skip_connection.bias", "input_blocks.11.0.in_layers.0.weight", "output_blocks.7.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.7.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.7.1.transformer_blocks.0.attn2.to_v.weight", "output_blocks.8.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.11.1.transformer_blocks.0.norm3.bias", "output_blocks.10.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.6.1.transformer_blocks.0.norm3.bias", "output_blocks.7.1.transformer_blocks.0.norm2.bias", "input_blocks.1.1.proj_out.weight", "output_blocks.9.1.transformer_blocks.0.norm1.bias", "output_blocks.6.1.transformer_blocks.0.attn1.to_out.0.weight", "input_blocks.1.1.transformer_blocks.0.attn1.to_out.0.bias", "input_blocks.11.0.in_layers.2.bias", "output_blocks.11.0.skip_connection.bias", "output_blocks.11.1.proj_in.weight", "output_blocks.10.1.transformer_blocks.0.ff.net.2.weight", "input_blocks.2.1.proj_in.bias", "output_blocks.10.1.proj_in.bias", "output_blocks.8.2.conv.bias", "output_blocks.10.0.out_layers.3.weight", "output_blocks.8.1.norm.weight", "output_blocks.10.1.proj_out.bias", "output_blocks.8.1.proj_in.weight", "output_blocks.9.1.proj_in.weight", "input_blocks.10.0.out_layers.3.weight", "output_blocks.10.1.transformer_blocks.0.ff.net.0.proj.weight", "input_blocks.11.0.emb_layers.1.weight", "output_blocks.11.1.transformer_blocks.0.ff.net.2.weight", "output_blocks.8.1.transformer_blocks.0.attn2.to_k.weight", "input_blocks.2.1.transformer_blocks.0.attn2.to_v.weight", "output_blocks.11.1.transformer_blocks.0.attn2.to_v.weight", "output_blocks.6.1.proj_out.weight", "output_blocks.8.1.transformer_blocks.0.norm2.bias", "output_blocks.7.1.transformer_blocks.0.attn2.to_q.weight", "input_blocks.10.0.emb_layers.1.bias", "output_blocks.9.1.transformer_blocks.0.ff.net.0.proj.weight", "output_blocks.11.0.emb_layers.1.weight", "input_blocks.2.1.transformer_blocks.0.ff.net.0.proj.weight", "output_blocks.6.1.norm.weight", "input_blocks.1.1.norm.bias", "output_blocks.6.1.transformer_blocks.0.attn2.to_q.weight", "output_blocks.10.0.emb_layers.1.weight", "output_blocks.7.1.transformer_blocks.0.attn1.to_k.weight", "output_blocks.11.0.out_layers.3.weight", "input_blocks.11.0.in_layers.2.weight", "input_blocks.2.1.transformer_blocks.0.norm1.bias", "output_blocks.11.0.in_layers.2.bias", "output_blocks.6.1.transformer_blocks.0.ff.net.0.proj.weight", "input_blocks.1.1.transformer_blocks.0.norm2.bias", "output_blocks.11.0.out_layers.3.bias", "output_blocks.9.0.in_layers.2.weight", "output_blocks.10.0.emb_layers.1.bias", "input_blocks.2.1.transformer_blocks.0.attn1.to_v.weight", "input_blocks.1.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.9.1.proj_in.bias", "output_blocks.11.0.in_layers.0.bias", "output_blocks.10.0.skip_connection.weight", "output_blocks.11.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.8.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.8.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.10.1.transformer_blocks.0.norm2.weight", "input_blocks.2.1.transformer_blocks.0.norm2.bias", "input_blocks.2.1.proj_in.weight", "input_blocks.1.1.transformer_blocks.0.norm2.weight", "input_blocks.2.1.transformer_blocks.0.attn2.to_out.0.weight", "output_blocks.10.1.transformer_blocks.0.norm1.weight", "input_blocks.10.0.out_layers.0.bias", "output_blocks.10.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.10.0.in_layers.2.bias", "output_blocks.9.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.11.1.proj_in.bias", "output_blocks.6.1.norm.bias", "input_blocks.2.1.transformer_blocks.0.attn1.to_k.weight", "output_blocks.9.1.transformer_blocks.0.norm1.weight", "output_blocks.9.1.transformer_blocks.0.norm2.bias", "output_blocks.11.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.8.1.transformer_blocks.0.norm3.bias", "output_blocks.10.1.transformer_blocks.0.attn2.to_out.0.weight", "output_blocks.9.0.skip_connection.weight", "output_blocks.7.1.transformer_blocks.0.norm3.weight", "output_blocks.11.1.transformer_blocks.0.attn2.to_q.weight", "output_blocks.8.1.transformer_blocks.0.attn1.to_k.weight", "output_blocks.9.0.in_layers.2.bias", "output_blocks.10.1.transformer_blocks.0.norm1.bias", "output_blocks.11.1.norm.weight", "input_blocks.2.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.9.1.proj_out.weight", "output_blocks.10.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.9.0.in_layers.0.bias", "output_blocks.11.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.10.1.transformer_blocks.0.attn1.to_v.weight", "output_blocks.9.1.proj_out.bias", "output_blocks.6.1.transformer_blocks.0.attn2.to_v.weight", "output_blocks.6.1.proj_out.bias", "output_blocks.6.1.transformer_blocks.0.attn1.to_k.weight", "input_blocks.1.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.10.1.transformer_blocks.0.norm3.weight", "output_blocks.9.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.6.1.transformer_blocks.0.norm2.bias", "input_blocks.1.1.proj_in.bias", "output_blocks.8.1.proj_out.bias", "input_blocks.11.0.out_layers.3.bias", "input_blocks.1.1.proj_out.bias", "output_blocks.9.0.out_layers.0.weight", "output_blocks.8.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.9.0.emb_layers.1.weight", "output_blocks.11.1.transformer_blocks.0.norm3.weight", "output_blocks.6.1.proj_in.bias", "output_blocks.6.1.transformer_blocks.0.attn1.to_v.weight", "input_blocks.11.0.out_layers.3.weight", "output_blocks.8.1.transformer_blocks.0.attn2.to_q.weight", "input_blocks.2.1.transformer_blocks.0.norm1.weight", "input_blocks.2.1.transformer_blocks.0.norm2.weight", "output_blocks.10.1.proj_in.weight", "output_blocks.11.1.transformer_blocks.0.attn1.to_k.weight", "output_blocks.9.1.transformer_blocks.0.attn2.to_q.weight", "input_blocks.1.1.transformer_blocks.0.ff.net.2.bias", "input_blocks.1.1.transformer_blocks.0.attn2.to_out.0.weight", "output_blocks.7.1.norm.weight", "output_blocks.11.0.out_layers.0.bias", "output_blocks.8.1.transformer_blocks.0.attn1.to_v.weight", "output_blocks.9.1.norm.bias", "output_blocks.7.1.proj_in.bias", "output_blocks.9.0.emb_layers.1.bias", "input_blocks.9.0.op.bias", "input_blocks.11.0.emb_layers.1.bias", "output_blocks.11.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.7.1.transformer_blocks.0.ff.net.0.proj.weight", "output_blocks.9.1.transformer_blocks.0.attn2.to_out.0.weight", "input_blocks.1.1.transformer_blocks.0.attn2.to_q.weight", "output_blocks.10.0.out_layers.0.weight", "output_blocks.6.1.transformer_blocks.0.norm2.weight", "output_blocks.11.1.transformer_blocks.0.norm2.weight", "input_blocks.1.1.transformer_blocks.0.ff.net.0.proj.weight", "input_blocks.10.0.in_layers.0.bias", "output_blocks.6.1.transformer_blocks.0.attn1.to_q.weight", "input_blocks.10.0.out_layers.0.weight", "input_blocks.10.0.in_layers.2.bias", "output_blocks.7.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.11.0.out_layers.0.weight", "output_blocks.6.1.transformer_blocks.0.norm1.bias", "output_blocks.6.1.transformer_blocks.0.attn1.to_out.0.bias", "output_blocks.8.2.conv.weight", "input_blocks.2.1.transformer_blocks.0.attn1.to_out.0.weight", "input_blocks.9.0.op.weight", "output_blocks.11.1.transformer_blocks.0.attn1.to_out.0.bias", "output_blocks.10.1.norm.bias", "output_blocks.8.1.transformer_blocks.0.attn1.to_out.0.bias", "input_blocks.1.1.transformer_blocks.0.norm1.bias", "output_blocks.10.1.transformer_blocks.0.attn2.to_q.weight", "output_blocks.8.1.transformer_blocks.0.norm1.weight", "input_blocks.2.1.transformer_blocks.0.norm3.bias", "input_blocks.2.1.transformer_blocks.0.attn1.to_out.0.bias", "input_blocks.11.0.out_layers.0.bias", "input_blocks.1.1.transformer_blocks.0.ff.net.2.weight", "input_blocks.2.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.11.1.transformer_blocks.0.attn1.to_v.weight", "output_blocks.9.0.in_layers.0.weight", "output_blocks.9.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.10.0.out_layers.3.bias", "output_blocks.10.1.proj_out.weight", "output_blocks.10.0.skip_connection.bias", "input_blocks.1.1.transformer_blocks.0.norm3.weight", "output_blocks.10.0.in_layers.0.bias", "output_blocks.9.1.transformer_blocks.0.norm2.weight", "output_blocks.10.0.in_layers.0.weight", "output_blocks.7.1.transformer_blocks.0.norm1.bias", "output_blocks.9.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.7.1.transformer_blocks.0.norm2.weight", "output_blocks.7.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.11.1.transformer_blocks.0.norm1.bias", "output_blocks.8.1.transformer_blocks.0.norm2.weight", "output_blocks.11.0.in_layers.0.weight", "input_blocks.1.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.9.1.transformer_blocks.0.attn1.to_v.weight", "input_blocks.1.1.transformer_blocks.0.norm3.bias", "output_blocks.9.1.transformer_blocks.0.attn1.to_out.0.bias", "output_blocks.11.0.in_layers.2.weight", "output_blocks.11.1.norm.bias", "output_blocks.10.1.transformer_blocks.0.norm2.bias", "output_blocks.9.1.norm.weight", "output_blocks.6.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.10.1.transformer_blocks.0.norm3.bias", "output_blocks.10.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.9.1.transformer_blocks.0.ff.net.2.weight", "input_blocks.1.1.transformer_blocks.0.attn2.to_v.weight", "input_blocks.2.1.transformer_blocks.0.norm3.weight", "output_blocks.10.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.10.1.transformer_blocks.0.attn1.to_k.weight", "input_blocks.2.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.11.1.proj_out.weight", "input_blocks.2.1.norm.weight", "output_blocks.7.1.transformer_blocks.0.attn1.to_out.0.bias", "input_blocks.1.1.transformer_blocks.0.attn1.to_k.weight", "output_blocks.6.1.transformer_blocks.0.ff.net.2.weight", "input_blocks.2.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.11.1.transformer_blocks.0.norm2.bias", "input_blocks.2.1.proj_out.weight", "output_blocks.6.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.8.1.transformer_blocks.0.norm1.bias", "input_blocks.2.1.transformer_blocks.0.attn2.to_q.weight", "output_blocks.9.1.transformer_blocks.0.attn1.to_k.weight", "output_blocks.6.1.proj_in.weight", "output_blocks.7.1.norm.bias", "input_blocks.1.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.7.1.proj_out.weight", "output_blocks.11.1.transformer_blocks.0.ff.net.0.proj.weight", "input_blocks.2.1.transformer_blocks.0.ff.net.2.weight", "output_blocks.7.1.proj_in.weight", "input_blocks.10.0.in_layers.0.weight", "output_blocks.8.1.norm.bias", "output_blocks.11.0.skip_connection.weight", "output_blocks.6.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.8.1.proj_out.weight", "output_blocks.8.1.transformer_blocks.0.attn2.to_v.weight", "output_blocks.6.1.transformer_blocks.0.attn2.to_out.0.weight", "input_blocks.2.1.transformer_blocks.0.attn2.to_out.0.bias", "input_blocks.1.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.11.1.transformer_blocks.0.attn2.to_out.0.weight", "output_blocks.9.0.out_layers.3.bias", "output_blocks.8.1.transformer_blocks.0.norm3.weight", "output_blocks.8.1.transformer_blocks.0.ff.net.0.proj.weight", "output_blocks.8.1.transformer_blocks.0.ff.net.2.weight", "output_blocks.6.1.transformer_blocks.0.norm1.weight", "input_blocks.10.0.out_layers.3.bias".
Missing key(s) in state_dict: "output_blocks.2.1.transformer_blocks.5.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.8.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.5.ff.net.0.proj.bias", "output_blocks.3.1.transformer_blocks.1.norm1.weight", "output_blocks.2.1.transformer_blocks.7.norm2.bias", "input_blocks.5.1.transformer_blocks.1.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.9.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.9.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.5.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.8.ff.net.0.proj.weight", "middle_block.1.transformer_blocks.5.ff.net.2.weight", "middle_block.1.transformer_blocks.6.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.8.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.1.ff.net.0.proj.weight", "input_blocks.5.1.transformer_blocks.1.norm3.weight", "output_blocks.0.1.transformer_blocks.8.attn1.to_out.0.weight", "input_blocks.8.1.transformer_blocks.3.attn1.to_k.weight", "middle_block.1.transformer_blocks.6.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.7.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.9.attn2.to_out.0.weight", "input_blocks.7.1.transformer_blocks.3.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.3.norm2.bias", "input_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.9.norm1.bias", "output_blocks.5.1.transformer_blocks.1.attn2.to_v.weight", "middle_block.1.transformer_blocks.2.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.2.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.9.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.4.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.3.attn1.to_q.weight", "middle_block.1.transformer_blocks.4.ff.net.0.proj.weight", "output_blocks.4.1.transformer_blocks.1.attn2.to_v.weight", "input_blocks.8.1.transformer_blocks.6.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.7.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.0.attn2.to_v.weight", "middle_block.1.transformer_blocks.9.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.6.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.6.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.8.ff.net.0.proj.bias", "output_blocks.2.1.transformer_blocks.5.norm2.weight", "output_blocks.2.1.transformer_blocks.3.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.9.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.5.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.6.ff.net.2.weight", "input_blocks.7.1.transformer_blocks.5.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.1.attn2.to_out.0.weight", "output_blocks.4.1.transformer_blocks.1.norm1.bias", "output_blocks.0.1.transformer_blocks.3.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.5.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.5.norm1.bias", "label_emb.0.0.weight", "input_blocks.7.1.transformer_blocks.6.attn1.to_v.weight", "input_blocks.8.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.4.norm1.bias", "input_blocks.7.1.transformer_blocks.7.norm3.weight", "input_blocks.8.1.transformer_blocks.5.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.0.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.7.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.8.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.8.norm2.bias", "middle_block.1.transformer_blocks.1.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.4.norm1.bias", "input_blocks.7.1.transformer_blocks.4.norm3.bias", "input_blocks.8.1.transformer_blocks.4.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.7.ff.net.2.weight", "output_blocks.1.1.transformer_blocks.7.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.6.ff.net.0.proj.bias", "output_blocks.1.1.proj_out.bias", "output_blocks.0.1.transformer_blocks.7.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.8.attn2.to_out.0.bias", "input_blocks.7.1.transformer_blocks.9.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.3.norm2.bias", "input_blocks.8.1.transformer_blocks.6.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.2.norm1.weight", "output_blocks.0.1.transformer_blocks.4.norm3.bias", "output_blocks.1.1.transformer_blocks.3.norm3.weight", "output_blocks.3.1.transformer_blocks.1.attn1.to_q.weight", "middle_block.1.transformer_blocks.4.norm3.bias", "input_blocks.7.1.transformer_blocks.4.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.1.norm2.weight", "middle_block.1.transformer_blocks.1.ff.net.2.bias", "output_blocks.1.1.transformer_blocks.7.ff.net.0.proj.bias", "input_blocks.5.1.transformer_blocks.1.norm1.weight", "input_blocks.7.1.transformer_blocks.2.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.4.attn1.to_k.weight", "middle_block.1.transformer_blocks.7.norm3.weight", "output_blocks.3.1.transformer_blocks.1.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.2.attn2.to_v.weight", "middle_block.1.transformer_blocks.8.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.7.norm1.bias", "input_blocks.7.1.transformer_blocks.6.norm1.weight", "output_blocks.4.1.transformer_blocks.1.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.2.attn1.to_k.weight", "middle_block.1.transformer_blocks.4.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.5.norm1.bias", "output_blocks.2.1.transformer_blocks.4.attn1.to_v.weight", "output_blocks.0.1.transformer_blocks.7.norm3.bias", "output_blocks.1.1.transformer_blocks.9.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.0.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.4.attn1.to_v.weight", "input_blocks.8.1.transformer_blocks.2.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.8.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.3.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.7.attn1.to_out.0.weight", "input_blocks.8.1.transformer_blocks.2.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.9.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.7.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.6.norm3.bias", "input_blocks.7.1.transformer_blocks.8.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.4.attn1.to_out.0.weight", "input_blocks.8.1.transformer_blocks.3.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.2.norm3.weight", "input_blocks.7.1.transformer_blocks.1.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.8.norm2.weight", "output_blocks.2.1.transformer_blocks.4.norm2.weight", "middle_block.1.transformer_blocks.9.ff.net.2.weight", "input_blocks.7.1.transformer_blocks.5.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.3.norm3.bias", "output_blocks.2.1.transformer_blocks.7.norm2.weight", "input_blocks.5.1.transformer_blocks.1.norm2.bias", "middle_block.1.transformer_blocks.1.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.4.norm1.bias", "input_blocks.8.1.transformer_blocks.7.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.9.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.9.norm2.bias", "middle_block.1.transformer_blocks.7.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.9.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.4.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.8.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.3.norm3.bias", "output_blocks.0.1.transformer_blocks.4.ff.net.2.weight", "input_blocks.4.1.transformer_blocks.1.ff.net.2.weight", "output_blocks.1.1.transformer_blocks.4.norm2.bias", "output_blocks.1.1.transformer_blocks.2.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.9.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.8.attn1.to_out.0.weight", "input_blocks.8.1.transformer_blocks.3.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.9.ff.net.0.proj.bias", "input_blocks.5.1.transformer_blocks.1.attn2.to_v.weight", "output_blocks.2.1.transformer_blocks.1.norm1.bias", "input_blocks.8.1.transformer_blocks.5.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.6.attn2.to_out.0.weight", "input_blocks.7.1.transformer_blocks.9.norm3.weight", "input_blocks.4.1.transformer_blocks.1.norm2.bias", "middle_block.1.transformer_blocks.7.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.4.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.4.norm2.weight", "output_blocks.1.1.transformer_blocks.4.ff.net.2.bias", "output_blocks.1.1.transformer_blocks.3.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.3.attn1.to_out.0.weight", "output_blocks.1.1.transformer_blocks.1.norm3.weight", "input_blocks.7.1.transformer_blocks.9.norm2.weight", "output_blocks.1.1.transformer_blocks.7.norm2.bias", "input_blocks.8.1.transformer_blocks.9.norm1.bias", "output_blocks.1.1.transformer_blocks.6.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.1.attn1.to_out.0.bias", "output_blocks.4.1.transformer_blocks.1.norm3.weight", "input_blocks.8.1.transformer_blocks.9.norm2.bias", "input_blocks.7.1.transformer_blocks.3.norm1.weight", "input_blocks.7.1.transformer_blocks.3.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.2.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.8.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.5.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.5.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.0.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.1.norm3.bias", "input_blocks.8.1.transformer_blocks.3.norm3.weight", "input_blocks.8.1.transformer_blocks.6.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.4.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.1.norm2.bias", "output_blocks.1.1.transformer_blocks.4.attn2.to_k.weight", "label_emb.0.2.bias", "middle_block.1.transformer_blocks.9.norm2.weight", "input_blocks.7.1.transformer_blocks.5.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.4.norm3.weight", "input_blocks.5.1.transformer_blocks.1.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.8.attn2.to_v.weight", "output_blocks.3.1.transformer_blocks.1.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.1.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.2.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.1.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.0.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.8.attn2.to_q.weight", "input_blocks.4.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.2.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.8.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.6.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.6.attn2.to_v.weight", "output_blocks.5.1.transformer_blocks.1.norm2.bias", "output_blocks.1.1.transformer_blocks.4.attn1.to_v.weight", "middle_block.1.transformer_blocks.3.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.8.norm1.bias", "middle_block.1.transformer_blocks.3.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.2.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.4.attn2.to_k.weight", "middle_block.1.transformer_blocks.6.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.3.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.2.norm1.weight", "output_blocks.1.1.transformer_blocks.6.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.6.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.3.norm1.bias", "input_blocks.7.1.transformer_blocks.7.norm2.weight", "input_blocks.8.1.transformer_blocks.9.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.3.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.1.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.8.norm2.weight", "output_blocks.2.1.transformer_blocks.3.norm3.bias", "output_blocks.1.1.transformer_blocks.4.attn1.to_q.weight", "middle_block.1.transformer_blocks.5.ff.net.2.bias", "output_blocks.5.1.transformer_blocks.1.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.2.norm2.weight", "input_blocks.8.1.transformer_blocks.3.norm1.bias", "output_blocks.1.1.transformer_blocks.3.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.4.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.3.attn1.to_v.weight", "output_blocks.0.1.transformer_blocks.4.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.7.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.2.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.1.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.1.attn2.to_q.weight", "middle_block.1.transformer_blocks.4.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.0.norm1.weight", "output_blocks.2.1.transformer_blocks.0.norm3.bias", "input_blocks.8.1.transformer_blocks.7.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.9.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.8.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.5.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.7.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.4.attn2.to_v.weight", "output_blocks.2.1.transformer_blocks.7.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.6.norm3.bias", "input_blocks.8.1.transformer_blocks.1.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.2.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.0.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.7.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.3.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.7.norm2.bias", "output_blocks.1.1.transformer_blocks.4.attn2.to_v.weight", "input_blocks.8.1.transformer_blocks.9.norm1.weight", "middle_block.1.transformer_blocks.1.norm2.weight", "input_blocks.7.1.transformer_blocks.8.norm3.bias", "input_blocks.8.1.transformer_blocks.7.norm2.weight", "output_blocks.0.1.transformer_blocks.2.attn1.to_k.weight", "input_blocks.4.1.transformer_blocks.1.norm1.bias", "input_blocks.7.1.transformer_blocks.6.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.2.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.3.norm3.bias", "input_blocks.7.1.transformer_blocks.2.ff.net.0.proj.weight", "output_blocks.5.1.transformer_blocks.1.norm3.weight", "output_blocks.0.1.transformer_blocks.9.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.9.attn1.to_k.weight", "middle_block.1.transformer_blocks.8.attn2.to_q.weight", "output_blocks.3.1.transformer_blocks.1.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.8.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.7.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.3.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.8.norm2.bias", "output_blocks.0.1.transformer_blocks.3.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.2.norm2.bias", "input_blocks.7.1.transformer_blocks.7.attn1.to_out.0.weight", "input_blocks.4.1.transformer_blocks.1.norm3.bias", "output_blocks.0.1.transformer_blocks.7.ff.net.2.bias", "input_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight", "input_blocks.7.1.transformer_blocks.8.norm3.weight", "input_blocks.4.1.transformer_blocks.1.norm2.weight", "output_blocks.1.1.transformer_blocks.0.norm1.bias", "input_blocks.7.1.transformer_blocks.5.attn1.to_k.weight", "output_blocks.2.1.transformer_blocks.8.norm2.weight", "output_blocks.0.1.transformer_blocks.3.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.5.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.7.attn1.to_out.0.weight", "output_blocks.1.1.transformer_blocks.6.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.1.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.5.norm2.weight", "input_blocks.8.1.transformer_blocks.4.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.3.norm1.bias", "output_blocks.2.1.transformer_blocks.4.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.1.ff.net.2.bias", "output_blocks.3.1.transformer_blocks.1.norm2.bias", "middle_block.1.transformer_blocks.3.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.1.norm3.bias", "input_blocks.7.1.transformer_blocks.5.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.3.norm3.weight", "output_blocks.4.1.transformer_blocks.1.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.7.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.5.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.4.attn2.to_q.weight", "middle_block.1.transformer_blocks.2.attn1.to_v.weight", "output_blocks.0.1.transformer_blocks.0.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.2.ff.net.2.bias", "output_blocks.1.1.transformer_blocks.0.norm2.weight", "input_blocks.8.1.transformer_blocks.6.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.6.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.1.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.8.norm3.weight", "input_blocks.8.1.transformer_blocks.3.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.8.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.5.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.0.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.4.ff.net.2.bias", "output_blocks.3.1.transformer_blocks.1.ff.net.2.weight", "input_blocks.4.1.transformer_blocks.1.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.4.norm2.bias", "output_blocks.0.1.transformer_blocks.8.ff.net.0.proj.bias", "output_blocks.2.1.transformer_blocks.8.ff.net.0.proj.weight", "input_blocks.7.1.transformer_blocks.2.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.5.norm2.bias", "input_blocks.7.1.transformer_blocks.4.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.9.attn2.to_q.weight", "input_blocks.8.1.transformer_blocks.9.norm3.weight", "middle_block.1.transformer_blocks.1.norm3.bias", "output_blocks.5.1.transformer_blocks.1.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.1.norm2.weight", "input_blocks.7.1.transformer_blocks.1.attn1.to_out.0.bias", "middle_block.1.transformer_blocks.7.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.7.norm2.weight", "output_blocks.2.1.transformer_blocks.0.norm1.weight", "output_blocks.0.1.transformer_blocks.5.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.2.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.9.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.6.norm3.weight", "output_blocks.1.1.transformer_blocks.8.norm1.bias", "output_blocks.0.1.norm.weight", "input_blocks.7.1.transformer_blocks.3.attn1.to_q.weight", "middle_block.1.transformer_blocks.4.attn2.to_out.0.bias", "output_blocks.1.1.proj_in.weight", "input_blocks.8.1.transformer_blocks.8.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.3.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.1.ff.net.0.proj.bias", "output_blocks.2.1.transformer_blocks.0.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.4.norm3.weight", "input_blocks.8.1.transformer_blocks.9.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.9.norm2.weight", "input_blocks.8.1.transformer_blocks.9.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.0.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.4.norm1.weight", "output_blocks.0.1.transformer_blocks.7.norm3.weight", "output_blocks.2.1.transformer_blocks.2.ff.net.2.weight", "middle_block.1.transformer_blocks.4.ff.net.2.bias", "middle_block.1.transformer_blocks.4.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.3.norm3.weight", "input_blocks.8.1.transformer_blocks.2.norm1.bias", "output_blocks.2.1.transformer_blocks.4.norm3.weight", "input_blocks.8.1.transformer_blocks.7.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.2.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.6.attn2.to_v.weight", "middle_block.1.transformer_blocks.9.ff.net.0.proj.bias", "input_blocks.5.1.transformer_blocks.1.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.2.attn1.to_out.0.weight", "output_blocks.3.1.transformer_blocks.1.attn2.to_v.weight", "middle_block.1.transformer_blocks.7.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.9.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.4.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.5.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.8.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.4.ff.net.2.weight", "input_blocks.4.1.transformer_blocks.1.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.6.norm1.weight", "middle_block.1.transformer_blocks.8.norm1.weight", "output_blocks.0.1.transformer_blocks.8.norm2.weight", "output_blocks.0.1.proj_out.weight", "middle_block.1.transformer_blocks.6.ff.net.2.weight", "output_blocks.1.1.transformer_blocks.2.norm2.weight", "output_blocks.1.1.transformer_blocks.6.norm3.bias", "output_blocks.1.1.transformer_blocks.1.norm2.weight", "input_blocks.7.1.transformer_blocks.6.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.1.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.3.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.2.norm1.weight", "output_blocks.0.1.transformer_blocks.0.attn1.to_k.weight", "output_blocks.2.1.transformer_blocks.7.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.6.norm3.weight", "output_blocks.3.1.transformer_blocks.1.ff.net.0.proj.bias", "middle_block.1.transformer_blocks.1.norm1.bias", "output_blocks.1.1.transformer_blocks.8.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.3.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.5.norm3.bias", "output_blocks.1.1.transformer_blocks.7.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.3.ff.net.2.bias", "output_blocks.0.1.proj_in.weight", "output_blocks.1.1.transformer_blocks.3.norm2.bias", "output_blocks.2.1.transformer_blocks.8.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.1.1.transformer_blocks.5.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.2.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.6.ff.net.2.weight", "output_blocks.4.1.transformer_blocks.1.attn1.to_out.0.bias", "output_blocks.2.2.conv.bias", "output_blocks.1.1.transformer_blocks.3.norm2.weight", "output_blocks.0.1.transformer_blocks.9.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.9.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.0.norm1.bias", "output_blocks.1.1.transformer_blocks.6.attn1.to_k.weight", "output_blocks.4.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.0.1.transformer_blocks.6.norm2.bias", "output_blocks.1.1.transformer_blocks.0.norm2.bias", "input_blocks.7.1.transformer_blocks.8.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.7.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.9.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.7.attn1.to_v.weight", "middle_block.1.transformer_blocks.2.norm2.weight", "output_blocks.1.1.transformer_blocks.1.norm2.bias", "middle_block.1.transformer_blocks.3.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.1.attn1.to_k.weight", "middle_block.1.transformer_blocks.8.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.2.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.6.attn1.to_out.0.bias", "input_blocks.4.1.transformer_blocks.1.norm1.weight", "input_blocks.4.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.4.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.5.attn2.to_v.weight", "output_blocks.2.1.transformer_blocks.7.attn1.to_v.weight", "middle_block.1.transformer_blocks.5.attn2.to_q.weight", "input_blocks.8.1.transformer_blocks.3.norm1.weight", "output_blocks.1.1.transformer_blocks.8.norm2.bias", "input_blocks.8.1.transformer_blocks.1.norm2.weight", "input_blocks.8.1.transformer_blocks.9.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.1.norm2.weight", "middle_block.1.transformer_blocks.2.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.6.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.6.norm3.weight", "output_blocks.1.1.transformer_blocks.6.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.6.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.1.norm3.weight", "middle_block.1.transformer_blocks.5.norm3.weight", "output_blocks.1.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.5.norm1.weight", "input_blocks.7.1.transformer_blocks.9.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.9.norm3.weight", "output_blocks.1.1.transformer_blocks.8.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.2.ff.net.0.proj.bias", "middle_block.1.transformer_blocks.6.ff.net.0.proj.weight", "input_blocks.7.1.transformer_blocks.7.attn1.to_v.weight", "output_blocks.4.1.transformer_blocks.1.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.8.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.5.attn1.to_k.weight", "input_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight", "output_blocks.4.1.transformer_blocks.1.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.2.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.9.ff.net.0.proj.weight", "middle_block.1.transformer_blocks.9.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.6.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.2.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.1.norm3.weight", "middle_block.1.transformer_blocks.4.norm2.weight", "output_blocks.0.1.transformer_blocks.3.attn1.to_k.weight", "output_blocks.2.1.transformer_blocks.6.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.0.ff.net.0.proj.weight", "middle_block.1.transformer_blocks.7.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.6.attn2.to_k.weight", "middle_block.1.transformer_blocks.7.norm3.bias", "output_blocks.1.1.transformer_blocks.5.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.8.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.3.norm3.weight", "output_blocks.2.1.transformer_blocks.1.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.1.norm2.bias", "input_blocks.8.1.transformer_blocks.4.norm1.weight", "middle_block.1.transformer_blocks.5.norm2.bias", "input_blocks.4.1.transformer_blocks.1.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.7.ff.net.2.weight", "middle_block.1.transformer_blocks.9.norm3.weight", "middle_block.1.transformer_blocks.2.norm3.bias", "middle_block.1.transformer_blocks.1.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.3.norm2.weight", "output_blocks.0.1.transformer_blocks.3.norm2.bias", "output_blocks.2.1.transformer_blocks.9.norm2.weight", "output_blocks.3.1.transformer_blocks.1.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.2.norm3.bias", "output_blocks.1.1.transformer_blocks.9.norm1.bias", "output_blocks.0.1.transformer_blocks.3.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.1.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.5.norm2.bias", "output_blocks.0.1.transformer_blocks.6.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.0.norm2.bias", "output_blocks.1.1.transformer_blocks.0.norm3.weight", "output_blocks.2.1.transformer_blocks.7.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.3.attn2.to_q.weight", "input_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.2.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.5.norm3.bias", "output_blocks.1.1.transformer_blocks.5.attn2.to_v.weight", "input_blocks.8.1.transformer_blocks.4.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.8.norm1.weight", "input_blocks.7.1.transformer_blocks.5.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.9.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.4.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.6.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.9.attn1.to_v.weight", "output_blocks.2.1.proj_in.bias", "output_blocks.4.1.transformer_blocks.1.norm3.bias", "output_blocks.0.1.transformer_blocks.8.norm1.weight", "input_blocks.8.1.transformer_blocks.6.norm2.weight", "input_blocks.7.1.transformer_blocks.3.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.9.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.7.norm3.bias", "middle_block.1.transformer_blocks.2.ff.net.2.weight", "input_blocks.7.1.transformer_blocks.7.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.9.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.3.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.5.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.2.norm2.weight", "output_blocks.2.1.transformer_blocks.8.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.7.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.8.norm3.bias", "input_blocks.7.1.transformer_blocks.3.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.2.attn2.to_v.weight", "middle_block.1.transformer_blocks.6.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.8.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.8.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.0.norm3.bias", "output_blocks.2.1.transformer_blocks.7.norm3.weight", "middle_block.1.transformer_blocks.9.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.7.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.1.norm1.weight", "middle_block.1.transformer_blocks.2.attn2.to_k.weight", "middle_block.1.transformer_blocks.7.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.0.ff.net.0.proj.bias", "middle_block.1.transformer_blocks.9.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.2.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.7.norm1.weight", "input_blocks.8.1.transformer_blocks.5.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.6.ff.net.0.proj.weight", "input_blocks.7.1.transformer_blocks.2.norm2.bias", "middle_block.1.transformer_blocks.7.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.1.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.9.norm2.bias", "output_blocks.2.1.transformer_blocks.5.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.6.norm3.bias", "output_blocks.2.1.transformer_blocks.9.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.6.norm1.bias", "middle_block.1.transformer_blocks.4.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.8.ff.net.2.weight", "middle_block.1.transformer_blocks.6.norm1.bias", "output_blocks.0.1.transformer_blocks.5.norm1.bias", "output_blocks.0.1.transformer_blocks.2.norm2.bias", "output_blocks.4.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.5.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.6.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.4.norm2.bias", "middle_block.1.transformer_blocks.8.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.2.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.2.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.4.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.9.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.9.attn2.to_v.weight", "input_blocks.4.1.transformer_blocks.1.attn2.to_k.weight", "output_blocks.0.1.proj_out.bias", "output_blocks.0.1.transformer_blocks.0.attn1.to_v.weight", "middle_block.1.transformer_blocks.5.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.8.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.6.norm2.weight", "output_blocks.1.1.norm.weight", "output_blocks.0.1.transformer_blocks.1.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.5.norm1.weight", "middle_block.1.transformer_blocks.6.norm1.weight", "input_blocks.8.1.transformer_blocks.9.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.9.norm3.weight", "output_blocks.1.1.transformer_blocks.9.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.9.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.2.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.0.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.1.attn2.to_q.weight", "middle_block.1.transformer_blocks.4.attn2.to_v.weight", "input_blocks.8.1.transformer_blocks.5.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.4.attn1.to_out.0.weight", "output_blocks.2.2.conv.weight", "output_blocks.2.1.transformer_blocks.2.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.6.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.3.norm2.weight", "output_blocks.1.1.transformer_blocks.5.attn1.to_v.weight", "output_blocks.0.1.transformer_blocks.9.norm3.bias", "middle_block.1.transformer_blocks.3.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.4.norm3.weight", "output_blocks.1.1.transformer_blocks.6.norm1.weight", "input_blocks.8.1.transformer_blocks.8.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.7.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.1.attn2.to_k.weight", "middle_block.1.transformer_blocks.4.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.8.norm3.bias", "input_blocks.7.1.transformer_blocks.4.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.0.norm2.bias", "middle_block.1.transformer_blocks.2.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.9.norm1.bias", "output_blocks.1.1.transformer_blocks.1.norm1.weight", "output_blocks.0.1.transformer_blocks.8.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.2.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.1.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.2.norm3.bias", "output_blocks.0.1.transformer_blocks.5.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.8.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.3.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.4.norm2.weight", "label_emb.0.0.bias", "output_blocks.1.1.transformer_blocks.4.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.9.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.8.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.1.attn1.to_out.0.weight", "output_blocks.1.1.transformer_blocks.3.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.5.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.2.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.3.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.4.ff.net.0.proj.weight", "output_blocks.1.1.proj_in.bias", "input_blocks.8.1.transformer_blocks.9.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.3.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.2.norm3.weight", "input_blocks.7.1.transformer_blocks.9.norm1.weight", "output_blocks.1.1.transformer_blocks.9.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.9.norm3.bias", "middle_block.1.transformer_blocks.3.norm3.bias", "middle_block.1.transformer_blocks.8.norm3.bias", "output_blocks.1.1.transformer_blocks.4.norm3.bias", "middle_block.1.transformer_blocks.8.norm1.bias", "output_blocks.1.1.transformer_blocks.4.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.2.norm3.weight", "output_blocks.2.1.proj_out.bias", "input_blocks.7.1.transformer_blocks.5.attn2.to_out.0.weight", "output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.3.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.6.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.3.attn2.to_out.0.weight", "input_blocks.7.1.transformer_blocks.7.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.3.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.2.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.2.attn1.to_k.weight", "output_blocks.3.1.transformer_blocks.1.norm3.weight", "middle_block.1.transformer_blocks.6.norm3.weight", "input_blocks.7.1.transformer_blocks.4.ff.net.0.proj.weight", "input_blocks.7.1.transformer_blocks.4.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.4.attn1.to_q.weight", "middle_block.1.transformer_blocks.5.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.0.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.5.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.9.attn2.to_v.weight", "input_blocks.8.1.transformer_blocks.4.norm2.bias", "output_blocks.0.1.transformer_blocks.5.norm3.bias", "output_blocks.1.1.transformer_blocks.7.norm3.weight", "output_blocks.2.1.transformer_blocks.2.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.5.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.3.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.5.norm2.bias", "output_blocks.2.1.transformer_blocks.8.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.3.attn1.to_k.weight", "input_blocks.5.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.3.ff.net.2.bias", "label_emb.0.2.weight", "output_blocks.1.1.transformer_blocks.5.norm1.weight", "output_blocks.1.1.transformer_blocks.4.norm1.weight", "output_blocks.1.1.transformer_blocks.8.norm1.weight", "input_blocks.8.1.transformer_blocks.4.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.9.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.4.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.6.attn1.to_q.weight", "middle_block.1.transformer_blocks.7.norm1.weight", "output_blocks.0.1.norm.bias", "input_blocks.5.1.transformer_blocks.1.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.5.norm2.bias", "input_blocks.8.1.transformer_blocks.1.norm1.weight", "output_blocks.2.1.transformer_blocks.1.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.5.attn1.to_k.weight", "input_blocks.5.1.transformer_blocks.1.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.1.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.7.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.2.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.8.norm2.weight", "input_blocks.7.1.transformer_blocks.9.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.3.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.5.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.7.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.7.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.7.norm3.bias", "output_blocks.2.1.transformer_blocks.7.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.3.attn1.to_q.weight", "middle_block.1.transformer_blocks.1.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.9.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.2.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.7.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.2.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.7.norm3.bias", "middle_block.1.transformer_blocks.7.attn2.to_out.0.weight", "input_blocks.7.1.transformer_blocks.9.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.3.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.2.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.9.attn2.to_v.weight", "input_blocks.5.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.2.attn1.to_out.0.bias", "output_blocks.3.1.transformer_blocks.1.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.4.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.5.ff.net.0.proj.bias", "output_blocks.2.1.transformer_blocks.4.attn1.to_out.0.bias", "middle_block.1.transformer_blocks.4.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.5.norm2.bias", "input_blocks.7.1.transformer_blocks.5.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.6.attn2.to_q.weight", "middle_block.1.transformer_blocks.3.norm1.bias", "input_blocks.8.1.transformer_blocks.1.attn2.to_v.weight", "input_blocks.8.1.transformer_blocks.6.attn1.to_k.weight", "middle_block.1.transformer_blocks.8.norm2.bias", "output_blocks.2.1.transformer_blocks.6.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.4.norm3.weight", "output_blocks.2.1.transformer_blocks.8.norm2.bias", "input_blocks.7.1.transformer_blocks.9.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.1.attn2.to_k.weight", "middle_block.1.transformer_blocks.5.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.0.norm1.bias", "input_blocks.8.1.transformer_blocks.8.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.9.ff.net.2.bias", "output_blocks.1.1.transformer_blocks.8.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.4.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.7.norm1.weight", "output_blocks.2.1.transformer_blocks.4.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.8.attn1.to_k.weight", "middle_block.1.transformer_blocks.1.norm2.bias", "input_blocks.7.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.0.norm2.weight", "input_blocks.8.1.transformer_blocks.5.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.1.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.9.norm3.bias", "output_blocks.1.1.transformer_blocks.9.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.1.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.8.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.6.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.3.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.2.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.1.norm3.weight", "middle_block.1.transformer_blocks.4.attn2.to_out.0.weight", "output_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.2.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.3.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.5.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.1.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.3.norm1.bias", "output_blocks.1.1.transformer_blocks.8.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.3.attn2.to_v.weight", "output_blocks.5.1.transformer_blocks.1.norm2.weight", "output_blocks.0.1.transformer_blocks.6.norm3.bias", "input_blocks.8.1.transformer_blocks.1.attn2.to_out.0.weight", "output_blocks.2.1.proj_out.weight", "output_blocks.2.1.transformer_blocks.6.attn1.to_k.weight", "output_blocks.2.1.transformer_blocks.7.norm3.bias", "output_blocks.1.1.transformer_blocks.8.attn2.to_k.weight", "output_blocks.5.1.transformer_blocks.1.norm1.weight", "output_blocks.1.1.transformer_blocks.2.norm3.bias", "output_blocks.2.1.transformer_blocks.5.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.2.norm1.bias", "middle_block.1.transformer_blocks.9.norm2.bias", "output_blocks.0.1.transformer_blocks.1.norm1.bias", "output_blocks.1.1.transformer_blocks.8.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.2.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.6.ff.net.0.proj.bias", "output_blocks.2.1.transformer_blocks.9.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.2.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.6.norm2.weight", "middle_block.1.transformer_blocks.2.attn2.to_out.0.weight", "output_blocks.5.1.transformer_blocks.1.norm1.bias", "output_blocks.0.1.transformer_blocks.4.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.9.norm2.weight", "output_blocks.2.1.transformer_blocks.8.norm1.bias", "input_blocks.7.1.transformer_blocks.5.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.2.norm2.weight", "output_blocks.1.1.transformer_blocks.6.norm1.bias", "output_blocks.0.1.proj_in.bias", "input_blocks.7.1.transformer_blocks.6.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.9.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.4.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.5.norm3.weight", "input_blocks.8.1.transformer_blocks.6.norm1.bias", "output_blocks.2.1.transformer_blocks.6.ff.net.2.weight", "input_blocks.7.1.transformer_blocks.8.ff.net.2.bias", "middle_block.1.transformer_blocks.2.norm1.bias", "middle_block.1.transformer_blocks.2.norm1.weight", "output_blocks.2.1.transformer_blocks.2.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.4.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.5.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.4.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.8.norm3.bias", "output_blocks.2.1.transformer_blocks.0.attn1.to_out.0.weight", "input_blocks.8.1.transformer_blocks.5.attn2.to_v.weight", "middle_block.1.transformer_blocks.8.norm3.weight", "middle_block.1.transformer_blocks.1.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.6.norm1.bias", "input_blocks.8.1.transformer_blocks.3.ff.net.2.weight", "output_blocks.1.1.transformer_blocks.1.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.1.attn1.to_out.0.bias", "middle_block.1.transformer_blocks.5.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.9.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.0.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.2.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.6.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.4.ff.net.2.bias", "output_blocks.1.1.transformer_blocks.2.norm2.bias", "input_blocks.8.1.transformer_blocks.8.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.7.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.6.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.1.norm3.bias", "middle_block.1.transformer_blocks.7.norm1.bias", "input_blocks.8.1.transformer_blocks.7.attn2.to_k.weight", "output_blocks.5.1.transformer_blocks.1.attn2.to_k.weight", "input_blocks.5.1.transformer_blocks.1.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.8.norm3.weight", "output_blocks.1.1.transformer_blocks.5.norm2.weight", "output_blocks.2.1.transformer_blocks.8.norm1.weight", "input_blocks.8.1.transformer_blocks.4.norm3.bias", "output_blocks.0.1.transformer_blocks.5.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.0.norm1.weight", "output_blocks.4.1.transformer_blocks.1.norm2.bias", "output_blocks.1.1.transformer_blocks.3.ff.net.2.weight", "output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight", "output_blocks.2.1.norm.bias", "middle_block.1.transformer_blocks.2.ff.net.2.bias", "input_blocks.7.1.transformer_blocks.2.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.6.norm2.bias", "middle_block.1.transformer_blocks.1.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.5.norm2.weight", "output_blocks.1.1.transformer_blocks.6.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.4.norm3.weight", "output_blocks.1.1.transformer_blocks.1.ff.net.0.proj.bias", "output_blocks.2.1.transformer_blocks.2.attn1.to_out.0.weight", "output_blocks.3.1.transformer_blocks.1.ff.net.2.bias", "middle_block.1.transformer_blocks.7.norm2.weight", "output_blocks.1.1.transformer_blocks.5.attn1.to_out.0.bias", "middle_block.1.transformer_blocks.3.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.1.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.5.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.3.attn2.to_out.0.bias", "input_blocks.7.1.transformer_blocks.4.attn2.to_q.weight", "input_blocks.8.1.transformer_blocks.3.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.1.norm1.bias", "output_blocks.1.1.transformer_blocks.7.attn2.to_v.weight", "middle_block.1.transformer_blocks.1.attn1.to_out.0.weight", "output_blocks.1.1.transformer_blocks.0.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.6.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.5.norm1.weight", "input_blocks.8.1.transformer_blocks.3.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.7.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.2.ff.net.2.weight", "output_blocks.1.1.transformer_blocks.6.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.5.attn1.to_out.0.weight", "output_blocks.2.1.proj_in.weight", "middle_block.1.transformer_blocks.2.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.0.norm3.weight", "output_blocks.0.1.transformer_blocks.7.attn1.to_q.weight", "output_blocks.3.1.transformer_blocks.1.norm3.bias", "output_blocks.2.1.transformer_blocks.1.norm1.weight", "output_blocks.0.1.transformer_blocks.9.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.2.norm3.bias", "output_blocks.2.1.transformer_blocks.9.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.7.norm3.weight", "output_blocks.2.1.transformer_blocks.8.norm3.weight", "middle_block.1.transformer_blocks.4.norm1.bias", "middle_block.1.transformer_blocks.6.attn2.to_k.weight", "output_blocks.2.1.transformer_blocks.7.norm1.bias", "input_blocks.7.1.transformer_blocks.1.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.1.ff.net.2.bias", "middle_block.1.transformer_blocks.6.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.2.ff.net.2.bias", "middle_block.1.transformer_blocks.9.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.7.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.9.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.1.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.8.norm1.weight", "output_blocks.1.1.transformer_blocks.0.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.0.ff.net.2.weight", "output_blocks.3.1.transformer_blocks.1.attn1.to_v.weight", "input_blocks.8.1.transformer_blocks.1.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.2.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.7.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.1.attn1.to_k.weight", "output_blocks.3.1.transformer_blocks.1.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.9.ff.net.0.proj.weight", "output_blocks.5.1.transformer_blocks.1.norm3.bias", "middle_block.1.transformer_blocks.6.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.2.attn2.to_v.weight", "middle_block.1.transformer_blocks.7.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.0.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.6.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.2.norm1.weight", "input_blocks.8.1.transformer_blocks.6.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.1.attn2.to_out.0.bias", "input_blocks.7.1.transformer_blocks.6.norm3.bias", "output_blocks.4.1.transformer_blocks.1.attn1.to_k.weight", "input_blocks.5.1.transformer_blocks.1.norm2.weight", "output_blocks.0.1.transformer_blocks.3.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.8.ff.net.0.proj.weight", "input_blocks.7.1.transformer_blocks.4.ff.net.2.weight", "output_blocks.1.1.proj_out.weight", "middle_block.1.transformer_blocks.1.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.5.norm1.weight", "output_blocks.2.1.transformer_blocks.1.norm3.bias", "input_blocks.7.1.transformer_blocks.4.norm2.weight", "output_blocks.1.1.transformer_blocks.0.attn2.to_q.weight", "input_blocks.8.1.transformer_blocks.2.norm3.weight", "output_blocks.2.1.transformer_blocks.5.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.6.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.7.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.0.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.9.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.3.norm2.weight", "output_blocks.0.1.transformer_blocks.2.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.0.ff.net.2.weight", "middle_block.1.transformer_blocks.7.attn2.to_out.0.bias", "input_blocks.7.1.transformer_blocks.7.ff.net.2.bias", "middle_block.1.transformer_blocks.4.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.3.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.9.norm2.weight", "input_blocks.7.1.transformer_blocks.2.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.0.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.1.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.3.norm1.weight", "input_blocks.7.1.transformer_blocks.5.norm3.weight", "input_blocks.7.1.transformer_blocks.1.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.6.attn1.to_out.0.bias", "output_blocks.3.1.transformer_blocks.1.norm2.weight", "input_blocks.8.1.transformer_blocks.2.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.2.norm1.bias", "input_blocks.8.1.transformer_blocks.2.norm2.weight", "input_blocks.8.1.transformer_blocks.4.ff.net.0.proj.bias", "middle_block.1.transformer_blocks.9.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.9.ff.net.2.bias", "output_blocks.1.1.transformer_blocks.7.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.1.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.1.norm1.bias", "output_blocks.2.1.norm.weight", "output_blocks.5.1.transformer_blocks.1.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.1.norm3.weight", "output_blocks.0.1.transformer_blocks.1.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.9.norm2.bias", "output_blocks.2.1.transformer_blocks.7.attn1.to_q.weight", "input_blocks.8.1.transformer_blocks.5.norm3.bias", "input_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.7.attn2.to_q.weight", "middle_block.1.transformer_blocks.9.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.2.attn2.to_k.weight", "middle_block.1.transformer_blocks.6.attn1.to_v.weight", "middle_block.1.transformer_blocks.3.attn2.to_v.weight", "middle_block.1.transformer_blocks.4.ff.net.0.proj.bias", "middle_block.1.transformer_blocks.3.norm3.weight", "output_blocks.1.1.transformer_blocks.9.norm1.weight", "middle_block.1.transformer_blocks.9.ff.net.0.proj.weight", "output_blocks.5.1.transformer_blocks.1.attn1.to_q.weight", "middle_block.1.transformer_blocks.5.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.3.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.6.norm2.weight", "output_blocks.2.1.transformer_blocks.4.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.8.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.2.norm1.bias", "output_blocks.0.1.transformer_blocks.6.attn1.to_out.0.bias", "middle_block.1.transformer_blocks.5.norm3.bias", "output_blocks.2.1.transformer_blocks.4.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.0.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.3.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.4.attn1.to_v.weight", "output_blocks.0.1.transformer_blocks.3.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.5.norm1.weight", "output_blocks.1.1.transformer_blocks.1.norm3.bias", "input_blocks.7.1.transformer_blocks.8.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.0.norm2.weight", "output_blocks.1.1.transformer_blocks.5.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.6.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.1.norm1.weight", "input_blocks.7.1.transformer_blocks.9.norm3.bias", "input_blocks.8.1.transformer_blocks.9.ff.net.0.proj.bias", "output_blocks.1.1.transformer_blocks.4.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.5.norm3.bias", "output_blocks.2.1.transformer_blocks.5.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.7.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.5.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.5.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.1.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.9.attn2.to_out.0.bias", "input_blocks.7.1.transformer_blocks.7.ff.net.0.proj.weight", "middle_block.1.transformer_blocks.3.attn1.to_k.weight", "output_blocks.2.1.transformer_blocks.4.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.3.attn1.to_q.weight", "output_blocks.2.1.transformer_blocks.1.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.7.attn2.to_q.weight", "output_blocks.2.1.transformer_blocks.3.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.8.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.4.norm2.bias", "output_blocks.0.1.transformer_blocks.1.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.4.norm1.weight", "input_blocks.7.1.transformer_blocks.2.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.0.ff.net.2.bias", "middle_block.1.transformer_blocks.8.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.4.ff.net.0.proj.weight", "input_blocks.4.1.transformer_blocks.1.norm3.weight", "output_blocks.0.1.transformer_blocks.0.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.5.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.3.1.transformer_blocks.1.norm1.bias", "input_blocks.7.1.transformer_blocks.8.attn1.to_v.weight", "input_blocks.7.1.transformer_blocks.1.ff.net.0.proj.weight", "middle_block.1.transformer_blocks.3.norm1.weight", "output_blocks.0.1.transformer_blocks.5.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.8.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.6.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.9.ff.net.2.weight", "output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.5.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.9.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.0.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.7.attn1.to_k.weight", "output_blocks.2.1.transformer_blocks.6.norm1.weight", "input_blocks.8.1.transformer_blocks.3.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.4.norm3.bias", "input_blocks.7.1.transformer_blocks.6.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.4.attn1.to_out.0.bias", "output_blocks.0.1.transformer_blocks.6.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.6.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.9.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.7.norm1.bias", "output_blocks.1.1.transformer_blocks.2.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.3.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.3.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.4.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.6.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.4.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.5.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.5.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.3.ff.net.2.bias", "output_blocks.1.1.norm.bias", "output_blocks.2.1.transformer_blocks.6.ff.net.0.proj.bias", "input_blocks.5.1.transformer_blocks.1.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.3.norm1.weight", "middle_block.1.transformer_blocks.5.norm1.bias", "output_blocks.2.1.transformer_blocks.8.norm3.bias", "input_blocks.7.1.transformer_blocks.3.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.9.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.1.attn2.to_k.weight", "input_blocks.4.1.transformer_blocks.1.attn2.to_v.weight", "input_blocks.7.1.transformer_blocks.4.norm1.bias", "input_blocks.8.1.transformer_blocks.5.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.7.attn2.to_k.weight", "output_blocks.1.1.transformer_blocks.5.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.8.norm2.weight", "input_blocks.8.1.transformer_blocks.5.norm1.bias", "input_blocks.5.1.transformer_blocks.1.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.9.ff.net.2.weight", "input_blocks.7.1.transformer_blocks.4.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.4.attn2.to_q.weight", "input_blocks.8.1.transformer_blocks.7.attn2.to_v.weight", "input_blocks.5.1.transformer_blocks.1.norm3.bias", "input_blocks.8.1.transformer_blocks.2.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.9.attn1.to_out.0.weight", "output_blocks.1.1.transformer_blocks.1.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.2.norm2.bias", "output_blocks.1.1.transformer_blocks.5.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.1.norm2.bias", "output_blocks.1.1.transformer_blocks.8.attn1.to_q.weight", "middle_block.1.transformer_blocks.1.norm1.weight", "middle_block.1.transformer_blocks.5.attn2.to_v.weight", "output_blocks.4.1.transformer_blocks.1.ff.net.2.weight", "input_blocks.4.1.transformer_blocks.1.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.1.attn2.to_out.0.weight", "middle_block.1.transformer_blocks.7.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.6.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.6.norm2.weight", "input_blocks.8.1.transformer_blocks.2.attn1.to_v.weight", "middle_block.1.transformer_blocks.1.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.8.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.3.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.2.ff.net.2.weight", "middle_block.1.transformer_blocks.9.norm1.weight", "output_blocks.2.1.transformer_blocks.4.norm1.weight", "middle_block.1.transformer_blocks.3.norm2.bias", "input_blocks.7.1.transformer_blocks.3.ff.net.2.weight", "input_blocks.7.1.transformer_blocks.9.norm1.bias", "middle_block.1.transformer_blocks.8.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.5.ff.net.2.bias", "middle_block.1.transformer_blocks.4.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.8.attn1.to_out.0.weight", "output_blocks.2.1.transformer_blocks.6.norm3.weight", "output_blocks.0.1.transformer_blocks.3.norm1.weight", "input_blocks.8.1.transformer_blocks.2.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.4.attn2.to_out.0.weight", "output_blocks.4.1.transformer_blocks.1.norm2.weight", "output_blocks.1.1.transformer_blocks.7.norm1.bias", "output_blocks.2.1.transformer_blocks.0.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.6.norm2.weight", "middle_block.1.transformer_blocks.3.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.8.attn2.to_v.weight", "input_blocks.5.1.transformer_blocks.1.norm1.bias", "output_blocks.1.1.transformer_blocks.7.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.6.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.3.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.2.attn1.to_out.0.bias", "output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.7.norm2.bias", "input_blocks.8.1.transformer_blocks.7.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.8.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.2.norm2.bias", "input_blocks.7.1.transformer_blocks.9.norm2.bias", "output_blocks.2.1.transformer_blocks.9.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.4.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.1.attn2.to_out.0.weight", "input_blocks.7.1.transformer_blocks.5.norm2.weight", "input_blocks.7.1.transformer_blocks.8.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.0.attn1.to_out.0.weight", "output_blocks.0.1.transformer_blocks.7.norm2.bias", "input_blocks.7.1.transformer_blocks.2.norm3.bias", "output_blocks.0.1.transformer_blocks.1.norm2.bias", "output_blocks.0.1.transformer_blocks.2.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.7.norm1.weight", "output_blocks.0.1.transformer_blocks.3.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.1.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.4.norm1.weight", "output_blocks.5.1.transformer_blocks.1.attn1.to_k.weight", "input_blocks.4.1.transformer_blocks.1.ff.net.0.proj.bias", "middle_block.1.transformer_blocks.7.ff.net.2.weight", "middle_block.1.transformer_blocks.8.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.8.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.1.attn1.to_k.weight", "output_blocks.1.1.transformer_blocks.7.attn1.to_q.weight", "input_blocks.4.1.transformer_blocks.1.attn1.to_out.0.weight", "middle_block.1.transformer_blocks.5.norm2.weight", "output_blocks.2.1.transformer_blocks.7.ff.net.2.weight", "middle_block.1.transformer_blocks.9.attn1.to_v.weight", "output_blocks.0.1.transformer_blocks.0.norm3.bias", "output_blocks.1.1.transformer_blocks.7.norm2.weight", "output_blocks.1.1.transformer_blocks.0.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.8.attn1.to_v.weight", "middle_block.1.transformer_blocks.4.norm2.bias", "output_blocks.1.1.transformer_blocks.3.norm3.bias", "middle_block.1.transformer_blocks.9.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.7.ff.net.0.proj.weight", "output_blocks.0.1.transformer_blocks.5.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.7.ff.net.0.proj.weight", "output_blocks.2.1.transformer_blocks.8.attn2.to_out.0.bias", "output_blocks.0.1.transformer_blocks.5.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.3.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.2.norm1.bias", "input_blocks.8.1.transformer_blocks.8.attn1.to_k.weight", "middle_block.1.transformer_blocks.2.norm3.weight", "output_blocks.1.1.transformer_blocks.2.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.6.attn2.to_k.weight", "middle_block.1.transformer_blocks.3.ff.net.0.proj.weight", "input_blocks.7.1.transformer_blocks.7.norm1.weight", "output_blocks.0.1.transformer_blocks.9.norm1.bias", "middle_block.1.transformer_blocks.8.attn2.to_out.0.bias", "input_blocks.7.1.transformer_blocks.5.norm1.bias", "output_blocks.1.1.transformer_blocks.8.attn2.to_out.0.weight", "input_blocks.8.1.transformer_blocks.8.ff.net.0.proj.bias", "output_blocks.0.1.transformer_blocks.8.attn1.to_v.weight", "input_blocks.8.1.transformer_blocks.4.norm2.weight", "middle_block.1.transformer_blocks.7.attn1.to_k.weight", "input_blocks.8.1.transformer_blocks.5.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.6.norm1.bias", "output_blocks.0.1.transformer_blocks.8.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.4.attn1.to_out.0.bias", "output_blocks.1.1.transformer_blocks.8.attn2.to_out.0.bias", "output_blocks.4.1.transformer_blocks.1.norm1.weight", "output_blocks.2.1.transformer_blocks.2.norm3.weight", "output_blocks.2.1.transformer_blocks.3.norm2.weight", "output_blocks.0.1.transformer_blocks.9.attn1.to_q.weight", "output_blocks.1.1.transformer_blocks.0.ff.net.2.bias", "output_blocks.0.1.transformer_blocks.9.norm1.weight", "input_blocks.7.1.transformer_blocks.3.ff.net.2.bias", "input_blocks.8.1.transformer_blocks.3.norm2.bias", "input_blocks.8.1.transformer_blocks.6.attn2.to_k.weight", "input_blocks.8.1.transformer_blocks.1.ff.net.2.bias", "middle_block.1.transformer_blocks.1.attn1.to_v.weight", "middle_block.1.transformer_blocks.3.norm2.weight", "input_blocks.7.1.transformer_blocks.7.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.3.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.7.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.6.norm2.bias", "output_blocks.2.1.transformer_blocks.1.attn1.to_v.weight", "output_blocks.1.1.transformer_blocks.6.attn1.to_q.weight", "input_blocks.7.1.transformer_blocks.6.ff.net.0.proj.bias", "input_blocks.7.1.transformer_blocks.7.norm2.bias", "input_blocks.7.1.transformer_blocks.7.attn1.to_out.0.bias", "input_blocks.8.1.transformer_blocks.7.attn1.to_v.weight", "middle_block.1.transformer_blocks.2.attn1.to_q.weight", "middle_block.1.transformer_blocks.6.norm2.bias", "input_blocks.8.1.transformer_blocks.6.norm3.weight", "output_blocks.0.1.transformer_blocks.6.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.2.norm1.weight", "output_blocks.2.1.transformer_blocks.0.norm3.weight", "output_blocks.1.1.transformer_blocks.8.ff.net.2.weight", "input_blocks.8.1.transformer_blocks.5.norm3.weight", "output_blocks.1.1.transformer_blocks.3.attn2.to_v.weight", "output_blocks.3.1.transformer_blocks.1.attn2.to_q.weight", "output_blocks.0.1.transformer_blocks.1.norm3.weight", "middle_block.1.transformer_blocks.9.norm3.bias", "output_blocks.1.1.transformer_blocks.3.norm1.bias", "output_blocks.0.1.transformer_blocks.6.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.0.attn2.to_v.weight", "output_blocks.1.1.transformer_blocks.0.attn1.to_v.weight", "input_blocks.8.1.transformer_blocks.4.norm1.bias", "output_blocks.3.1.transformer_blocks.1.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.5.attn2.to_k.weight", "input_blocks.7.1.transformer_blocks.1.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.5.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.8.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.0.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.7.attn2.to_q.weight", "input_blocks.8.1.transformer_blocks.1.ff.net.0.proj.bias", "input_blocks.8.1.transformer_blocks.9.norm3.bias", "input_blocks.8.1.transformer_blocks.2.attn2.to_v.weight", "output_blocks.2.1.transformer_blocks.9.attn2.to_q.weight", "input_blocks.7.1.transformer_blocks.5.attn1.to_v.weight", "output_blocks.2.1.transformer_blocks.9.norm1.weight", "output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.bias", "input_blocks.4.1.transformer_blocks.1.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.6.attn1.to_k.weight", "middle_block.1.transformer_blocks.2.attn2.to_q.weight", "output_blocks.1.1.transformer_blocks.0.attn1.to_k.weight", "input_blocks.7.1.transformer_blocks.8.norm1.bias", "output_blocks.1.1.transformer_blocks.5.attn2.to_out.0.bias", "middle_block.1.transformer_blocks.5.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.6.attn2.to_out.0.weight", "output_blocks.1.1.transformer_blocks.9.norm3.weight", "input_blocks.8.1.transformer_blocks.9.attn2.to_out.0.weight", "input_blocks.7.1.transformer_blocks.8.norm2.bias", "middle_block.1.transformer_blocks.8.ff.net.2.bias", "output_blocks.2.1.transformer_blocks.2.attn1.to_v.weight", "output_blocks.4.1.transformer_blocks.1.ff.net.0.proj.weight", "output_blocks.1.1.transformer_blocks.1.norm1.bias", "output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.bias", "input_blocks.7.1.transformer_blocks.1.attn1.to_k.weight", "output_blocks.0.1.transformer_blocks.7.norm1.bias", "output_blocks.2.1.transformer_blocks.8.ff.net.2.weight", "output_blocks.5.1.transformer_blocks.1.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.1.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.6.attn1.to_q.weight", "output_blocks.0.1.transformer_blocks.1.ff.net.0.proj.bias", "middle_block.1.transformer_blocks.5.attn2.to_out.0.weight", "output_blocks.0.1.transformer_blocks.3.attn2.to_out.0.bias", "output_blocks.1.1.transformer_blocks.2.ff.net.0.proj.weight", "input_blocks.7.1.transformer_blocks.8.attn1.to_out.0.bias", "output_blocks.2.1.transformer_blocks.9.attn1.to_out.0.weight", "output_blocks.4.1.transformer_blocks.1.ff.net.0.proj.bias", "output_blocks.2.1.transformer_blocks.8.attn2.to_q.weight", "output_blocks.4.1.transformer_blocks.1.attn2.to_out.0.weight", "output_blocks.2.1.transformer_blocks.4.ff.net.2.weight", "middle_block.1.transformer_blocks.6.attn1.to_out.0.weight", "input_blocks.8.1.transformer_blocks.7.attn2.to_out.0.bias", "output_blocks.2.1.transformer_blocks.3.ff.net.2.weight", "output_blocks.0.1.transformer_blocks.4.attn2.to_v.weight", "middle_block.1.transformer_blocks.2.attn2.to_v.weight", "output_blocks.0.1.transformer_blocks.7.attn1.to_k.weight", "output_blocks.2.1.transformer_blocks.5.norm3.weight", "output_blocks.1.1.transformer_blocks.6.norm2.bias", "input_blocks.7.1.transformer_blocks.6.ff.net.0.proj.weight", "input_blocks.8.1.transformer_blocks.8.norm1.bias", "output_blocks.0.1.transformer_blocks.9.attn1.to_out.0.bias", "input_blocks.7.1.transformer_blocks.6.norm2.bias", "output_blocks.0.1.transformer_blocks.5.norm3.weight", "output_blocks.1.1.transformer_blocks.7.attn2.to_out.0.bias", "input_blocks.8.1.transformer_blocks.8.norm3.weight", "input_blocks.8.1.transformer_blocks.6.norm1.weight", "output_blocks.0.1.transformer_blocks.7.norm1.weight", "input_blocks.8.1.transformer_blocks.5.attn2.to_k.weight", "output_blocks.0.1.transformer_blocks.4.attn2.to_q.weight", "middle_block.1.transformer_blocks.8.ff.net.2.weight", "output_blocks.2.1.transformer_blocks.1.attn1.to_out.0.weight", "input_blocks.7.1.transformer_blocks.8.attn1.to_out.0.weight".
Traceback (most recent call last):
File "C:\Program Files\Python310\lib\runpy.py", line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File "C:\Program Files\Python310\lib\runpy.py", line 86, in _run_code
exec(code, run_globals)
File "D:\AI\Kohya\kohya_ss\venv\Scripts\accelerate.EXE\__main__.py", line 7, in <module>
sys.exit(main())
File "D:\AI\Kohya\kohya_ss\venv\lib\site-packages\accelerate\commands\accelerate_cli.py", line 47, in main
args.func(args)
File "D:\AI\Kohya\kohya_ss\venv\lib\site-packages\accelerate\commands\launch.py", line 1017, in launch_command
simple_launcher(args)
File "D:\AI\Kohya\kohya_ss\venv\lib\site-packages\accelerate\commands\launch.py", line 637, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['D:\\AI\\Kohya\\kohya_ss\\venv\\Scripts\\python.exe', 'D:/AI/Kohya/kohya_ss/sd-scripts/sdxl_train.py', '--config_file', 'D:/AI/ai_trainning/model/config_dreambooth-20241209-173523.toml', '--log_prefix=xl-loha']' returned non-zero exit status 1.
17:35:34-263774 INFO Training has ended.