skx618 commited on
Commit
d966fa7
·
verified ·
1 Parent(s): 48e39a4

Add files using upload-large-folder tool

Browse files
Files changed (49) hide show
  1. LICENSE +84 -0
  2. LICENSE-Qwen3-VL +201 -0
  3. NOTICE +18 -0
  4. README.md +44 -0
  5. audio_scheduler/scheduler_config.json +5 -0
  6. audio_vae/config.json +125 -0
  7. checkpoint_content.json +99 -0
  8. checkpoint_metadata.json +222 -0
  9. fastvideo_inference.json +33 -0
  10. modelopt_manifest.json +523 -0
  11. modular_model_index.json +131 -0
  12. processor/chat_template.json +3 -0
  13. processor/merges.txt +0 -0
  14. processor/preprocessor_config.json +21 -0
  15. processor/tokenizer.json +0 -0
  16. processor/tokenizer_config.json +246 -0
  17. processor/video_preprocessor_config.json +21 -0
  18. processor/vocab.json +0 -0
  19. scheduler/scheduler_config.json +5 -0
  20. text_encoder/chat_template.json +3 -0
  21. text_encoder/config.json +62 -0
  22. text_encoder/merges.txt +0 -0
  23. text_encoder/model-00001-of-00014.safetensors +3 -0
  24. text_encoder/model-00002-of-00014.safetensors +3 -0
  25. text_encoder/model-00003-of-00014.safetensors +3 -0
  26. text_encoder/model-00006-of-00014.safetensors +3 -0
  27. text_encoder/model-00007-of-00014.safetensors +3 -0
  28. text_encoder/model-00011-of-00014.safetensors +3 -0
  29. text_encoder/model-00014-of-00014.safetensors +3 -0
  30. text_encoder/model.safetensors.index.json +1065 -0
  31. text_encoder/preprocessor_config.json +21 -0
  32. text_encoder/tokenizer.json +0 -0
  33. text_encoder/tokenizer_config.json +246 -0
  34. text_encoder/video_preprocessor_config.json +21 -0
  35. text_encoder/vocab.json +0 -0
  36. tokenizer/merges.txt +0 -0
  37. tokenizer/tokenizer.json +0 -0
  38. tokenizer/tokenizer_config.json +246 -0
  39. tokenizer/vocab.json +0 -0
  40. transformer/config.json +26 -0
  41. transformer/diffusion_pytorch_model-00002-of-00014.safetensors +3 -0
  42. transformer/diffusion_pytorch_model-00003-of-00014.safetensors +3 -0
  43. transformer/diffusion_pytorch_model-00007-of-00014.safetensors +3 -0
  44. transformer/diffusion_pytorch_model-00008-of-00014.safetensors +3 -0
  45. transformer/diffusion_pytorch_model-00009-of-00014.safetensors +3 -0
  46. transformer/diffusion_pytorch_model.safetensors.index.json +895 -0
  47. transformer/modelopt-component-manifest.json +1483 -0
  48. vae/config.json +97 -0
  49. vae/diffusion_pytorch_model.safetensors.index.json +710 -0
LICENSE ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MiniMax H3 COMMUNITY LICENSE AGREEMENT
2
+ MiniMax H3 release date/License date: August 2, 2026.
3
+ The scope of this License Agreement (this “Agreement”) is expressly limited to the “Applicable Territory” as defined below.
4
+ By clicking to accept, or by using, reproducing, modifying, distributing, running, or displaying any portion or element of the MiniMax H3 Works (including through any Hosted Services) in any manner, you acknowledge and accept the terms of this Agreement, and this Agreement shall take immediate effect upon the occurrence of such act.
5
+ I. Definitions
6
+ 1. “Acceptable Use Policy” means the policy published by MiniMax in Exhibit A.
7
+ 2. “Agreement” means the terms and conditions set forth herein that govern the use, reproduction, distribution, modification, running, and display of the MiniMax H3 Works or any portion or element thereof.
8
+ 3. “Applicable Territory” means worldwide, excluding the Excluded Territories.
9
+ 4. “Documentation” means the specifications, manuals, and documentation concerning MiniMax H3 that are publicly released by MiniMax.
10
+ 5. “Excluded Territories” means the European Union, the United Kingdom, the Republic of Korea and the United States of America.
11
+ 6. “MiniMax H3” means the video generation model, together with its software and algorithms, including trained model weights, parameters (including optimizer states), machine-learning model code, inference-supporting code, and other elements thereof made publicly available by Us, as released at https://huggingface.co/MiniMaxAI/MiniMax-H3.
12
+ 7. “MiniMax H3 Works” means (i) the Materials, (ii) the Model Derivatives, and (iii) all derivatives thereof.
13
+ 8. “Hosted Services” means hosted services provided via application programming interfaces (APIs), web access, or any other electronic or remote means.
14
+ 9. “Licensee,” “you,” or “your” means the natural or legal person exercising rights and/or using the MiniMax H3 Works for any purpose in any field of use under this Agreement.
15
+ 10. “Materials” means, collectively, MiniMax H3 and the Documentation (and any portion thereof), in each case as made available by MiniMax under this Agreement and proprietary to MiniMax.
16
+ 11. “Model Derivatives” means all of the following: (i) any modification of MiniMax H3 or any Model Derivative thereof; (ii) any work based on MiniMax H3 or any Model Derivative thereof; or (iii) any other machine learning model created by transferring the patterns of the weights, parameters, operational patterns, or Outputs of MiniMax H3 or any Model Derivative thereof to another model, such that the latter model exhibits behavior similar to MiniMax H3 or its Model Derivatives, including by distillation methods, methods using intermediate data representations, or methods based on training using synthetic-data Outputs generated by MiniMax H3 or its Model Derivatives. For the avoidance of doubt, Outputs are not deemed Model Derivatives.
17
+ 12. “Output” means any result of operating or otherwise using MiniMax H3 or any Model Derivatives (including through Hosted Services).
18
+ 13. “Third Party” means any natural or legal person that is not under common control with us or with you.
19
+ 14. “Including” means “including but not limited to.”
20
+ 15. “We,” “Us” or “MiniMax” means Nanonoble Pte. Ltd..
21
+ II. Grant of Rights
22
+ Solely within the Applicable Territory, we grant you a non-exclusive, non-transferable, royalty-free, limited license to use, reproduce, distribute, create derivative works (including Model Derivatives), and modify the Materials in accordance with the terms of this Agreement and the Acceptable Use Policy, based on the intellectual property and other rights owned by MiniMax that are embodied in or used by the Materials. You shall not violate (or encourage or permit any person to violate) any term of this Agreement or the Acceptable Use Policy.
23
+ We will continuously evaluate the applicable laws, regulations and compliance requirements for the Excluded Territories. In the meantime, should any person in such Excluded Territories be interested in deploying our models, you are welcome to contact us about obtaining a license, which will be granted based on robust controls and guardrails for purposes of complying with the laws, regulations and compliance requirements of the Excluded Territories.
24
+ III. Distribution and Redistribution
25
+ Subject to and conditioned on your continuing compliance with this Agreement, including its territorial restrictions and the Acceptable Use Policy, and solely within the Applicable Territory, you may distribute or make available the MiniMax H3 Works to Third Parties within the Applicable Territory; provided, that all of the following conditions are met:
26
+ 1. You must provide a copy of this Agreement to all such Third Parties who receive the MiniMax H3 Works or use your products or services related thereto;
27
+ 2. You must cause any modified files to carry prominent notices stating that you have modified such files;
28
+ 3. You are encouraged to:
29
+ a. display a notice on any product or service developed using MiniMax H3 indicating that the product or service is “Powered by MiniMax H3”;
30
+ b. add an AI-generation identifier to files produced using generative AI models including MiniMax H3; and
31
+ c. publish at least one technical blog post or a public statement describing your experience using MiniMax H3 Works;
32
+ 4. All distributions to Third Parties (other than through Hosted Services) must be accompanied by a “NOTICE” text file containing the following notice:
33
+ “MiniMax H3 is licensed under the MiniMax H3 Community License Agreement, Copyright © 2026 MiniMax. All Rights Reserved.”
34
+ You may add your own copyright notices on your modifications; except as provided in this Section and in Section V, however, you may not impose additional or different terms and conditions on the use, reproduction, or distribution of your modifications or of any aggregate Model Derivatives, and your use, reproduction, modification, distribution, running, and display of the work must otherwise comply with the terms and conditions of this Agreement (including the provisions concerning the Applicable Territory). If you receive the MiniMax H3 Works from a Licensee as part of an integrated end-user product, the provisions of Section III of this Agreement do not apply to you, but Section V and Exhibit A remain applicable.
35
+ IV. Additional Commercial Terms
36
+ 1. You shall obtain a separate, prior written authorization from MiniMax by contacting api@minimax.io with the subject line “MiniMax H3 licensing - authorization request”, if your commercial products and services generate more than 20 million US dollars (or equivalent in other currencies) in yearly revenue.
37
+ 2. You shall prominently display “MiniMax H3”on the user interface of commercial product or service that uses MiniMax H3 or MiniMax H3 Works.
38
+ V. Use Restrictions
39
+ 1. Your use of the MiniMax H3 Works must comply with applicable laws and regulations (including trade-compliance laws and regulations) and must comply with the Acceptable Use Policy for the MiniMax H3 Works, which is incorporated into this Agreement by reference.
40
+ 2. Before providing access to the MiniMax H3 Works or any product, service, or Hosted Service incorporating them, you must bind each recipient or user to enforceable terms at least as protective as the use restrictions in this Section V and Exhibit A, and you must notify each recipient or user that those restrictions apply.
41
+ 3. You may not use the MiniMax H3 Works or any of their Outputs or results to improve any other artificial intelligence model (other than MiniMax H3 or its Model Derivatives).
42
+ 4. You may not use, reproduce, modify, distribute, or display the MiniMax H3 Works or any of their Outputs or results outside the Applicable Territory. Any such use outside the Applicable Territory is not authorized by this Agreement.
43
+ 5. If you provide or make available to any Third Party a product, service, or Hosted Service that permits the generation of Outputs using MiniMax H3 or any Model Derivative, you must, before making that product or service available and throughout its operation, implement, maintain, test, and periodically review reasonable and proportionate technical and organizational safeguards designed to prevent and mitigate access, uses, and Outputs that violate this Section V or Exhibit A, including uses or Outputs that infringe, misappropriate, or otherwise violate any Third Party’s intellectual-property or other rights. You must not knowingly disable, materially weaken, or permit the circumvention of those safeguards. You must maintain a reasonably accessible mechanism for reporting suspected violations. Upon receiving a good-faith report or otherwise obtaining actual knowledge of a violation, you must promptly investigate and take reasonable steps within your control to stop or mitigate the violation, including removing or disabling access to offending content or services and suspending or terminating repeat violators where appropriate. You are responsible for implementing and enforcing these requirements with respect to your products, services, systems, users, and downstream recipients.
44
+ VI. Intellectual Property
45
+ 1. Subject to MiniMax’s rights in the MiniMax H3 Works (and the intellectual property therein), and to your compliance with the terms and conditions of this Agreement, as between you and MiniMax, you will own the derivative works and modifications of the Materials that you have created or had created, as well as any Model Derivatives.
46
+ 2. Except for the limited license expressly granted in this paragraph, no trademark license is granted under this Agreement; with respect to MiniMax H3 Works, the Licensee may not use any name or mark owned by or associated with MiniMax or any of its affiliates, except as reasonably and customarily necessary to describe and distribute the MiniMax H3 Works. MiniMax hereby grants you a license to use the “MiniMax H3” mark (the “Mark”) within the Applicable Territory solely for the purpose of complying with Section III.3; provided, that you comply with all applicable trademark-protection laws. All goodwill arising from your use of the Mark shall inure to the benefit of MiniMax.
47
+ 3. If you bring or assert any suit or other legal proceeding (including a cross-claim or counterclaim in any action) against us or any other natural or legal person alleging that the Materials, any Output, or any portion of the foregoing infringes any intellectual property right or other right owned by you or for which you can obtain a license, all licenses granted to you under this Agreement will terminate as of the date such suit or proceeding is filed. You shall defend, indemnify, and hold us harmless against any Third-Party claim arising out of or related to the use or distribution of the MiniMax H3 Works by you or by any Third Party.
48
+ 4. MiniMax claims no rights over the Outputs you generate. You and your users are entirely responsible for the Outputs and any subsequent use thereof.
49
+ VII. Disclaimers and Limitations of Liability
50
+ 1. We have no obligation to support, update, provide training for, or develop any further version of the MiniMax H3 Works, or to grant any license with respect thereto.
51
+ 2. UNLESS AND ONLY TO THE EXTENT REQUIRED BY APPLICABLE LAW, THE MINIMAX H3 WORKS AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED “AS IS” WITHOUT ANY EXPRESS OR IMPLIED WARRANTIES OF ANY KIND INCLUDING ANY WARRANTIES OF TITLE, MERCHANTABILITY, NONINFRINGEMENT, COURSE OF DEALING, USAGE OF TRADE, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING THE APPROPRIATENESS OF USING, REPRODUCING, MODIFYING, PERFORMING, DISPLAYING OR DISTRIBUTING ANY OF THE MINIMAX H3 WORKS OR OUTPUTS AND ASSUME ANY AND ALL RISKS ASSOCIATED WITH YOUR OR A THIRD PARTY’S USE OR DISTRIBUTION OF ANY OF THE MINIMAX H3 WORKS OR OUTPUTS AND YOUR EXERCISE OF RIGHTS AND PERMISSIONS UNDER THIS AGREEMENT.
52
+ 3. TO THE FULLEST EXTENT PERMITTED BY APPLICABLE LAW, IN NO EVENT SHALL MINIMAX OR ITS AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, FOR ANY DAMAGES, INCLUDING ANY DIRECT, INDIRECT, SPECIAL, INCIDENTAL, EXEMPLARY, CONSEQUENTIAL OR PUNITIVE DAMAGES, OR LOST PROFITS OF ANY KIND ARISING FROM THIS AGREEMENT OR RELATED TO ANY OF THE MINIMAX H3 WORKS OR OUTPUTS, EVEN IF MINIMAX OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF ANY OF THE FOREGOING.
53
+ VIII. Term and Termination
54
+ 1. This Agreement is effective from the moment you accept this Agreement or begin accessing the Materials, and, subject to your compliance with its terms and conditions, will remain in effect until terminated as provided herein.
55
+ 2. If you breach any term or condition of this Agreement, we have the right to terminate this Agreement. Upon termination, you must immediately cease accessing, using, and distributing the MiniMax H3 Works; delete or destroy all copies within your possession or control; and notify each downstream recipient that your authorization has ended. The obligations in the preceding sentence and Sections VI.1, VI.3, VII, and IX survive termination.
56
+ IX. Governing Law and Jurisdiction
57
+ 1. This Agreement, and any dispute arising out of or related to this Agreement, shall be governed by the laws of the Hong Kong Special Administrative Region of the People’s Republic of China, without regard to its conflict-of-laws rules. The United Nations Convention on Contracts for the International Sale of Goods does not apply to this Agreement.
58
+ 2. Any dispute arising out of or related to this Agreement shall be subject to the exclusive jurisdiction of the courts of the Hong Kong Special Administrative Region of the People’s Republic of China with competent jurisdiction. Both MiniMax and the Licensee hereby consent to the exclusive jurisdiction of such courts for any such dispute.
59
+ Additional Note: Please note that the encoder of MiniMax H3 uses Qwen3-VL-32B, which is licensed under Apache 2.0 License: https://github.com/QwenLM/Qwen3-VL/blob/main/LICENSE.
60
+
61
+ Exhibit A — Acceptable Use Policy
62
+ MiniMax reserves the right to update this Acceptable Use Policy from time to time.
63
+ Last revised: August 2, 2026.
64
+ MiniMax is committed to promoting the safe and fair use of its tools and features, including MiniMax H3. You agree not to use MiniMax H3, any Model Derivatives, or any Output in any of the following ways:
65
+ 1. Use outside the Applicable Territory;
66
+ 2. Use in any manner that violates any applicable national, federal, state, local, or international law, regulation, or other legal requirement, or that infringes, misappropriates, or otherwise violates any Third Party’s intellectual-property or other proprietary rights, including through unauthorized reproduction, distribution, public display, public performance, or creation of derivative works;
67
+ 3. Use in any manner that may harm yourself or others;
68
+ 4. Use to repurpose or distribute the Outputs of MiniMax H3 or any Model Derivatives in order to harm yourself or others;
69
+ 5. Use to circumvent or bypass any safety guardrails or safeguards we have implemented;
70
+ 6. Use in any manner that exploits or harms, or intends to exploit or harm, minors;
71
+ 7. Use to generate or disseminate verifiably false information and/or content for the purpose of harming others or influencing elections;
72
+ 8. Use to manufacture or facilitate false online engagement, including fake reviews and other means of false online engagement;
73
+ 9. Use to intentionally defame, disparage, or otherwise harass others;
74
+ 10. Use to generate and/or disseminate malware (including ransomware) or any other content intended to damage electronic systems;
75
+ 11. Use to generate or disseminate personally identifiable information for the purpose of harming others;
76
+ 12. Use to generate or disseminate information (including images, code, posts, or articles) in or to any public environment (including via bot tweets or similar means) without clearly and prominently disclosing that such information and/or content is machine-generated;
77
+ 13. Use to impersonate another person without that person’s consent, authorization, or lawful right to do so;
78
+ 14. Use to make high-risk automated decisions in critical domains that affect individual safety, rights, or well-being (such as law enforcement, immigration, healthcare or medical services, critical-infrastructure management, product-safety components, essential services, credit, employment, housing, education, social scoring, or insurance);
79
+ 15. Use in any manner that violates or disregards the social, ethical, or moral standards of other countries or regions;
80
+ 16. Use to carry out, assist, threaten, incite, plan, advocate for, or encourage violent extremism or terrorism;
81
+ 17. Use for any purpose intended to discriminate against, or harm, individuals or groups based on protected characteristics or categories, online or offline social behavior, or known or predicted personality traits;
82
+ 18. Use to intentionally exploit the vulnerabilities of specific populations based on age, social, physical, or psychological characteristics, so as to materially distort the behavior of a member of that group in a manner that causes, or is likely to cause, physical or psychological harm to that person or to others;
83
+ 19. Use for military purposes;
84
+ 20. Use to engage in any unauthorized or unlicensed professional activity, including but not limited to financial, legal, medical or healthcare, or other professional practice.
LICENSE-Qwen3-VL ADDED
@@ -0,0 +1,201 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Apache License
2
+ Version 2.0, January 2004
3
+ http://www.apache.org/licenses/
4
+
5
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
6
+
7
+ 1. Definitions.
8
+
9
+ "License" shall mean the terms and conditions for use, reproduction,
10
+ and distribution as defined by Sections 1 through 9 of this document.
11
+
12
+ "Licensor" shall mean the copyright owner or entity authorized by
13
+ the copyright owner that is granting the License.
14
+
15
+ "Legal Entity" shall mean the union of the acting entity and all
16
+ other entities that control, are controlled by, or are under common
17
+ control with that entity. For the purposes of this definition,
18
+ "control" means (i) the power, direct or indirect, to cause the
19
+ direction or management of such entity, whether by contract or
20
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
21
+ outstanding shares, or (iii) beneficial ownership of such entity.
22
+
23
+ "You" (or "Your") shall mean an individual or Legal Entity
24
+ exercising permissions granted by this License.
25
+
26
+ "Source" form shall mean the preferred form for making modifications,
27
+ including but not limited to software source code, documentation
28
+ source, and configuration files.
29
+
30
+ "Object" form shall mean any form resulting from mechanical
31
+ transformation or translation of a Source form, including but
32
+ not limited to compiled object code, generated documentation,
33
+ and conversions to other media types.
34
+
35
+ "Work" shall mean the work of authorship, whether in Source or
36
+ Object form, made available under the License, as indicated by a
37
+ copyright notice that is included in or attached to the work
38
+ (an example is provided in the Appendix below).
39
+
40
+ "Derivative Works" shall mean any work, whether in Source or Object
41
+ form, that is based on (or derived from) the Work and for which the
42
+ editorial revisions, annotations, elaborations, or other modifications
43
+ represent, as a whole, an original work of authorship. For the purposes
44
+ of this License, Derivative Works shall not include works that remain
45
+ separable from, or merely link (or bind by name) to the interfaces of,
46
+ the Work and Derivative Works thereof.
47
+
48
+ "Contribution" shall mean any work of authorship, including
49
+ the original version of the Work and any modifications or additions
50
+ to that Work or Derivative Works thereof, that is intentionally
51
+ submitted to Licensor for inclusion in the Work by the copyright owner
52
+ or by an individual or Legal Entity authorized to submit on behalf of
53
+ the copyright owner. For the purposes of this definition, "submitted"
54
+ means any form of electronic, verbal, or written communication sent
55
+ to the Licensor or its representatives, including but not limited to
56
+ communication on electronic mailing lists, source code control systems,
57
+ and issue tracking systems that are managed by, or on behalf of, the
58
+ Licensor for the purpose of discussing and improving the Work, but
59
+ excluding communication that is conspicuously marked or otherwise
60
+ designated in writing by the copyright owner as "Not a Contribution."
61
+
62
+ "Contributor" shall mean Licensor and any individual or Legal Entity
63
+ on behalf of whom a Contribution has been received by Licensor and
64
+ subsequently incorporated within the Work.
65
+
66
+ 2. Grant of Copyright License. Subject to the terms and conditions of
67
+ this License, each Contributor hereby grants to You a perpetual,
68
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
69
+ copyright license to reproduce, prepare Derivative Works of,
70
+ publicly display, publicly perform, sublicense, and distribute the
71
+ Work and such Derivative Works in Source or Object form.
72
+
73
+ 3. Grant of Patent License. Subject to the terms and conditions of
74
+ this License, each Contributor hereby grants to You a perpetual,
75
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
76
+ (except as stated in this section) patent license to make, have made,
77
+ use, offer to sell, sell, import, and otherwise transfer the Work,
78
+ where such license applies only to those patent claims licensable
79
+ by such Contributor that are necessarily infringed by their
80
+ Contribution(s) alone or by combination of their Contribution(s)
81
+ with the Work to which such Contribution(s) was submitted. If You
82
+ institute patent litigation against any entity (including a
83
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
84
+ or a Contribution incorporated within the Work constitutes direct
85
+ or contributory patent infringement, then any patent licenses
86
+ granted to You under this License for that Work shall terminate
87
+ as of the date such litigation is filed.
88
+
89
+ 4. Redistribution. You may reproduce and distribute copies of the
90
+ Work or Derivative Works thereof in any medium, with or without
91
+ modifications, and in Source or Object form, provided that You
92
+ meet the following conditions:
93
+
94
+ (a) You must give any other recipients of the Work or
95
+ Derivative Works a copy of this License; and
96
+
97
+ (b) You must cause any modified files to carry prominent notices
98
+ stating that You changed the files; and
99
+
100
+ (c) You must retain, in the Source form of any Derivative Works
101
+ that You distribute, all copyright, patent, trademark, and
102
+ attribution notices from the Source form of the Work,
103
+ excluding those notices that do not pertain to any part of
104
+ the Derivative Works; and
105
+
106
+ (d) If the Work includes a "NOTICE" text file as part of its
107
+ distribution, then any Derivative Works that You distribute must
108
+ include a readable copy of the attribution notices contained
109
+ within such NOTICE file, excluding those notices that do not
110
+ pertain to any part of the Derivative Works, in at least one
111
+ of the following places: within a NOTICE text file distributed
112
+ as part of the Derivative Works; within the Source form or
113
+ documentation, if provided along with the Derivative Works; or,
114
+ within a display generated by the Derivative Works, if and
115
+ wherever such third-party notices normally appear. The contents
116
+ of the NOTICE file are for informational purposes only and
117
+ do not modify the License. You may add Your own attribution
118
+ notices within Derivative Works that You distribute, alongside
119
+ or as an addendum to the NOTICE text from the Work, provided
120
+ that such additional attribution notices cannot be construed
121
+ as modifying the License.
122
+
123
+ You may add Your own copyright statement to Your modifications and
124
+ may provide additional or different license terms and conditions
125
+ for use, reproduction, or distribution of Your modifications, or
126
+ for any such Derivative Works as a whole, provided Your use,
127
+ reproduction, and distribution of the Work otherwise complies with
128
+ the conditions stated in this License.
129
+
130
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
131
+ any Contribution intentionally submitted for inclusion in the Work
132
+ by You to the Licensor shall be under the terms and conditions of
133
+ this License, without any additional terms or conditions.
134
+ Notwithstanding the above, nothing herein shall supersede or modify
135
+ the terms of any separate license agreement you may have executed
136
+ with Licensor regarding such Contributions.
137
+
138
+ 6. Trademarks. This License does not grant permission to use the trade
139
+ names, trademarks, service marks, or product names of the Licensor,
140
+ except as required for reasonable and customary use in describing the
141
+ origin of the Work and reproducing the content of the NOTICE file.
142
+
143
+ 7. Disclaimer of Warranty. Unless required by applicable law or
144
+ agreed to in writing, Licensor provides the Work (and each
145
+ Contributor provides its Contributions) on an "AS IS" BASIS,
146
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
147
+ implied, including, without limitation, any warranties or conditions
148
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
149
+ PARTICULAR PURPOSE. You are solely responsible for determining the
150
+ appropriateness of using or redistributing the Work and assume any
151
+ risks associated with Your exercise of permissions under this License.
152
+
153
+ 8. Limitation of Liability. In no event and under no legal theory,
154
+ whether in tort (including negligence), contract, or otherwise,
155
+ unless required by applicable law (such as deliberate and grossly
156
+ negligent acts) or agreed to in writing, shall any Contributor be
157
+ liable to You for damages, including any direct, indirect, special,
158
+ incidental, or consequential damages of any character arising as a
159
+ result of this License or out of the use or inability to use the
160
+ Work (including but not limited to damages for loss of goodwill,
161
+ work stoppage, computer failure or malfunction, or any and all
162
+ other commercial damages or losses), even if such Contributor
163
+ has been advised of the possibility of such damages.
164
+
165
+ 9. Accepting Warranty or Additional Liability. While redistributing
166
+ the Work or Derivative Works thereof, You may choose to offer,
167
+ and charge a fee for, acceptance of support, warranty, indemnity,
168
+ or other liability obligations and/or rights consistent with this
169
+ License. However, in accepting such obligations, You may act only
170
+ on Your own behalf and on Your sole responsibility, not on behalf
171
+ of any other Contributor, and only if You agree to indemnify,
172
+ defend, and hold each Contributor harmless for any liability
173
+ incurred by, or claims asserted against, such Contributor by reason
174
+ of your accepting any such warranty or additional liability.
175
+
176
+ END OF TERMS AND CONDITIONS
177
+
178
+ APPENDIX: How to apply the Apache License to your work.
179
+
180
+ To apply the Apache License to your work, attach the following
181
+ boilerplate notice, with the fields enclosed by brackets "[]"
182
+ replaced with your own identifying information. (Don't include
183
+ the brackets!) The text should be enclosed in the appropriate
184
+ comment syntax for the file format. We also recommend that a
185
+ file or class name and description of purpose be included on the
186
+ same "printed page" as the copyright notice for easier
187
+ identification within third-party archives.
188
+
189
+ Copyright [yyyy] [name of copyright owner]
190
+
191
+ Licensed under the Apache License, Version 2.0 (the "License");
192
+ you may not use this file except in compliance with the License.
193
+ You may obtain a copy of the License at
194
+
195
+ http://www.apache.org/licenses/LICENSE-2.0
196
+
197
+ Unless required by applicable law or agreed to in writing, software
198
+ distributed under the License is distributed on an "AS IS" BASIS,
199
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
200
+ See the License for the specific language governing permissions and
201
+ limitations under the License.
NOTICE ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MiniMax H3 is licensed under the MiniMax H3 Community License Agreement, Copyright © 2026 MiniMax. All Rights Reserved.
2
+
3
+ FastVideo-FastH3-8-Step-V2 is a modified MiniMax H3 model from the FastVideo team.
4
+ The transformer/*.safetensors files contain the DMD2-distilled, VSA-H3 student
5
+ at training step 1300, not the original MiniMax H3 transformer weights.
6
+ The accompanying transformer configuration and index describe that student.
7
+ The scheduler configurations and fastvideo_inference.json describe its trained
8
+ eight-forward schedule, video/audio shifts 10/3, and 80% tile-64 VSA policy.
9
+ The modular model index, model card, and release/provenance documentation were
10
+ prepared by FastVideo for this derivative.
11
+
12
+ The bundled text encoder, tokenizer, processor, video VAE and audio VAE weights
13
+ are unmodified MiniMax H3 components. The Qwen3-VL encoder is licensed under
14
+ Apache License 2.0; a copy is included as LICENSE-Qwen3-VL.
15
+ Source: https://github.com/QwenLM/Qwen3-VL
16
+
17
+ The model license is provided in LICENSE. These notices do not replace or
18
+ modify its terms.
README.md ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: minimax-h3-community
4
+ license_link: LICENSE
5
+ base_model: FastVideo/FastVideo-FastH3-8-Step-V2
6
+ library_name: uniserve
7
+ pipeline_tag: text-to-video
8
+ tags:
9
+ - text-to-video
10
+ - text-to-audio-video
11
+ - fastvideo
12
+ - fasth3
13
+ - nvfp4
14
+ - modelopt
15
+ - quantized
16
+ ---
17
+
18
+ # FastVideo-FastH3-8-Step-V2-NVFP4
19
+
20
+ > This UniServe deployment checkpoint applies calibrated NVIDIA Model Optimizer NVFP4 W4A4 only to the fused gate/up and down projections in all 50 H3 denoiser gated MLPs; denoiser attention, the BF16 text encoder, token refiner, modulation, normalization, latent and conditioning boundaries, the complete BF16 Video VAE, and audio decoder remain BF16/FP32. Calibration used 1,000 prompts with complete eight-forward denoising trajectories, ModelOpt commit `6a4b3f147e14a6fec690fedbced8df402344085d`, E2M1 values, K16 FP8 E4M3 block scales, FP32 tensor scales, and calibration-derived activation tensor scales; no Phase-B VAE calibration or VAE quantization is included.
21
+
22
+ This repository is a packed UniServe checkpoint derived from [FastVideo/FastVideo-FastH3-8-Step-V2](https://huggingface.co/FastVideo/FastVideo-FastH3-8-Step-V2). It generates synchronized video and audio with eight transformer forwards and retains the source checkpoint's VSA-H3 execution contract, including video scheduler shift 10 and VSA sparsity 0.8.
23
+
24
+ ## Run with UniServe
25
+
26
+ UniServe detects `modelopt_manifest.json` automatically and selects the only valid precision, `calibrated`. The packed checkpoint does not require NVIDIA Model Optimizer at deployment time.
27
+
28
+ ```bash
29
+ uniserve serve skx618/FastVideo-FastH3-8-Step-V2-NVFP4 \
30
+ --model-description minimax-h3 \
31
+ --served-model-name MiniMax-H3 \
32
+ --dtype bfloat16 \
33
+ --quantization-config '{"mode":"calibrated"}'
34
+ ```
35
+
36
+ The checkpoint targets the source model's four-B200 execution contract. The GPU count must divide H3's 56 attention heads.
37
+
38
+ ## Validation status
39
+
40
+ The denoiser component was exported after the complete 1,000-record Phase A calibration. This assembled 8-step repository has not yet undergone the separate projection-conformance, end-to-end performance, or held-out perceptual evaluation performed for the 4-step checkpoint; no corresponding quality or speedup claim is made here.
41
+
42
+ ## License
43
+
44
+ This derivative inherits the [MiniMax H3 Community License](LICENSE) and the source checkpoint's usage conditions.
audio_scheduler/scheduler_config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "MiniMaxH3Scheduler",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "shift": 3.0
5
+ }
audio_vae/config.json ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKLMiniMaxH3Audio",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "encoder_dim": 64,
5
+ "encoder_rates": [
6
+ 2,
7
+ 4,
8
+ 4,
9
+ 5,
10
+ 5
11
+ ],
12
+ "latent_dim": 2048,
13
+ "latent_channels": 32,
14
+ "decoder_dim": 1024,
15
+ "decoder_rates": [
16
+ 5,
17
+ 5,
18
+ 2,
19
+ 2,
20
+ 2,
21
+ 2,
22
+ 2
23
+ ],
24
+ "decoder_kernel_sizes": [
25
+ 9,
26
+ 9,
27
+ 4,
28
+ 4,
29
+ 4,
30
+ 4,
31
+ 4
32
+ ],
33
+ "num_attention_heads": 8,
34
+ "resblock_kernel_sizes": [
35
+ 3,
36
+ 7,
37
+ 11
38
+ ],
39
+ "resblock_dilation_sizes": [
40
+ [
41
+ 1,
42
+ 3,
43
+ 5
44
+ ],
45
+ [
46
+ 1,
47
+ 3,
48
+ 5
49
+ ],
50
+ [
51
+ 1,
52
+ 3,
53
+ 5
54
+ ]
55
+ ],
56
+ "sampling_rate": 32000,
57
+ "latents_mean": [
58
+ -0.020211687488382354,
59
+ 0.3876466479950502,
60
+ -0.04398279799186767,
61
+ -0.28591514936373,
62
+ 0.08179686214561671,
63
+ -0.35782641352446604,
64
+ 0.040623809960919084,
65
+ -0.01552534501956604,
66
+ -0.223362481667332,
67
+ 0.1821006842509091,
68
+ 0.2941778783780663,
69
+ -0.07901167601970885,
70
+ -0.056815072777201,
71
+ -0.3699028221860095,
72
+ -0.31616315591624855,
73
+ 0.5905951377425391,
74
+ -0.052139568068853864,
75
+ 0.013673160263486295,
76
+ -0.03691647864630577,
77
+ 0.09732660653298163,
78
+ -0.3394662328788498,
79
+ -0.30685677538541667,
80
+ -0.24504598907458763,
81
+ -0.034698524462007344,
82
+ 0.02868032184767538,
83
+ -0.21217779266454084,
84
+ -0.1678263169941987,
85
+ 0.3221287889040614,
86
+ -0.1223055851554907,
87
+ 0.4356604928128464,
88
+ -0.0502599202236253,
89
+ 0.3979258376211797
90
+ ],
91
+ "latents_std": [
92
+ 1.6895524230479284,
93
+ 2.76263727217653,
94
+ 1.7945344281264435,
95
+ 1.6801681847309828,
96
+ 1.6390226546605453,
97
+ 2.7788298348882177,
98
+ 1.7659090095747236,
99
+ 1.6199757612137327,
100
+ 2.6336525640336896,
101
+ 1.8539356672817833,
102
+ 2.5056497896915633,
103
+ 1.811019237886178,
104
+ 1.9579657790720237,
105
+ 1.6685498243529284,
106
+ 1.4922469314453364,
107
+ 3.298670198067373,
108
+ 1.9491804496832168,
109
+ 1.8720003270431442,
110
+ 1.8334080103291832,
111
+ 1.6488070416529093,
112
+ 1.6176957696319716,
113
+ 1.9131449234774398,
114
+ 1.5695245398428617,
115
+ 1.6943659940415912,
116
+ 1.8318420762504692,
117
+ 1.5540637421583379,
118
+ 1.9344930328968526,
119
+ 1.599198216109855,
120
+ 1.718045989838149,
121
+ 1.6307219190837705,
122
+ 1.8661226051202384,
123
+ 1.5613768203168363
124
+ ]
125
+ }
checkpoint_content.json ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "aggregate_sha256": "516323fa396fa5dff4e82669d4e9a08a5791692a3d3b98ff6bc3de3fc6a33d11",
3
+ "checkpoint_root": "/mnt/lustre/vlm-wlsaidhi/fastvideo/outputs/minimax_h3_dmd2_sp4_fsdp64_v14_datafree_mixed_vsa80_8step_vshift10/inference/checkpoint-1300",
4
+ "file_count": 18,
5
+ "files": [
6
+ {
7
+ "bytes": 9,
8
+ "path": ".complete",
9
+ "sha256": "37a40f08d8548dba289b9b0bb35bcf63b359f6d37ee86044ebc6b6da080b9ec1"
10
+ },
11
+ {
12
+ "bytes": 6561,
13
+ "path": "metadata.json",
14
+ "sha256": "ca9f2d609c05742ba465d24989981ec02cca26acb6ca2f163dc0f6dc8d11c27b"
15
+ },
16
+ {
17
+ "bytes": 546,
18
+ "path": "transformer/config.json",
19
+ "sha256": "74c11bff524336576096993cbfcdcdc2ef4fa2fa4409df693bdcbc6c666282ae"
20
+ },
21
+ {
22
+ "bytes": 5331008552,
23
+ "path": "transformer/diffusion_pytorch_model-00001-of-00014.safetensors",
24
+ "sha256": "b82974a058b58c586279df78d146b3e20915765d87f404dc82a0efda3a955c8f"
25
+ },
26
+ {
27
+ "bytes": 5318721256,
28
+ "path": "transformer/diffusion_pytorch_model-00002-of-00014.safetensors",
29
+ "sha256": "05568fca94d81e382546e9a6ae8633a97fb10981fdc5e4aac34c28ef7f14d3b2"
30
+ },
31
+ {
32
+ "bytes": 5318721248,
33
+ "path": "transformer/diffusion_pytorch_model-00003-of-00014.safetensors",
34
+ "sha256": "ec8885fa237d7475e343b40de460d70adb8b5d0eeb3e2df176eb6af9c49610fb"
35
+ },
36
+ {
37
+ "bytes": 4875566048,
38
+ "path": "transformer/diffusion_pytorch_model-00004-of-00014.safetensors",
39
+ "sha256": "70dcbf6d3efb8d26f2dd4b20cd4f5c7564d6b9c6c1685c53cde24421cb151d56"
40
+ },
41
+ {
42
+ "bytes": 5318505992,
43
+ "path": "transformer/diffusion_pytorch_model-00005-of-00014.safetensors",
44
+ "sha256": "cabab8f1b8d57dc6de42de220dcf5ccbb754222741c5bc70d294ebd6e02d82eb"
45
+ },
46
+ {
47
+ "bytes": 5164580688,
48
+ "path": "transformer/diffusion_pytorch_model-00006-of-00014.safetensors",
49
+ "sha256": "9bb11d605a7c42372e8f206c2d47967d3b70db736aca68910a19aacebeeadfc6"
50
+ },
51
+ {
52
+ "bytes": 5318721240,
53
+ "path": "transformer/diffusion_pytorch_model-00007-of-00014.safetensors",
54
+ "sha256": "bcb3ac18457582de135b576eedad84626d54e29220a540016d2b2b385e9ac5f9"
55
+ },
56
+ {
57
+ "bytes": 5318721248,
58
+ "path": "transformer/diffusion_pytorch_model-00008-of-00014.safetensors",
59
+ "sha256": "845041576ed28ff8c419751a89ae87fe26ffac3df15f9890bc4241f671e7e5e2"
60
+ },
61
+ {
62
+ "bytes": 4875566056,
63
+ "path": "transformer/diffusion_pytorch_model-00009-of-00014.safetensors",
64
+ "sha256": "ad34ff06d42a9d90938d888a58ac0315087c3cbfde9676cf83e5f11199571430"
65
+ },
66
+ {
67
+ "bytes": 5318505984,
68
+ "path": "transformer/diffusion_pytorch_model-00010-of-00014.safetensors",
69
+ "sha256": "0efb2a0fd04d955dfa475508d28562fa596edb1ec4f8e4c62bae4ba9fb112d80"
70
+ },
71
+ {
72
+ "bytes": 5164580688,
73
+ "path": "transformer/diffusion_pytorch_model-00011-of-00014.safetensors",
74
+ "sha256": "32f04fe4184564b146f6214af8e80fb4b783a9dc1a9743282d61ef21745d3d3d"
75
+ },
76
+ {
77
+ "bytes": 5318721256,
78
+ "path": "transformer/diffusion_pytorch_model-00012-of-00014.safetensors",
79
+ "sha256": "903eccb1a1098e32f16a6979c27cbe87bf1dc304832173fc22e101b8ae3f8490"
80
+ },
81
+ {
82
+ "bytes": 5318721208,
83
+ "path": "transformer/diffusion_pytorch_model-00013-of-00014.safetensors",
84
+ "sha256": "018db4d6d8fe97c0e560d850ba5c275792ce0bfd33c8918caf6d198d758225ff"
85
+ },
86
+ {
87
+ "bytes": 2138941296,
88
+ "path": "transformer/diffusion_pytorch_model-00014-of-00014.safetensors",
89
+ "sha256": "160b0f5a830b332fb61be18c45e4d4ebab7829db7d8cb18302714c145819b8da"
90
+ },
91
+ {
92
+ "bytes": 70079,
93
+ "path": "transformer/diffusion_pytorch_model.safetensors.index.json",
94
+ "sha256": "5be1367650e2faf79edf1f106a8354d1a7ef2e3ff45df40c4514b4ae97e1136b"
95
+ }
96
+ ],
97
+ "schema_version": "fastvideo-checkpoint-content-identity-v1",
98
+ "shard_count": 14
99
+ }
checkpoint_metadata.json ADDED
@@ -0,0 +1,222 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "base_model_dir": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
3
+ "config": {
4
+ "callbacks": {
5
+ "grad_clip": {
6
+ "_target_": "fastvideo.train.callbacks.grad_clip.GradNormClipCallback",
7
+ "max_grad_norm": 1.0
8
+ },
9
+ "latent_vis": {
10
+ "_target_": "fastvideo.train.callbacks.latent_vis.LatentVisCallback",
11
+ "every_steps": 100,
12
+ "fps": 24
13
+ },
14
+ "validation": {
15
+ "_target_": "fastvideo.train.callbacks.validation.ValidationCallback",
16
+ "dataset_file": "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/validation/heldout60.json",
17
+ "every_steps": 100,
18
+ "guidance_scale": 1.0,
19
+ "max_record_num_frames": 345,
20
+ "num_videos_per_prompt": 1,
21
+ "offload_training_state": true,
22
+ "pipeline_target": "fastvideo.pipelines.basic.minimax_h3.minimax_h3_pipeline.MiniMaxH3Pipeline",
23
+ "run_at_start": true,
24
+ "sampling_steps": [
25
+ 8
26
+ ],
27
+ "sampling_timesteps": [
28
+ 999,
29
+ 874,
30
+ 749,
31
+ 624,
32
+ 500,
33
+ 375,
34
+ 250,
35
+ 125
36
+ ],
37
+ "text_encoder_cpu_offload": true,
38
+ "use_record_dimensions": true,
39
+ "use_validation_media_conditioning": false,
40
+ "vae_cpu_offload": true
41
+ }
42
+ },
43
+ "method": {
44
+ "_target_": "fastvideo.train.methods.distribution_matching.dmd2.DMD2Method",
45
+ "cfg_uncond": {
46
+ "text": "zero"
47
+ },
48
+ "dmd_denoising_steps": [
49
+ 999,
50
+ 874,
51
+ 749,
52
+ 624,
53
+ 500,
54
+ 375,
55
+ 250,
56
+ 125
57
+ ],
58
+ "fake_score_betas": [
59
+ 0.9,
60
+ 0.999
61
+ ],
62
+ "fake_score_learning_rate": 2e-06,
63
+ "fake_score_loss_space": "x0",
64
+ "fake_score_lr_scheduler": "constant",
65
+ "generator_update_interval": 5,
66
+ "max_timestep_ratio": 0.999,
67
+ "min_timestep_ratio": 0.001,
68
+ "real_score_guidance_scale": 1.0,
69
+ "rollout_carry": true,
70
+ "rollout_carry_slots": 4,
71
+ "rollout_mode": "simulate",
72
+ "rollout_sample_type": "ode",
73
+ "score_timestep_continuous": true,
74
+ "score_timestep_shift": 2.4,
75
+ "score_timestep_warp_max": 0.999
76
+ },
77
+ "models": {
78
+ "critic": {
79
+ "_target_": "fastvideo.train.models.minimax_h3.MiniMaxH3DMDModel",
80
+ "attention_backend": "FLASH_ATTN",
81
+ "disable_custom_init_weights": true,
82
+ "enable_gradient_checkpointing_type": "full",
83
+ "init_from": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
84
+ "trainable": true
85
+ },
86
+ "student": {
87
+ "_target_": "fastvideo.train.models.minimax_h3.MiniMaxH3DMDModel",
88
+ "attention_backend": "VIDEO_SPARSE_ATTN_H3",
89
+ "enable_gradient_checkpointing_type": "full",
90
+ "init_from": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
91
+ "trainable": true
92
+ },
93
+ "teacher": {
94
+ "_target_": "fastvideo.train.models.minimax_h3.MiniMaxH3DMDModel",
95
+ "attention_backend": "FLASH_ATTN",
96
+ "disable_custom_init_weights": true,
97
+ "init_from": "/mnt/lustre/vlm-k1kong/models/MiniMax-H3",
98
+ "trainable": false
99
+ }
100
+ },
101
+ "pipeline": {
102
+ "audio_scheduler_shift": 3.0,
103
+ "dit_config": {
104
+ "uniform_parameter_dtype": false
105
+ },
106
+ "video_scheduler_shift": 10.0
107
+ },
108
+ "training": {
109
+ "checkpoint": {
110
+ "checkpointing_start_step": 100,
111
+ "checkpoints_total_limit": 3,
112
+ "inference_checkpoint_dtype": "bfloat16",
113
+ "inference_checkpoint_role": "student",
114
+ "output_dir": "/mnt/lustre/vlm-wlsaidhi/fastvideo/outputs/minimax_h3_dmd2_sp4_fsdp64_v14_datafree_mixed_vsa80_8step_vshift10",
115
+ "require_complete_training_checkpoint": true,
116
+ "resume_from_checkpoint": "latest",
117
+ "save_inference_checkpoint_on_validation": true,
118
+ "training_state_checkpointing_steps": 100
119
+ },
120
+ "data": {
121
+ "data_path": [
122
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_nuva_50k_720_mixed_len/data",
123
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_5s_768p/data",
124
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_nuva_10k_720_mixed_len/data",
125
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_video_nuva_10k_mixed_res_len/data",
126
+ "/mnt/lustre/vlm-shared/h3_t2av_preprocessed/v10_mixed_native_v3/h3_t2av_fastgen_vidprom_150k/data"
127
+ ],
128
+ "dataloader_num_workers": 0,
129
+ "native_shape_bucketing": true,
130
+ "num_frames": 124,
131
+ "num_height": 768,
132
+ "num_latent_t": 37,
133
+ "num_width": 1344,
134
+ "preprocessed_data_type": "text_only",
135
+ "seed": 42,
136
+ "train_batch_size": 1,
137
+ "training_cfg_rate": 0.0
138
+ },
139
+ "distributed": {
140
+ "hsdp_replicate_dim": 1,
141
+ "hsdp_shard_dim": 64,
142
+ "num_gpus": 64,
143
+ "sp_size": 4,
144
+ "tp_size": 1
145
+ },
146
+ "dit_precision": "fp32",
147
+ "loop": {
148
+ "gradient_accumulation_steps": 4,
149
+ "max_train_steps": 4000
150
+ },
151
+ "model": {
152
+ "enable_gradient_checkpointing_type": "full",
153
+ "enable_torch_compile": true,
154
+ "precondition_outputs": false,
155
+ "torch_compile_kwargs": {
156
+ "dynamic": true,
157
+ "recompile_limit": 32
158
+ }
159
+ },
160
+ "optimizer": {
161
+ "betas": [
162
+ 0.9,
163
+ 0.999
164
+ ],
165
+ "learning_rate": 2e-06,
166
+ "lr_scheduler": "constant",
167
+ "lr_warmup_steps": 0,
168
+ "weight_decay": 0.01
169
+ },
170
+ "tracker": {
171
+ "project_name": "h3-dmd2-vsa",
172
+ "run_name": "dmd2_sp4_fsdp64_v14_datafree_mixed_vsa80_8step_vshift10"
173
+ },
174
+ "vsa": {
175
+ "sparsity": 0.8,
176
+ "tile_size": 64
177
+ }
178
+ }
179
+ },
180
+ "dtype": "bfloat16",
181
+ "format_version": 1,
182
+ "kind": "inference",
183
+ "max_shard_size_bytes": 5368709120,
184
+ "module": "transformer",
185
+ "role": "student",
186
+ "shard_count": 14,
187
+ "shard_file_sizes": [
188
+ 5331008552,
189
+ 5318721256,
190
+ 5318721248,
191
+ 4875566048,
192
+ 5318505992,
193
+ 5164580688,
194
+ 5318721240,
195
+ 5318721248,
196
+ 4875566056,
197
+ 5318505984,
198
+ 5164580688,
199
+ 5318721256,
200
+ 5318721208,
201
+ 2138941296
202
+ ],
203
+ "shard_sizes": [
204
+ 5331000320,
205
+ 5318715392,
206
+ 5318715392,
207
+ 4875560448,
208
+ 5318500352,
209
+ 5164574720,
210
+ 5318715392,
211
+ 5318715392,
212
+ 4875560448,
213
+ 5318500352,
214
+ 5164574720,
215
+ 5318715392,
216
+ 5318715392,
217
+ 2138938880
218
+ ],
219
+ "step": 1300,
220
+ "tensor_count": 688,
221
+ "total_size": 70099502592
222
+ }
fastvideo_inference.json ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "attention_backend": "VIDEO_SPARSE_ATTN_H3",
3
+ "audio_scheduler_shift": 3.0,
4
+ "checkpoint_content_sha256": "516323fa396fa5dff4e82669d4e9a08a5791692a3d3b98ff6bc3de3fc6a33d11",
5
+ "checkpoint_metadata_sha256": "ca9f2d609c05742ba465d24989981ec02cca26acb6ca2f163dc0f6dc8d11c27b",
6
+ "checkpoint_step": 1300,
7
+ "dmd_denoising_steps": [
8
+ 999,
9
+ 874,
10
+ 749,
11
+ 624,
12
+ 500,
13
+ 375,
14
+ 250,
15
+ 125
16
+ ],
17
+ "fastvideo_commit": "24bbe7fddd05ca6f2c34b3dbed06ac1c75b72086",
18
+ "guidance_scale": 1.0,
19
+ "model_id": "FastVideo/FastVideo-FastH3-8-Step-V2",
20
+ "num_gpus": 4,
21
+ "num_inference_steps": 9,
22
+ "schema_version": "fasth3-inference-contract-v1",
23
+ "sequence_parallel_size": 4,
24
+ "task": "t2av",
25
+ "torch_compile": false,
26
+ "training_parent_run_id": "20260829T210445Z-h3-v14-8step-datafree-vsa80-vshift10",
27
+ "transformer_forwards": 8,
28
+ "use_fsdp_inference": true,
29
+ "video_scheduler_shift": 10.0,
30
+ "vsa_kernel": "sm100a",
31
+ "vsa_sparsity": 0.8,
32
+ "vsa_tile_size": 64
33
+ }
modelopt_manifest.json ADDED
@@ -0,0 +1,523 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "calibration": {
3
+ "activation_block_scale": "runtime dynamic K16 encoding",
4
+ "activation_global_scale": "ModelOpt NVFP4 activation headroom calibration",
5
+ "denoising_forwards_per_record": 8,
6
+ "records": 1000,
7
+ "sample_sha256": "5baf06f8a8a811d4021efd4b372e984d3a8a5ea71912b150d80ace804046dd90",
8
+ "weight_scale": "static MSE, complete E4M3 scale sweep"
9
+ },
10
+ "components": {
11
+ "denoiser": {
12
+ "enabled": true,
13
+ "excluded_patterns": [
14
+ "attention",
15
+ "token_refiner",
16
+ "adaln",
17
+ "norm",
18
+ "latent_heads"
19
+ ],
20
+ "modules": {
21
+ "denoiser.transformer.layers.0.mlp.down": {
22
+ "activation_amax": 2462.01708984375
23
+ },
24
+ "denoiser.transformer.layers.0.mlp.gate_up.projections.gate": {
25
+ "activation_amax": 747.9899291992188
26
+ },
27
+ "denoiser.transformer.layers.0.mlp.gate_up.projections.up": {
28
+ "activation_amax": 747.9899291992188
29
+ },
30
+ "denoiser.transformer.layers.1.mlp.down": {
31
+ "activation_amax": 1285.5098876953125
32
+ },
33
+ "denoiser.transformer.layers.1.mlp.gate_up.projections.gate": {
34
+ "activation_amax": 671.212158203125
35
+ },
36
+ "denoiser.transformer.layers.1.mlp.gate_up.projections.up": {
37
+ "activation_amax": 671.212158203125
38
+ },
39
+ "denoiser.transformer.layers.10.mlp.down": {
40
+ "activation_amax": 5855.6962890625
41
+ },
42
+ "denoiser.transformer.layers.10.mlp.gate_up.projections.gate": {
43
+ "activation_amax": 2743.63916015625
44
+ },
45
+ "denoiser.transformer.layers.10.mlp.gate_up.projections.up": {
46
+ "activation_amax": 2743.63916015625
47
+ },
48
+ "denoiser.transformer.layers.11.mlp.down": {
49
+ "activation_amax": 6525.51025390625
50
+ },
51
+ "denoiser.transformer.layers.11.mlp.gate_up.projections.gate": {
52
+ "activation_amax": 2743.63916015625
53
+ },
54
+ "denoiser.transformer.layers.11.mlp.gate_up.projections.up": {
55
+ "activation_amax": 2743.63916015625
56
+ },
57
+ "denoiser.transformer.layers.12.mlp.down": {
58
+ "activation_amax": 6525.51025390625
59
+ },
60
+ "denoiser.transformer.layers.12.mlp.gate_up.projections.gate": {
61
+ "activation_amax": 2743.63916015625
62
+ },
63
+ "denoiser.transformer.layers.12.mlp.gate_up.projections.up": {
64
+ "activation_amax": 2743.63916015625
65
+ },
66
+ "denoiser.transformer.layers.13.mlp.down": {
67
+ "activation_amax": 6525.51025390625
68
+ },
69
+ "denoiser.transformer.layers.13.mlp.gate_up.projections.gate": {
70
+ "activation_amax": 3057.47509765625
71
+ },
72
+ "denoiser.transformer.layers.13.mlp.gate_up.projections.up": {
73
+ "activation_amax": 3057.47509765625
74
+ },
75
+ "denoiser.transformer.layers.14.mlp.down": {
76
+ "activation_amax": 6525.51025390625
77
+ },
78
+ "denoiser.transformer.layers.14.mlp.gate_up.projections.gate": {
79
+ "activation_amax": 2743.63916015625
80
+ },
81
+ "denoiser.transformer.layers.14.mlp.gate_up.projections.up": {
82
+ "activation_amax": 2743.63916015625
83
+ },
84
+ "denoiser.transformer.layers.15.mlp.down": {
85
+ "activation_amax": 6525.51025390625
86
+ },
87
+ "denoiser.transformer.layers.15.mlp.gate_up.projections.gate": {
88
+ "activation_amax": 2743.63916015625
89
+ },
90
+ "denoiser.transformer.layers.15.mlp.gate_up.projections.up": {
91
+ "activation_amax": 2743.63916015625
92
+ },
93
+ "denoiser.transformer.layers.16.mlp.down": {
94
+ "activation_amax": 6525.51025390625
95
+ },
96
+ "denoiser.transformer.layers.16.mlp.gate_up.projections.gate": {
97
+ "activation_amax": 3407.209716796875
98
+ },
99
+ "denoiser.transformer.layers.16.mlp.gate_up.projections.up": {
100
+ "activation_amax": 3407.209716796875
101
+ },
102
+ "denoiser.transformer.layers.17.mlp.down": {
103
+ "activation_amax": 9030.7177734375
104
+ },
105
+ "denoiser.transformer.layers.17.mlp.gate_up.projections.gate": {
106
+ "activation_amax": 3057.47509765625
107
+ },
108
+ "denoiser.transformer.layers.17.mlp.gate_up.projections.up": {
109
+ "activation_amax": 3057.47509765625
110
+ },
111
+ "denoiser.transformer.layers.18.mlp.down": {
112
+ "activation_amax": 9030.7177734375
113
+ },
114
+ "denoiser.transformer.layers.18.mlp.gate_up.projections.gate": {
115
+ "activation_amax": 2743.63916015625
116
+ },
117
+ "denoiser.transformer.layers.18.mlp.gate_up.projections.up": {
118
+ "activation_amax": 2743.63916015625
119
+ },
120
+ "denoiser.transformer.layers.19.mlp.down": {
121
+ "activation_amax": 9030.7177734375
122
+ },
123
+ "denoiser.transformer.layers.19.mlp.gate_up.projections.gate": {
124
+ "activation_amax": 2743.63916015625
125
+ },
126
+ "denoiser.transformer.layers.19.mlp.gate_up.projections.up": {
127
+ "activation_amax": 2743.63916015625
128
+ },
129
+ "denoiser.transformer.layers.2.mlp.down": {
130
+ "activation_amax": 3796.94921875
131
+ },
132
+ "denoiser.transformer.layers.2.mlp.gate_up.projections.gate": {
133
+ "activation_amax": 1153.55810546875
134
+ },
135
+ "denoiser.transformer.layers.2.mlp.gate_up.projections.up": {
136
+ "activation_amax": 1153.55810546875
137
+ },
138
+ "denoiser.transformer.layers.20.mlp.down": {
139
+ "activation_amax": 10063.712890625
140
+ },
141
+ "denoiser.transformer.layers.20.mlp.gate_up.projections.gate": {
142
+ "activation_amax": 3057.47509765625
143
+ },
144
+ "denoiser.transformer.layers.20.mlp.gate_up.projections.up": {
145
+ "activation_amax": 3057.47509765625
146
+ },
147
+ "denoiser.transformer.layers.21.mlp.down": {
148
+ "activation_amax": 10063.712890625
149
+ },
150
+ "denoiser.transformer.layers.21.mlp.gate_up.projections.gate": {
151
+ "activation_amax": 3057.47509765625
152
+ },
153
+ "denoiser.transformer.layers.21.mlp.gate_up.projections.up": {
154
+ "activation_amax": 3057.47509765625
155
+ },
156
+ "denoiser.transformer.layers.22.mlp.down": {
157
+ "activation_amax": 10063.712890625
158
+ },
159
+ "denoiser.transformer.layers.22.mlp.gate_up.projections.gate": {
160
+ "activation_amax": 3407.209716796875
161
+ },
162
+ "denoiser.transformer.layers.22.mlp.gate_up.projections.up": {
163
+ "activation_amax": 3407.209716796875
164
+ },
165
+ "denoiser.transformer.layers.23.mlp.down": {
166
+ "activation_amax": 12497.7001953125
167
+ },
168
+ "denoiser.transformer.layers.23.mlp.gate_up.projections.gate": {
169
+ "activation_amax": 3407.209716796875
170
+ },
171
+ "denoiser.transformer.layers.23.mlp.gate_up.projections.up": {
172
+ "activation_amax": 3407.209716796875
173
+ },
174
+ "denoiser.transformer.layers.24.mlp.down": {
175
+ "activation_amax": 13927.271484375
176
+ },
177
+ "denoiser.transformer.layers.24.mlp.gate_up.projections.gate": {
178
+ "activation_amax": 3796.94921875
179
+ },
180
+ "denoiser.transformer.layers.24.mlp.gate_up.projections.up": {
181
+ "activation_amax": 3796.94921875
182
+ },
183
+ "denoiser.transformer.layers.25.mlp.down": {
184
+ "activation_amax": 19274.087890625
185
+ },
186
+ "denoiser.transformer.layers.25.mlp.gate_up.projections.gate": {
187
+ "activation_amax": 3796.94921875
188
+ },
189
+ "denoiser.transformer.layers.25.mlp.gate_up.projections.up": {
190
+ "activation_amax": 3796.94921875
191
+ },
192
+ "denoiser.transformer.layers.26.mlp.down": {
193
+ "activation_amax": 21478.7890625
194
+ },
195
+ "denoiser.transformer.layers.26.mlp.gate_up.projections.gate": {
196
+ "activation_amax": 4231.27001953125
197
+ },
198
+ "denoiser.transformer.layers.26.mlp.gate_up.projections.up": {
199
+ "activation_amax": 4231.27001953125
200
+ },
201
+ "denoiser.transformer.layers.27.mlp.down": {
202
+ "activation_amax": 29724.70703125
203
+ },
204
+ "denoiser.transformer.layers.27.mlp.gate_up.projections.gate": {
205
+ "activation_amax": 4715.27099609375
206
+ },
207
+ "denoiser.transformer.layers.27.mlp.gate_up.projections.up": {
208
+ "activation_amax": 4715.27099609375
209
+ },
210
+ "denoiser.transformer.layers.28.mlp.down": {
211
+ "activation_amax": 45841.765625
212
+ },
213
+ "denoiser.transformer.layers.28.mlp.gate_up.projections.gate": {
214
+ "activation_amax": 4715.27099609375
215
+ },
216
+ "denoiser.transformer.layers.28.mlp.gate_up.projections.up": {
217
+ "activation_amax": 4715.27099609375
218
+ },
219
+ "denoiser.transformer.layers.29.mlp.down": {
220
+ "activation_amax": 56928.95703125
221
+ },
222
+ "denoiser.transformer.layers.29.mlp.gate_up.projections.gate": {
223
+ "activation_amax": 4715.27099609375
224
+ },
225
+ "denoiser.transformer.layers.29.mlp.gate_up.projections.up": {
226
+ "activation_amax": 4715.27099609375
227
+ },
228
+ "denoiser.transformer.layers.3.mlp.down": {
229
+ "activation_amax": 4715.27099609375
230
+ },
231
+ "denoiser.transformer.layers.3.mlp.gate_up.projections.gate": {
232
+ "activation_amax": 1153.55810546875
233
+ },
234
+ "denoiser.transformer.layers.3.mlp.gate_up.projections.up": {
235
+ "activation_amax": 1153.55810546875
236
+ },
237
+ "denoiser.transformer.layers.30.mlp.down": {
238
+ "activation_amax": 78784.546875
239
+ },
240
+ "denoiser.transformer.layers.30.mlp.gate_up.projections.gate": {
241
+ "activation_amax": 5254.6357421875
242
+ },
243
+ "denoiser.transformer.layers.30.mlp.gate_up.projections.up": {
244
+ "activation_amax": 5254.6357421875
245
+ },
246
+ "denoiser.transformer.layers.31.mlp.down": {
247
+ "activation_amax": 109030.7109375
248
+ },
249
+ "denoiser.transformer.layers.31.mlp.gate_up.projections.gate": {
250
+ "activation_amax": 5254.6357421875
251
+ },
252
+ "denoiser.transformer.layers.31.mlp.gate_up.projections.up": {
253
+ "activation_amax": 5254.6357421875
254
+ },
255
+ "denoiser.transformer.layers.32.mlp.down": {
256
+ "activation_amax": 135400.640625
257
+ },
258
+ "denoiser.transformer.layers.32.mlp.gate_up.projections.gate": {
259
+ "activation_amax": 5855.6962890625
260
+ },
261
+ "denoiser.transformer.layers.32.mlp.gate_up.projections.up": {
262
+ "activation_amax": 5855.6962890625
263
+ },
264
+ "denoiser.transformer.layers.33.mlp.down": {
265
+ "activation_amax": 168148.34375
266
+ },
267
+ "denoiser.transformer.layers.33.mlp.gate_up.projections.gate": {
268
+ "activation_amax": 5855.6962890625
269
+ },
270
+ "denoiser.transformer.layers.33.mlp.gate_up.projections.up": {
271
+ "activation_amax": 5855.6962890625
272
+ },
273
+ "denoiser.transformer.layers.34.mlp.down": {
274
+ "activation_amax": 168148.34375
275
+ },
276
+ "denoiser.transformer.layers.34.mlp.gate_up.projections.gate": {
277
+ "activation_amax": 6525.51025390625
278
+ },
279
+ "denoiser.transformer.layers.34.mlp.gate_up.projections.up": {
280
+ "activation_amax": 6525.51025390625
281
+ },
282
+ "denoiser.transformer.layers.35.mlp.down": {
283
+ "activation_amax": 232702.140625
284
+ },
285
+ "denoiser.transformer.layers.35.mlp.gate_up.projections.gate": {
286
+ "activation_amax": 6525.51025390625
287
+ },
288
+ "denoiser.transformer.layers.35.mlp.gate_up.projections.up": {
289
+ "activation_amax": 6525.51025390625
290
+ },
291
+ "denoiser.transformer.layers.36.mlp.down": {
292
+ "activation_amax": 232702.140625
293
+ },
294
+ "denoiser.transformer.layers.36.mlp.gate_up.projections.gate": {
295
+ "activation_amax": 6525.51025390625
296
+ },
297
+ "denoiser.transformer.layers.36.mlp.gate_up.projections.up": {
298
+ "activation_amax": 6525.51025390625
299
+ },
300
+ "denoiser.transformer.layers.37.mlp.down": {
301
+ "activation_amax": 208816.328125
302
+ },
303
+ "denoiser.transformer.layers.37.mlp.gate_up.projections.gate": {
304
+ "activation_amax": 6525.51025390625
305
+ },
306
+ "denoiser.transformer.layers.37.mlp.gate_up.projections.up": {
307
+ "activation_amax": 6525.51025390625
308
+ },
309
+ "denoiser.transformer.layers.38.mlp.down": {
310
+ "activation_amax": 288982.96875
311
+ },
312
+ "denoiser.transformer.layers.38.mlp.gate_up.projections.gate": {
313
+ "activation_amax": 6525.51025390625
314
+ },
315
+ "denoiser.transformer.layers.38.mlp.gate_up.projections.up": {
316
+ "activation_amax": 6525.51025390625
317
+ },
318
+ "denoiser.transformer.layers.39.mlp.down": {
319
+ "activation_amax": 358875.78125
320
+ },
321
+ "denoiser.transformer.layers.39.mlp.gate_up.projections.gate": {
322
+ "activation_amax": 7271.94189453125
323
+ },
324
+ "denoiser.transformer.layers.39.mlp.gate_up.projections.up": {
325
+ "activation_amax": 7271.94189453125
326
+ },
327
+ "denoiser.transformer.layers.4.mlp.down": {
328
+ "activation_amax": 4715.27099609375
329
+ },
330
+ "denoiser.transformer.layers.4.mlp.gate_up.projections.gate": {
331
+ "activation_amax": 1285.5098876953125
332
+ },
333
+ "denoiser.transformer.layers.4.mlp.gate_up.projections.up": {
334
+ "activation_amax": 1285.5098876953125
335
+ },
336
+ "denoiser.transformer.layers.40.mlp.down": {
337
+ "activation_amax": 445672.6875
338
+ },
339
+ "denoiser.transformer.layers.40.mlp.gate_up.projections.gate": {
340
+ "activation_amax": 7271.94189453125
341
+ },
342
+ "denoiser.transformer.layers.40.mlp.gate_up.projections.up": {
343
+ "activation_amax": 7271.94189453125
344
+ },
345
+ "denoiser.transformer.layers.41.mlp.down": {
346
+ "activation_amax": 496651.71875
347
+ },
348
+ "denoiser.transformer.layers.41.mlp.gate_up.projections.gate": {
349
+ "activation_amax": 8103.755859375
350
+ },
351
+ "denoiser.transformer.layers.41.mlp.gate_up.projections.up": {
352
+ "activation_amax": 8103.755859375
353
+ },
354
+ "denoiser.transformer.layers.42.mlp.down": {
355
+ "activation_amax": 616770.8125
356
+ },
357
+ "denoiser.transformer.layers.42.mlp.gate_up.projections.gate": {
358
+ "activation_amax": 9030.7177734375
359
+ },
360
+ "denoiser.transformer.layers.42.mlp.gate_up.projections.up": {
361
+ "activation_amax": 9030.7177734375
362
+ },
363
+ "denoiser.transformer.layers.43.mlp.down": {
364
+ "activation_amax": 616770.8125
365
+ },
366
+ "denoiser.transformer.layers.43.mlp.gate_up.projections.gate": {
367
+ "activation_amax": 9030.7177734375
368
+ },
369
+ "denoiser.transformer.layers.43.mlp.gate_up.projections.up": {
370
+ "activation_amax": 9030.7177734375
371
+ },
372
+ "denoiser.transformer.layers.44.mlp.down": {
373
+ "activation_amax": 687321.25
374
+ },
375
+ "denoiser.transformer.layers.44.mlp.gate_up.projections.gate": {
376
+ "activation_amax": 10063.712890625
377
+ },
378
+ "denoiser.transformer.layers.44.mlp.gate_up.projections.up": {
379
+ "activation_amax": 10063.712890625
380
+ },
381
+ "denoiser.transformer.layers.45.mlp.down": {
382
+ "activation_amax": 853555.25
383
+ },
384
+ "denoiser.transformer.layers.45.mlp.gate_up.projections.gate": {
385
+ "activation_amax": 11214.8681640625
386
+ },
387
+ "denoiser.transformer.layers.45.mlp.gate_up.projections.up": {
388
+ "activation_amax": 11214.8681640625
389
+ },
390
+ "denoiser.transformer.layers.46.mlp.down": {
391
+ "activation_amax": 1059994.25
392
+ },
393
+ "denoiser.transformer.layers.46.mlp.gate_up.projections.gate": {
394
+ "activation_amax": 12497.7001953125
395
+ },
396
+ "denoiser.transformer.layers.46.mlp.gate_up.projections.up": {
397
+ "activation_amax": 12497.7001953125
398
+ },
399
+ "denoiser.transformer.layers.47.mlp.down": {
400
+ "activation_amax": 1316362.125
401
+ },
402
+ "denoiser.transformer.layers.47.mlp.gate_up.projections.gate": {
403
+ "activation_amax": 13927.271484375
404
+ },
405
+ "denoiser.transformer.layers.47.mlp.gate_up.projections.up": {
406
+ "activation_amax": 13927.271484375
407
+ },
408
+ "denoiser.transformer.layers.48.mlp.down": {
409
+ "activation_amax": 2030107.875
410
+ },
411
+ "denoiser.transformer.layers.48.mlp.gate_up.projections.gate": {
412
+ "activation_amax": 17295.69140625
413
+ },
414
+ "denoiser.transformer.layers.48.mlp.gate_up.projections.up": {
415
+ "activation_amax": 17295.69140625
416
+ },
417
+ "denoiser.transformer.layers.49.mlp.down": {
418
+ "activation_amax": 2809486.5
419
+ },
420
+ "denoiser.transformer.layers.49.mlp.gate_up.projections.gate": {
421
+ "activation_amax": 19274.087890625
422
+ },
423
+ "denoiser.transformer.layers.49.mlp.gate_up.projections.up": {
424
+ "activation_amax": 19274.087890625
425
+ },
426
+ "denoiser.transformer.layers.5.mlp.down": {
427
+ "activation_amax": 5254.6357421875
428
+ },
429
+ "denoiser.transformer.layers.5.mlp.gate_up.projections.gate": {
430
+ "activation_amax": 2209.302001953125
431
+ },
432
+ "denoiser.transformer.layers.5.mlp.gate_up.projections.up": {
433
+ "activation_amax": 2209.302001953125
434
+ },
435
+ "denoiser.transformer.layers.6.mlp.down": {
436
+ "activation_amax": 5254.6357421875
437
+ },
438
+ "denoiser.transformer.layers.6.mlp.gate_up.projections.gate": {
439
+ "activation_amax": 2209.302001953125
440
+ },
441
+ "denoiser.transformer.layers.6.mlp.gate_up.projections.up": {
442
+ "activation_amax": 2209.302001953125
443
+ },
444
+ "denoiser.transformer.layers.7.mlp.down": {
445
+ "activation_amax": 4715.27099609375
446
+ },
447
+ "denoiser.transformer.layers.7.mlp.gate_up.projections.gate": {
448
+ "activation_amax": 2462.01708984375
449
+ },
450
+ "denoiser.transformer.layers.7.mlp.gate_up.projections.up": {
451
+ "activation_amax": 2462.01708984375
452
+ },
453
+ "denoiser.transformer.layers.8.mlp.down": {
454
+ "activation_amax": 5855.6962890625
455
+ },
456
+ "denoiser.transformer.layers.8.mlp.gate_up.projections.gate": {
457
+ "activation_amax": 2462.01708984375
458
+ },
459
+ "denoiser.transformer.layers.8.mlp.gate_up.projections.up": {
460
+ "activation_amax": 2462.01708984375
461
+ },
462
+ "denoiser.transformer.layers.9.mlp.down": {
463
+ "activation_amax": 5855.6962890625
464
+ },
465
+ "denoiser.transformer.layers.9.mlp.gate_up.projections.gate": {
466
+ "activation_amax": 2743.63916015625
467
+ },
468
+ "denoiser.transformer.layers.9.mlp.gate_up.projections.up": {
469
+ "activation_amax": 2743.63916015625
470
+ }
471
+ },
472
+ "quantized_patterns": [
473
+ "transformer_blocks.*.ff.net.0.proj",
474
+ "transformer_blocks.*.ff.net.2"
475
+ ]
476
+ },
477
+ "text_encoder": {
478
+ "enabled": false,
479
+ "excluded_patterns": [
480
+ "attention",
481
+ "embedding",
482
+ "norm",
483
+ "rope",
484
+ "softmax",
485
+ "checkpoint_layers.50:64",
486
+ "conditioning_output"
487
+ ],
488
+ "modules": {},
489
+ "quantized_patterns": [
490
+ "retained_layers.0:50.mlp.{gate,up,down}"
491
+ ]
492
+ },
493
+ "video_vae": {
494
+ "enabled": false,
495
+ "excluded_patterns": [
496
+ "post_quant_conv",
497
+ "decoder_boundaries",
498
+ "conv",
499
+ "norm",
500
+ "rope",
501
+ "softmax",
502
+ "residual",
503
+ "affine",
504
+ "pixel_postprocess"
505
+ ],
506
+ "modules": {},
507
+ "quantized_patterns": [
508
+ "decoder.transformer_blocks.*.{q,k,v,out,gate,up,down}"
509
+ ]
510
+ }
511
+ },
512
+ "modelopt_commit": "6a4b3f147e14a6fec690fedbced8df402344085d",
513
+ "numerical_format": {
514
+ "activation": "a4",
515
+ "block_scale": "fp8_e4m3",
516
+ "block_size": 16,
517
+ "output": "bf16",
518
+ "tensor_scale": "fp32",
519
+ "values": "e2m1",
520
+ "weight": "w4"
521
+ },
522
+ "schema_version": 1
523
+ }
modular_model_index.json ADDED
@@ -0,0 +1,131 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_blocks_class_name": "MiniMaxH3Blocks",
3
+ "_class_name": "MiniMaxH3ModularPipeline",
4
+ "_diffusers_version": "0.36.0.dev0",
5
+ "audio_scheduler": [
6
+ "diffusers",
7
+ "MiniMaxH3Scheduler",
8
+ {
9
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
10
+ "revision": null,
11
+ "subfolder": "audio_scheduler",
12
+ "type_hint": [
13
+ "diffusers",
14
+ "MiniMaxH3Scheduler"
15
+ ],
16
+ "variant": null
17
+ }
18
+ ],
19
+ "audio_vae": [
20
+ "diffusers",
21
+ "AutoencoderKLMiniMaxH3Audio",
22
+ {
23
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
24
+ "revision": null,
25
+ "subfolder": "audio_vae",
26
+ "type_hint": [
27
+ "diffusers",
28
+ "AutoencoderKLMiniMaxH3Audio"
29
+ ],
30
+ "variant": null
31
+ }
32
+ ],
33
+ "processor": [
34
+ "transformers",
35
+ "Qwen3VLProcessor",
36
+ {
37
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
38
+ "revision": null,
39
+ "subfolder": "processor",
40
+ "type_hint": [
41
+ "transformers",
42
+ "Qwen3VLProcessor"
43
+ ],
44
+ "variant": null
45
+ }
46
+ ],
47
+ "scheduler": [
48
+ "diffusers",
49
+ "MiniMaxH3Scheduler",
50
+ {
51
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
52
+ "revision": null,
53
+ "subfolder": "scheduler",
54
+ "type_hint": [
55
+ "diffusers",
56
+ "MiniMaxH3Scheduler"
57
+ ],
58
+ "variant": null
59
+ }
60
+ ],
61
+ "text_encoder": [
62
+ "transformers",
63
+ "Qwen3VLForConditionalGeneration",
64
+ {
65
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
66
+ "revision": null,
67
+ "subfolder": "text_encoder",
68
+ "type_hint": [
69
+ "transformers",
70
+ "Qwen3VLForConditionalGeneration"
71
+ ],
72
+ "variant": null
73
+ }
74
+ ],
75
+ "tokenizer": [
76
+ "transformers",
77
+ "Qwen2TokenizerFast",
78
+ {
79
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
80
+ "revision": null,
81
+ "subfolder": "tokenizer",
82
+ "type_hint": [
83
+ "transformers",
84
+ "Qwen2TokenizerFast"
85
+ ],
86
+ "variant": null
87
+ }
88
+ ],
89
+ "transformer": [
90
+ "diffusers",
91
+ "MiniMaxH3Transformer3DModel",
92
+ {
93
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
94
+ "revision": null,
95
+ "subfolder": "transformer",
96
+ "type_hint": [
97
+ "diffusers",
98
+ "MiniMaxH3Transformer3DModel"
99
+ ],
100
+ "variant": null
101
+ }
102
+ ],
103
+ "transformer_ref": [
104
+ "diffusers",
105
+ "MiniMaxH3Transformer3DModel",
106
+ {
107
+ "pretrained_model_name_or_path": "MiniMaxAI/MiniMax-H3",
108
+ "revision": null,
109
+ "subfolder": "transformer_ref",
110
+ "type_hint": [
111
+ "diffusers",
112
+ "MiniMaxH3Transformer3DModel"
113
+ ],
114
+ "variant": null
115
+ }
116
+ ],
117
+ "vae": [
118
+ "diffusers",
119
+ "AutoencoderKLMiniMaxH3",
120
+ {
121
+ "pretrained_model_name_or_path": "FastVideo/FastVideo-FastH3-8-Step-V2",
122
+ "revision": null,
123
+ "subfolder": "vae",
124
+ "type_hint": [
125
+ "diffusers",
126
+ "AutoencoderKLMiniMaxH3"
127
+ ],
128
+ "variant": null
129
+ }
130
+ ]
131
+ }
processor/chat_template.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n"
3
+ }
processor/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
processor/preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 16777216,
4
+ "shortest_edge": 65536
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "image_processor_type": "Qwen2VLImageProcessorFast"
21
+ }
processor/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
processor/tokenizer_config.json ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>",
228
+ "<d>",
229
+ "</d>",
230
+ "<|cutoff|>",
231
+ "<|lyrics_start|>",
232
+ "<|lyrics_end|>",
233
+ "<|caption_start|>",
234
+ "<|caption_end|>"
235
+ ],
236
+ "bos_token": null,
237
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
238
+ "clean_up_tokenization_spaces": false,
239
+ "eos_token": "<|im_end|>",
240
+ "errors": "replace",
241
+ "model_max_length": 262144,
242
+ "pad_token": "<|endoftext|>",
243
+ "split_special_tokens": false,
244
+ "tokenizer_class": "Qwen2Tokenizer",
245
+ "unk_token": null
246
+ }
processor/video_preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 25165824,
4
+ "shortest_edge": 4096
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "video_processor_type": "Qwen3VLVideoProcessor"
21
+ }
processor/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "MiniMaxH3Scheduler",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "shift": 10.0
5
+ }
text_encoder/chat_template.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n"
3
+ }
text_encoder/config.json ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3VLForConditionalGeneration"
4
+ ],
5
+ "image_token_id": 151655,
6
+ "model_type": "qwen3_vl",
7
+ "text_config": {
8
+ "attention_bias": false,
9
+ "attention_dropout": 0.0,
10
+ "bos_token_id": 151643,
11
+ "dtype": "bfloat16",
12
+ "eos_token_id": 151645,
13
+ "head_dim": 128,
14
+ "hidden_act": "silu",
15
+ "hidden_size": 5120,
16
+ "initializer_range": 0.02,
17
+ "intermediate_size": 25600,
18
+ "max_position_embeddings": 262144,
19
+ "model_type": "qwen3_vl_text",
20
+ "num_attention_heads": 64,
21
+ "num_hidden_layers": 64,
22
+ "num_key_value_heads": 8,
23
+ "rms_norm_eps": 1e-06,
24
+ "rope_scaling": {
25
+ "mrope_interleaved": true,
26
+ "mrope_section": [
27
+ 24,
28
+ 20,
29
+ 20
30
+ ],
31
+ "rope_type": "default"
32
+ },
33
+ "rope_theta": 5000000,
34
+ "use_cache": true,
35
+ "vocab_size": 151936
36
+ },
37
+ "tie_word_embeddings": false,
38
+ "transformers_version": "4.57.0.dev0",
39
+ "video_token_id": 151656,
40
+ "vision_config": {
41
+ "deepstack_visual_indexes": [
42
+ 8,
43
+ 16,
44
+ 24
45
+ ],
46
+ "depth": 27,
47
+ "hidden_act": "gelu_pytorch_tanh",
48
+ "hidden_size": 1152,
49
+ "in_channels": 3,
50
+ "initializer_range": 0.02,
51
+ "intermediate_size": 4304,
52
+ "model_type": "qwen3_vl",
53
+ "num_heads": 16,
54
+ "num_position_embeddings": 2304,
55
+ "out_hidden_size": 5120,
56
+ "patch_size": 16,
57
+ "spatial_merge_size": 2,
58
+ "temporal_patch_size": 2
59
+ },
60
+ "vision_end_token_id": 151653,
61
+ "vision_start_token_id": 151652
62
+ }
text_encoder/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
text_encoder/model-00001-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b9dfbc930e505402ae9d7e5091a9d7d656cda5f34614f01cfe70bfb0cca27cb
3
+ size 4932328944
text_encoder/model-00002-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8bb44b4ff303fe76fe9e894022fb3dc71b15a2e716592790fe0e3c3e60478fa
3
+ size 4875990528
text_encoder/model-00003-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54f22e8b3168f8dc962fac0d313607ebf52a12b433d4cf3098a0d82d9f042940
3
+ size 4875990552
text_encoder/model-00006-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82f05620d1f718a90c362b221d6a184ff1a0f53301d706882d3df49695fa1974
3
+ size 4875990584
text_encoder/model-00007-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb91da8cb01ff4de3eef0eab1c3e769a734b3a1aafc61734068638a0d6c86934
3
+ size 4875990584
text_encoder/model-00011-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3820ffe8d8d6477f6fe8d614ef3c87abb264ee39accebf43a1507b970d80946f
3
+ size 4875990584
text_encoder/model-00014-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e45b6c9998c77ee5a6577f9f47bc76416c1d4d387169e50c4c9d3134ea51b13b
3
+ size 3270697008
text_encoder/model.safetensors.index.json ADDED
@@ -0,0 +1,1065 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 66714780128
4
+ },
5
+ "weight_map": {
6
+ "lm_head.weight": "model-00014-of-00014.safetensors",
7
+ "model.language_model.embed_tokens.weight": "model-00001-of-00014.safetensors",
8
+ "model.language_model.layers.0.input_layernorm.weight": "model-00001-of-00014.safetensors",
9
+ "model.language_model.layers.0.mlp.down_proj.weight": "model-00001-of-00014.safetensors",
10
+ "model.language_model.layers.0.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
11
+ "model.language_model.layers.0.mlp.up_proj.weight": "model-00001-of-00014.safetensors",
12
+ "model.language_model.layers.0.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
13
+ "model.language_model.layers.0.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
14
+ "model.language_model.layers.0.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
15
+ "model.language_model.layers.0.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
16
+ "model.language_model.layers.0.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
17
+ "model.language_model.layers.0.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
18
+ "model.language_model.layers.0.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
19
+ "model.language_model.layers.1.input_layernorm.weight": "model-00001-of-00014.safetensors",
20
+ "model.language_model.layers.1.mlp.down_proj.weight": "model-00001-of-00014.safetensors",
21
+ "model.language_model.layers.1.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
22
+ "model.language_model.layers.1.mlp.up_proj.weight": "model-00001-of-00014.safetensors",
23
+ "model.language_model.layers.1.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
24
+ "model.language_model.layers.1.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
25
+ "model.language_model.layers.1.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
26
+ "model.language_model.layers.1.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
27
+ "model.language_model.layers.1.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
28
+ "model.language_model.layers.1.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
29
+ "model.language_model.layers.1.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
30
+ "model.language_model.layers.10.input_layernorm.weight": "model-00003-of-00014.safetensors",
31
+ "model.language_model.layers.10.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
32
+ "model.language_model.layers.10.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
33
+ "model.language_model.layers.10.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
34
+ "model.language_model.layers.10.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
35
+ "model.language_model.layers.10.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
36
+ "model.language_model.layers.10.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
37
+ "model.language_model.layers.10.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
38
+ "model.language_model.layers.10.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
39
+ "model.language_model.layers.10.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
40
+ "model.language_model.layers.10.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
41
+ "model.language_model.layers.11.input_layernorm.weight": "model-00003-of-00014.safetensors",
42
+ "model.language_model.layers.11.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
43
+ "model.language_model.layers.11.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
44
+ "model.language_model.layers.11.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
45
+ "model.language_model.layers.11.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
46
+ "model.language_model.layers.11.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
47
+ "model.language_model.layers.11.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
48
+ "model.language_model.layers.11.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
49
+ "model.language_model.layers.11.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
50
+ "model.language_model.layers.11.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
51
+ "model.language_model.layers.11.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
52
+ "model.language_model.layers.12.input_layernorm.weight": "model-00003-of-00014.safetensors",
53
+ "model.language_model.layers.12.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
54
+ "model.language_model.layers.12.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
55
+ "model.language_model.layers.12.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
56
+ "model.language_model.layers.12.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
57
+ "model.language_model.layers.12.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
58
+ "model.language_model.layers.12.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
59
+ "model.language_model.layers.12.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
60
+ "model.language_model.layers.12.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
61
+ "model.language_model.layers.12.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
62
+ "model.language_model.layers.12.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
63
+ "model.language_model.layers.13.input_layernorm.weight": "model-00003-of-00014.safetensors",
64
+ "model.language_model.layers.13.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
65
+ "model.language_model.layers.13.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
66
+ "model.language_model.layers.13.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
67
+ "model.language_model.layers.13.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
68
+ "model.language_model.layers.13.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
69
+ "model.language_model.layers.13.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
70
+ "model.language_model.layers.13.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
71
+ "model.language_model.layers.13.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
72
+ "model.language_model.layers.13.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
73
+ "model.language_model.layers.13.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
74
+ "model.language_model.layers.14.input_layernorm.weight": "model-00004-of-00014.safetensors",
75
+ "model.language_model.layers.14.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
76
+ "model.language_model.layers.14.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
77
+ "model.language_model.layers.14.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
78
+ "model.language_model.layers.14.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
79
+ "model.language_model.layers.14.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
80
+ "model.language_model.layers.14.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
81
+ "model.language_model.layers.14.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
82
+ "model.language_model.layers.14.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
83
+ "model.language_model.layers.14.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
84
+ "model.language_model.layers.14.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
85
+ "model.language_model.layers.15.input_layernorm.weight": "model-00004-of-00014.safetensors",
86
+ "model.language_model.layers.15.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
87
+ "model.language_model.layers.15.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
88
+ "model.language_model.layers.15.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
89
+ "model.language_model.layers.15.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
90
+ "model.language_model.layers.15.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
91
+ "model.language_model.layers.15.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
92
+ "model.language_model.layers.15.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
93
+ "model.language_model.layers.15.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
94
+ "model.language_model.layers.15.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
95
+ "model.language_model.layers.15.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
96
+ "model.language_model.layers.16.input_layernorm.weight": "model-00004-of-00014.safetensors",
97
+ "model.language_model.layers.16.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
98
+ "model.language_model.layers.16.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
99
+ "model.language_model.layers.16.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
100
+ "model.language_model.layers.16.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
101
+ "model.language_model.layers.16.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
102
+ "model.language_model.layers.16.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
103
+ "model.language_model.layers.16.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
104
+ "model.language_model.layers.16.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
105
+ "model.language_model.layers.16.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
106
+ "model.language_model.layers.16.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
107
+ "model.language_model.layers.17.input_layernorm.weight": "model-00004-of-00014.safetensors",
108
+ "model.language_model.layers.17.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
109
+ "model.language_model.layers.17.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
110
+ "model.language_model.layers.17.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
111
+ "model.language_model.layers.17.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
112
+ "model.language_model.layers.17.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
113
+ "model.language_model.layers.17.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
114
+ "model.language_model.layers.17.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
115
+ "model.language_model.layers.17.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
116
+ "model.language_model.layers.17.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
117
+ "model.language_model.layers.17.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
118
+ "model.language_model.layers.18.input_layernorm.weight": "model-00004-of-00014.safetensors",
119
+ "model.language_model.layers.18.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
120
+ "model.language_model.layers.18.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
121
+ "model.language_model.layers.18.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
122
+ "model.language_model.layers.18.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
123
+ "model.language_model.layers.18.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
124
+ "model.language_model.layers.18.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
125
+ "model.language_model.layers.18.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
126
+ "model.language_model.layers.18.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
127
+ "model.language_model.layers.18.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
128
+ "model.language_model.layers.18.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
129
+ "model.language_model.layers.19.input_layernorm.weight": "model-00005-of-00014.safetensors",
130
+ "model.language_model.layers.19.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
131
+ "model.language_model.layers.19.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
132
+ "model.language_model.layers.19.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
133
+ "model.language_model.layers.19.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
134
+ "model.language_model.layers.19.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
135
+ "model.language_model.layers.19.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
136
+ "model.language_model.layers.19.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
137
+ "model.language_model.layers.19.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
138
+ "model.language_model.layers.19.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
139
+ "model.language_model.layers.19.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
140
+ "model.language_model.layers.2.input_layernorm.weight": "model-00001-of-00014.safetensors",
141
+ "model.language_model.layers.2.mlp.down_proj.weight": "model-00001-of-00014.safetensors",
142
+ "model.language_model.layers.2.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
143
+ "model.language_model.layers.2.mlp.up_proj.weight": "model-00001-of-00014.safetensors",
144
+ "model.language_model.layers.2.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
145
+ "model.language_model.layers.2.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
146
+ "model.language_model.layers.2.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
147
+ "model.language_model.layers.2.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
148
+ "model.language_model.layers.2.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
149
+ "model.language_model.layers.2.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
150
+ "model.language_model.layers.2.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
151
+ "model.language_model.layers.20.input_layernorm.weight": "model-00005-of-00014.safetensors",
152
+ "model.language_model.layers.20.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
153
+ "model.language_model.layers.20.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
154
+ "model.language_model.layers.20.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
155
+ "model.language_model.layers.20.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
156
+ "model.language_model.layers.20.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
157
+ "model.language_model.layers.20.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
158
+ "model.language_model.layers.20.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
159
+ "model.language_model.layers.20.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
160
+ "model.language_model.layers.20.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
161
+ "model.language_model.layers.20.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
162
+ "model.language_model.layers.21.input_layernorm.weight": "model-00005-of-00014.safetensors",
163
+ "model.language_model.layers.21.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
164
+ "model.language_model.layers.21.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
165
+ "model.language_model.layers.21.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
166
+ "model.language_model.layers.21.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
167
+ "model.language_model.layers.21.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
168
+ "model.language_model.layers.21.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
169
+ "model.language_model.layers.21.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
170
+ "model.language_model.layers.21.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
171
+ "model.language_model.layers.21.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
172
+ "model.language_model.layers.21.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
173
+ "model.language_model.layers.22.input_layernorm.weight": "model-00005-of-00014.safetensors",
174
+ "model.language_model.layers.22.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
175
+ "model.language_model.layers.22.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
176
+ "model.language_model.layers.22.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
177
+ "model.language_model.layers.22.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
178
+ "model.language_model.layers.22.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
179
+ "model.language_model.layers.22.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
180
+ "model.language_model.layers.22.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
181
+ "model.language_model.layers.22.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
182
+ "model.language_model.layers.22.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
183
+ "model.language_model.layers.22.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
184
+ "model.language_model.layers.23.input_layernorm.weight": "model-00005-of-00014.safetensors",
185
+ "model.language_model.layers.23.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
186
+ "model.language_model.layers.23.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
187
+ "model.language_model.layers.23.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
188
+ "model.language_model.layers.23.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
189
+ "model.language_model.layers.23.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
190
+ "model.language_model.layers.23.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
191
+ "model.language_model.layers.23.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
192
+ "model.language_model.layers.23.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
193
+ "model.language_model.layers.23.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
194
+ "model.language_model.layers.23.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
195
+ "model.language_model.layers.24.input_layernorm.weight": "model-00006-of-00014.safetensors",
196
+ "model.language_model.layers.24.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
197
+ "model.language_model.layers.24.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
198
+ "model.language_model.layers.24.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
199
+ "model.language_model.layers.24.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
200
+ "model.language_model.layers.24.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
201
+ "model.language_model.layers.24.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
202
+ "model.language_model.layers.24.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
203
+ "model.language_model.layers.24.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
204
+ "model.language_model.layers.24.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
205
+ "model.language_model.layers.24.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
206
+ "model.language_model.layers.25.input_layernorm.weight": "model-00006-of-00014.safetensors",
207
+ "model.language_model.layers.25.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
208
+ "model.language_model.layers.25.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
209
+ "model.language_model.layers.25.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
210
+ "model.language_model.layers.25.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
211
+ "model.language_model.layers.25.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
212
+ "model.language_model.layers.25.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
213
+ "model.language_model.layers.25.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
214
+ "model.language_model.layers.25.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
215
+ "model.language_model.layers.25.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
216
+ "model.language_model.layers.25.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
217
+ "model.language_model.layers.26.input_layernorm.weight": "model-00006-of-00014.safetensors",
218
+ "model.language_model.layers.26.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
219
+ "model.language_model.layers.26.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
220
+ "model.language_model.layers.26.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
221
+ "model.language_model.layers.26.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
222
+ "model.language_model.layers.26.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
223
+ "model.language_model.layers.26.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
224
+ "model.language_model.layers.26.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
225
+ "model.language_model.layers.26.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
226
+ "model.language_model.layers.26.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
227
+ "model.language_model.layers.26.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
228
+ "model.language_model.layers.27.input_layernorm.weight": "model-00006-of-00014.safetensors",
229
+ "model.language_model.layers.27.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
230
+ "model.language_model.layers.27.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
231
+ "model.language_model.layers.27.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
232
+ "model.language_model.layers.27.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
233
+ "model.language_model.layers.27.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
234
+ "model.language_model.layers.27.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
235
+ "model.language_model.layers.27.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
236
+ "model.language_model.layers.27.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
237
+ "model.language_model.layers.27.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
238
+ "model.language_model.layers.27.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
239
+ "model.language_model.layers.28.input_layernorm.weight": "model-00006-of-00014.safetensors",
240
+ "model.language_model.layers.28.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
241
+ "model.language_model.layers.28.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
242
+ "model.language_model.layers.28.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
243
+ "model.language_model.layers.28.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
244
+ "model.language_model.layers.28.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
245
+ "model.language_model.layers.28.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
246
+ "model.language_model.layers.28.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
247
+ "model.language_model.layers.28.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
248
+ "model.language_model.layers.28.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
249
+ "model.language_model.layers.28.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
250
+ "model.language_model.layers.29.input_layernorm.weight": "model-00007-of-00014.safetensors",
251
+ "model.language_model.layers.29.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
252
+ "model.language_model.layers.29.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
253
+ "model.language_model.layers.29.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
254
+ "model.language_model.layers.29.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
255
+ "model.language_model.layers.29.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
256
+ "model.language_model.layers.29.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
257
+ "model.language_model.layers.29.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
258
+ "model.language_model.layers.29.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
259
+ "model.language_model.layers.29.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
260
+ "model.language_model.layers.29.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
261
+ "model.language_model.layers.3.input_layernorm.weight": "model-00001-of-00014.safetensors",
262
+ "model.language_model.layers.3.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
263
+ "model.language_model.layers.3.mlp.gate_proj.weight": "model-00001-of-00014.safetensors",
264
+ "model.language_model.layers.3.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
265
+ "model.language_model.layers.3.post_attention_layernorm.weight": "model-00001-of-00014.safetensors",
266
+ "model.language_model.layers.3.self_attn.k_norm.weight": "model-00001-of-00014.safetensors",
267
+ "model.language_model.layers.3.self_attn.k_proj.weight": "model-00001-of-00014.safetensors",
268
+ "model.language_model.layers.3.self_attn.o_proj.weight": "model-00001-of-00014.safetensors",
269
+ "model.language_model.layers.3.self_attn.q_norm.weight": "model-00001-of-00014.safetensors",
270
+ "model.language_model.layers.3.self_attn.q_proj.weight": "model-00001-of-00014.safetensors",
271
+ "model.language_model.layers.3.self_attn.v_proj.weight": "model-00001-of-00014.safetensors",
272
+ "model.language_model.layers.30.input_layernorm.weight": "model-00007-of-00014.safetensors",
273
+ "model.language_model.layers.30.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
274
+ "model.language_model.layers.30.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
275
+ "model.language_model.layers.30.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
276
+ "model.language_model.layers.30.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
277
+ "model.language_model.layers.30.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
278
+ "model.language_model.layers.30.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
279
+ "model.language_model.layers.30.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
280
+ "model.language_model.layers.30.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
281
+ "model.language_model.layers.30.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
282
+ "model.language_model.layers.30.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
283
+ "model.language_model.layers.31.input_layernorm.weight": "model-00007-of-00014.safetensors",
284
+ "model.language_model.layers.31.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
285
+ "model.language_model.layers.31.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
286
+ "model.language_model.layers.31.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
287
+ "model.language_model.layers.31.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
288
+ "model.language_model.layers.31.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
289
+ "model.language_model.layers.31.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
290
+ "model.language_model.layers.31.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
291
+ "model.language_model.layers.31.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
292
+ "model.language_model.layers.31.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
293
+ "model.language_model.layers.31.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
294
+ "model.language_model.layers.32.input_layernorm.weight": "model-00007-of-00014.safetensors",
295
+ "model.language_model.layers.32.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
296
+ "model.language_model.layers.32.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
297
+ "model.language_model.layers.32.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
298
+ "model.language_model.layers.32.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
299
+ "model.language_model.layers.32.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
300
+ "model.language_model.layers.32.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
301
+ "model.language_model.layers.32.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
302
+ "model.language_model.layers.32.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
303
+ "model.language_model.layers.32.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
304
+ "model.language_model.layers.32.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
305
+ "model.language_model.layers.33.input_layernorm.weight": "model-00007-of-00014.safetensors",
306
+ "model.language_model.layers.33.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
307
+ "model.language_model.layers.33.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
308
+ "model.language_model.layers.33.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
309
+ "model.language_model.layers.33.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
310
+ "model.language_model.layers.33.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
311
+ "model.language_model.layers.33.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
312
+ "model.language_model.layers.33.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
313
+ "model.language_model.layers.33.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
314
+ "model.language_model.layers.33.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
315
+ "model.language_model.layers.33.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
316
+ "model.language_model.layers.34.input_layernorm.weight": "model-00008-of-00014.safetensors",
317
+ "model.language_model.layers.34.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
318
+ "model.language_model.layers.34.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
319
+ "model.language_model.layers.34.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
320
+ "model.language_model.layers.34.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
321
+ "model.language_model.layers.34.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
322
+ "model.language_model.layers.34.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
323
+ "model.language_model.layers.34.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
324
+ "model.language_model.layers.34.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
325
+ "model.language_model.layers.34.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
326
+ "model.language_model.layers.34.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
327
+ "model.language_model.layers.35.input_layernorm.weight": "model-00008-of-00014.safetensors",
328
+ "model.language_model.layers.35.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
329
+ "model.language_model.layers.35.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
330
+ "model.language_model.layers.35.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
331
+ "model.language_model.layers.35.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
332
+ "model.language_model.layers.35.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
333
+ "model.language_model.layers.35.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
334
+ "model.language_model.layers.35.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
335
+ "model.language_model.layers.35.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
336
+ "model.language_model.layers.35.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
337
+ "model.language_model.layers.35.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
338
+ "model.language_model.layers.36.input_layernorm.weight": "model-00008-of-00014.safetensors",
339
+ "model.language_model.layers.36.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
340
+ "model.language_model.layers.36.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
341
+ "model.language_model.layers.36.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
342
+ "model.language_model.layers.36.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
343
+ "model.language_model.layers.36.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
344
+ "model.language_model.layers.36.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
345
+ "model.language_model.layers.36.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
346
+ "model.language_model.layers.36.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
347
+ "model.language_model.layers.36.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
348
+ "model.language_model.layers.36.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
349
+ "model.language_model.layers.37.input_layernorm.weight": "model-00008-of-00014.safetensors",
350
+ "model.language_model.layers.37.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
351
+ "model.language_model.layers.37.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
352
+ "model.language_model.layers.37.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
353
+ "model.language_model.layers.37.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
354
+ "model.language_model.layers.37.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
355
+ "model.language_model.layers.37.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
356
+ "model.language_model.layers.37.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
357
+ "model.language_model.layers.37.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
358
+ "model.language_model.layers.37.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
359
+ "model.language_model.layers.37.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
360
+ "model.language_model.layers.38.input_layernorm.weight": "model-00008-of-00014.safetensors",
361
+ "model.language_model.layers.38.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
362
+ "model.language_model.layers.38.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
363
+ "model.language_model.layers.38.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
364
+ "model.language_model.layers.38.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
365
+ "model.language_model.layers.38.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
366
+ "model.language_model.layers.38.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
367
+ "model.language_model.layers.38.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
368
+ "model.language_model.layers.38.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
369
+ "model.language_model.layers.38.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
370
+ "model.language_model.layers.38.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
371
+ "model.language_model.layers.39.input_layernorm.weight": "model-00009-of-00014.safetensors",
372
+ "model.language_model.layers.39.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
373
+ "model.language_model.layers.39.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
374
+ "model.language_model.layers.39.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
375
+ "model.language_model.layers.39.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
376
+ "model.language_model.layers.39.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
377
+ "model.language_model.layers.39.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
378
+ "model.language_model.layers.39.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
379
+ "model.language_model.layers.39.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
380
+ "model.language_model.layers.39.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
381
+ "model.language_model.layers.39.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
382
+ "model.language_model.layers.4.input_layernorm.weight": "model-00002-of-00014.safetensors",
383
+ "model.language_model.layers.4.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
384
+ "model.language_model.layers.4.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
385
+ "model.language_model.layers.4.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
386
+ "model.language_model.layers.4.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
387
+ "model.language_model.layers.4.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
388
+ "model.language_model.layers.4.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
389
+ "model.language_model.layers.4.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
390
+ "model.language_model.layers.4.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
391
+ "model.language_model.layers.4.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
392
+ "model.language_model.layers.4.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
393
+ "model.language_model.layers.40.input_layernorm.weight": "model-00009-of-00014.safetensors",
394
+ "model.language_model.layers.40.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
395
+ "model.language_model.layers.40.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
396
+ "model.language_model.layers.40.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
397
+ "model.language_model.layers.40.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
398
+ "model.language_model.layers.40.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
399
+ "model.language_model.layers.40.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
400
+ "model.language_model.layers.40.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
401
+ "model.language_model.layers.40.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
402
+ "model.language_model.layers.40.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
403
+ "model.language_model.layers.40.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
404
+ "model.language_model.layers.41.input_layernorm.weight": "model-00009-of-00014.safetensors",
405
+ "model.language_model.layers.41.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
406
+ "model.language_model.layers.41.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
407
+ "model.language_model.layers.41.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
408
+ "model.language_model.layers.41.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
409
+ "model.language_model.layers.41.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
410
+ "model.language_model.layers.41.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
411
+ "model.language_model.layers.41.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
412
+ "model.language_model.layers.41.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
413
+ "model.language_model.layers.41.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
414
+ "model.language_model.layers.41.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
415
+ "model.language_model.layers.42.input_layernorm.weight": "model-00009-of-00014.safetensors",
416
+ "model.language_model.layers.42.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
417
+ "model.language_model.layers.42.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
418
+ "model.language_model.layers.42.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
419
+ "model.language_model.layers.42.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
420
+ "model.language_model.layers.42.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
421
+ "model.language_model.layers.42.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
422
+ "model.language_model.layers.42.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
423
+ "model.language_model.layers.42.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
424
+ "model.language_model.layers.42.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
425
+ "model.language_model.layers.42.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
426
+ "model.language_model.layers.43.input_layernorm.weight": "model-00009-of-00014.safetensors",
427
+ "model.language_model.layers.43.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
428
+ "model.language_model.layers.43.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
429
+ "model.language_model.layers.43.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
430
+ "model.language_model.layers.43.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
431
+ "model.language_model.layers.43.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
432
+ "model.language_model.layers.43.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
433
+ "model.language_model.layers.43.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
434
+ "model.language_model.layers.43.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
435
+ "model.language_model.layers.43.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
436
+ "model.language_model.layers.43.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
437
+ "model.language_model.layers.44.input_layernorm.weight": "model-00010-of-00014.safetensors",
438
+ "model.language_model.layers.44.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
439
+ "model.language_model.layers.44.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
440
+ "model.language_model.layers.44.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
441
+ "model.language_model.layers.44.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
442
+ "model.language_model.layers.44.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
443
+ "model.language_model.layers.44.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
444
+ "model.language_model.layers.44.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
445
+ "model.language_model.layers.44.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
446
+ "model.language_model.layers.44.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
447
+ "model.language_model.layers.44.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
448
+ "model.language_model.layers.45.input_layernorm.weight": "model-00010-of-00014.safetensors",
449
+ "model.language_model.layers.45.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
450
+ "model.language_model.layers.45.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
451
+ "model.language_model.layers.45.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
452
+ "model.language_model.layers.45.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
453
+ "model.language_model.layers.45.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
454
+ "model.language_model.layers.45.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
455
+ "model.language_model.layers.45.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
456
+ "model.language_model.layers.45.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
457
+ "model.language_model.layers.45.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
458
+ "model.language_model.layers.45.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
459
+ "model.language_model.layers.46.input_layernorm.weight": "model-00010-of-00014.safetensors",
460
+ "model.language_model.layers.46.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
461
+ "model.language_model.layers.46.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
462
+ "model.language_model.layers.46.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
463
+ "model.language_model.layers.46.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
464
+ "model.language_model.layers.46.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
465
+ "model.language_model.layers.46.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
466
+ "model.language_model.layers.46.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
467
+ "model.language_model.layers.46.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
468
+ "model.language_model.layers.46.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
469
+ "model.language_model.layers.46.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
470
+ "model.language_model.layers.47.input_layernorm.weight": "model-00010-of-00014.safetensors",
471
+ "model.language_model.layers.47.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
472
+ "model.language_model.layers.47.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
473
+ "model.language_model.layers.47.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
474
+ "model.language_model.layers.47.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
475
+ "model.language_model.layers.47.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
476
+ "model.language_model.layers.47.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
477
+ "model.language_model.layers.47.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
478
+ "model.language_model.layers.47.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
479
+ "model.language_model.layers.47.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
480
+ "model.language_model.layers.47.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
481
+ "model.language_model.layers.48.input_layernorm.weight": "model-00010-of-00014.safetensors",
482
+ "model.language_model.layers.48.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
483
+ "model.language_model.layers.48.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
484
+ "model.language_model.layers.48.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
485
+ "model.language_model.layers.48.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
486
+ "model.language_model.layers.48.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
487
+ "model.language_model.layers.48.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
488
+ "model.language_model.layers.48.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
489
+ "model.language_model.layers.48.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
490
+ "model.language_model.layers.48.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
491
+ "model.language_model.layers.48.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
492
+ "model.language_model.layers.49.input_layernorm.weight": "model-00011-of-00014.safetensors",
493
+ "model.language_model.layers.49.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
494
+ "model.language_model.layers.49.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
495
+ "model.language_model.layers.49.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
496
+ "model.language_model.layers.49.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
497
+ "model.language_model.layers.49.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
498
+ "model.language_model.layers.49.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
499
+ "model.language_model.layers.49.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
500
+ "model.language_model.layers.49.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
501
+ "model.language_model.layers.49.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
502
+ "model.language_model.layers.49.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
503
+ "model.language_model.layers.5.input_layernorm.weight": "model-00002-of-00014.safetensors",
504
+ "model.language_model.layers.5.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
505
+ "model.language_model.layers.5.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
506
+ "model.language_model.layers.5.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
507
+ "model.language_model.layers.5.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
508
+ "model.language_model.layers.5.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
509
+ "model.language_model.layers.5.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
510
+ "model.language_model.layers.5.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
511
+ "model.language_model.layers.5.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
512
+ "model.language_model.layers.5.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
513
+ "model.language_model.layers.5.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
514
+ "model.language_model.layers.50.input_layernorm.weight": "model-00011-of-00014.safetensors",
515
+ "model.language_model.layers.50.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
516
+ "model.language_model.layers.50.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
517
+ "model.language_model.layers.50.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
518
+ "model.language_model.layers.50.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
519
+ "model.language_model.layers.50.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
520
+ "model.language_model.layers.50.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
521
+ "model.language_model.layers.50.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
522
+ "model.language_model.layers.50.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
523
+ "model.language_model.layers.50.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
524
+ "model.language_model.layers.50.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
525
+ "model.language_model.layers.51.input_layernorm.weight": "model-00011-of-00014.safetensors",
526
+ "model.language_model.layers.51.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
527
+ "model.language_model.layers.51.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
528
+ "model.language_model.layers.51.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
529
+ "model.language_model.layers.51.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
530
+ "model.language_model.layers.51.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
531
+ "model.language_model.layers.51.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
532
+ "model.language_model.layers.51.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
533
+ "model.language_model.layers.51.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
534
+ "model.language_model.layers.51.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
535
+ "model.language_model.layers.51.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
536
+ "model.language_model.layers.52.input_layernorm.weight": "model-00011-of-00014.safetensors",
537
+ "model.language_model.layers.52.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
538
+ "model.language_model.layers.52.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
539
+ "model.language_model.layers.52.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
540
+ "model.language_model.layers.52.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
541
+ "model.language_model.layers.52.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
542
+ "model.language_model.layers.52.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
543
+ "model.language_model.layers.52.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
544
+ "model.language_model.layers.52.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
545
+ "model.language_model.layers.52.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
546
+ "model.language_model.layers.52.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
547
+ "model.language_model.layers.53.input_layernorm.weight": "model-00011-of-00014.safetensors",
548
+ "model.language_model.layers.53.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
549
+ "model.language_model.layers.53.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
550
+ "model.language_model.layers.53.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
551
+ "model.language_model.layers.53.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
552
+ "model.language_model.layers.53.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
553
+ "model.language_model.layers.53.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
554
+ "model.language_model.layers.53.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
555
+ "model.language_model.layers.53.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
556
+ "model.language_model.layers.53.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
557
+ "model.language_model.layers.53.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
558
+ "model.language_model.layers.54.input_layernorm.weight": "model-00012-of-00014.safetensors",
559
+ "model.language_model.layers.54.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
560
+ "model.language_model.layers.54.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
561
+ "model.language_model.layers.54.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
562
+ "model.language_model.layers.54.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
563
+ "model.language_model.layers.54.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
564
+ "model.language_model.layers.54.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
565
+ "model.language_model.layers.54.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
566
+ "model.language_model.layers.54.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
567
+ "model.language_model.layers.54.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
568
+ "model.language_model.layers.54.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
569
+ "model.language_model.layers.55.input_layernorm.weight": "model-00012-of-00014.safetensors",
570
+ "model.language_model.layers.55.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
571
+ "model.language_model.layers.55.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
572
+ "model.language_model.layers.55.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
573
+ "model.language_model.layers.55.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
574
+ "model.language_model.layers.55.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
575
+ "model.language_model.layers.55.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
576
+ "model.language_model.layers.55.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
577
+ "model.language_model.layers.55.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
578
+ "model.language_model.layers.55.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
579
+ "model.language_model.layers.55.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
580
+ "model.language_model.layers.56.input_layernorm.weight": "model-00012-of-00014.safetensors",
581
+ "model.language_model.layers.56.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
582
+ "model.language_model.layers.56.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
583
+ "model.language_model.layers.56.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
584
+ "model.language_model.layers.56.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
585
+ "model.language_model.layers.56.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
586
+ "model.language_model.layers.56.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
587
+ "model.language_model.layers.56.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
588
+ "model.language_model.layers.56.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
589
+ "model.language_model.layers.56.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
590
+ "model.language_model.layers.56.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
591
+ "model.language_model.layers.57.input_layernorm.weight": "model-00012-of-00014.safetensors",
592
+ "model.language_model.layers.57.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
593
+ "model.language_model.layers.57.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
594
+ "model.language_model.layers.57.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
595
+ "model.language_model.layers.57.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
596
+ "model.language_model.layers.57.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
597
+ "model.language_model.layers.57.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
598
+ "model.language_model.layers.57.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
599
+ "model.language_model.layers.57.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
600
+ "model.language_model.layers.57.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
601
+ "model.language_model.layers.57.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
602
+ "model.language_model.layers.58.input_layernorm.weight": "model-00012-of-00014.safetensors",
603
+ "model.language_model.layers.58.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
604
+ "model.language_model.layers.58.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
605
+ "model.language_model.layers.58.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
606
+ "model.language_model.layers.58.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
607
+ "model.language_model.layers.58.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
608
+ "model.language_model.layers.58.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
609
+ "model.language_model.layers.58.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
610
+ "model.language_model.layers.58.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
611
+ "model.language_model.layers.58.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
612
+ "model.language_model.layers.58.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
613
+ "model.language_model.layers.59.input_layernorm.weight": "model-00013-of-00014.safetensors",
614
+ "model.language_model.layers.59.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
615
+ "model.language_model.layers.59.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
616
+ "model.language_model.layers.59.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
617
+ "model.language_model.layers.59.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
618
+ "model.language_model.layers.59.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
619
+ "model.language_model.layers.59.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
620
+ "model.language_model.layers.59.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
621
+ "model.language_model.layers.59.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
622
+ "model.language_model.layers.59.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
623
+ "model.language_model.layers.59.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
624
+ "model.language_model.layers.6.input_layernorm.weight": "model-00002-of-00014.safetensors",
625
+ "model.language_model.layers.6.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
626
+ "model.language_model.layers.6.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
627
+ "model.language_model.layers.6.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
628
+ "model.language_model.layers.6.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
629
+ "model.language_model.layers.6.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
630
+ "model.language_model.layers.6.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
631
+ "model.language_model.layers.6.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
632
+ "model.language_model.layers.6.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
633
+ "model.language_model.layers.6.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
634
+ "model.language_model.layers.6.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
635
+ "model.language_model.layers.60.input_layernorm.weight": "model-00013-of-00014.safetensors",
636
+ "model.language_model.layers.60.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
637
+ "model.language_model.layers.60.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
638
+ "model.language_model.layers.60.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
639
+ "model.language_model.layers.60.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
640
+ "model.language_model.layers.60.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
641
+ "model.language_model.layers.60.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
642
+ "model.language_model.layers.60.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
643
+ "model.language_model.layers.60.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
644
+ "model.language_model.layers.60.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
645
+ "model.language_model.layers.60.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
646
+ "model.language_model.layers.61.input_layernorm.weight": "model-00013-of-00014.safetensors",
647
+ "model.language_model.layers.61.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
648
+ "model.language_model.layers.61.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
649
+ "model.language_model.layers.61.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
650
+ "model.language_model.layers.61.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
651
+ "model.language_model.layers.61.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
652
+ "model.language_model.layers.61.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
653
+ "model.language_model.layers.61.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
654
+ "model.language_model.layers.61.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
655
+ "model.language_model.layers.61.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
656
+ "model.language_model.layers.61.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
657
+ "model.language_model.layers.62.input_layernorm.weight": "model-00013-of-00014.safetensors",
658
+ "model.language_model.layers.62.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
659
+ "model.language_model.layers.62.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
660
+ "model.language_model.layers.62.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
661
+ "model.language_model.layers.62.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
662
+ "model.language_model.layers.62.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
663
+ "model.language_model.layers.62.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
664
+ "model.language_model.layers.62.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
665
+ "model.language_model.layers.62.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
666
+ "model.language_model.layers.62.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
667
+ "model.language_model.layers.62.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
668
+ "model.language_model.layers.63.input_layernorm.weight": "model-00013-of-00014.safetensors",
669
+ "model.language_model.layers.63.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
670
+ "model.language_model.layers.63.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
671
+ "model.language_model.layers.63.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
672
+ "model.language_model.layers.63.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
673
+ "model.language_model.layers.63.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
674
+ "model.language_model.layers.63.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
675
+ "model.language_model.layers.63.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
676
+ "model.language_model.layers.63.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
677
+ "model.language_model.layers.63.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
678
+ "model.language_model.layers.63.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
679
+ "model.language_model.layers.7.input_layernorm.weight": "model-00002-of-00014.safetensors",
680
+ "model.language_model.layers.7.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
681
+ "model.language_model.layers.7.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
682
+ "model.language_model.layers.7.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
683
+ "model.language_model.layers.7.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
684
+ "model.language_model.layers.7.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
685
+ "model.language_model.layers.7.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
686
+ "model.language_model.layers.7.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
687
+ "model.language_model.layers.7.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
688
+ "model.language_model.layers.7.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
689
+ "model.language_model.layers.7.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
690
+ "model.language_model.layers.8.input_layernorm.weight": "model-00002-of-00014.safetensors",
691
+ "model.language_model.layers.8.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
692
+ "model.language_model.layers.8.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
693
+ "model.language_model.layers.8.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
694
+ "model.language_model.layers.8.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
695
+ "model.language_model.layers.8.self_attn.k_norm.weight": "model-00002-of-00014.safetensors",
696
+ "model.language_model.layers.8.self_attn.k_proj.weight": "model-00002-of-00014.safetensors",
697
+ "model.language_model.layers.8.self_attn.o_proj.weight": "model-00002-of-00014.safetensors",
698
+ "model.language_model.layers.8.self_attn.q_norm.weight": "model-00002-of-00014.safetensors",
699
+ "model.language_model.layers.8.self_attn.q_proj.weight": "model-00002-of-00014.safetensors",
700
+ "model.language_model.layers.8.self_attn.v_proj.weight": "model-00002-of-00014.safetensors",
701
+ "model.language_model.layers.9.input_layernorm.weight": "model-00003-of-00014.safetensors",
702
+ "model.language_model.layers.9.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
703
+ "model.language_model.layers.9.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
704
+ "model.language_model.layers.9.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
705
+ "model.language_model.layers.9.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
706
+ "model.language_model.layers.9.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
707
+ "model.language_model.layers.9.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
708
+ "model.language_model.layers.9.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
709
+ "model.language_model.layers.9.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
710
+ "model.language_model.layers.9.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
711
+ "model.language_model.layers.9.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
712
+ "model.language_model.norm.weight": "model-00014-of-00014.safetensors",
713
+ "model.visual.blocks.0.attn.proj.bias": "model-00014-of-00014.safetensors",
714
+ "model.visual.blocks.0.attn.proj.weight": "model-00014-of-00014.safetensors",
715
+ "model.visual.blocks.0.attn.qkv.bias": "model-00014-of-00014.safetensors",
716
+ "model.visual.blocks.0.attn.qkv.weight": "model-00014-of-00014.safetensors",
717
+ "model.visual.blocks.0.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
718
+ "model.visual.blocks.0.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
719
+ "model.visual.blocks.0.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
720
+ "model.visual.blocks.0.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
721
+ "model.visual.blocks.0.norm1.bias": "model-00014-of-00014.safetensors",
722
+ "model.visual.blocks.0.norm1.weight": "model-00014-of-00014.safetensors",
723
+ "model.visual.blocks.0.norm2.bias": "model-00014-of-00014.safetensors",
724
+ "model.visual.blocks.0.norm2.weight": "model-00014-of-00014.safetensors",
725
+ "model.visual.blocks.1.attn.proj.bias": "model-00014-of-00014.safetensors",
726
+ "model.visual.blocks.1.attn.proj.weight": "model-00014-of-00014.safetensors",
727
+ "model.visual.blocks.1.attn.qkv.bias": "model-00014-of-00014.safetensors",
728
+ "model.visual.blocks.1.attn.qkv.weight": "model-00014-of-00014.safetensors",
729
+ "model.visual.blocks.1.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
730
+ "model.visual.blocks.1.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
731
+ "model.visual.blocks.1.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
732
+ "model.visual.blocks.1.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
733
+ "model.visual.blocks.1.norm1.bias": "model-00014-of-00014.safetensors",
734
+ "model.visual.blocks.1.norm1.weight": "model-00014-of-00014.safetensors",
735
+ "model.visual.blocks.1.norm2.bias": "model-00014-of-00014.safetensors",
736
+ "model.visual.blocks.1.norm2.weight": "model-00014-of-00014.safetensors",
737
+ "model.visual.blocks.10.attn.proj.bias": "model-00014-of-00014.safetensors",
738
+ "model.visual.blocks.10.attn.proj.weight": "model-00014-of-00014.safetensors",
739
+ "model.visual.blocks.10.attn.qkv.bias": "model-00014-of-00014.safetensors",
740
+ "model.visual.blocks.10.attn.qkv.weight": "model-00014-of-00014.safetensors",
741
+ "model.visual.blocks.10.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
742
+ "model.visual.blocks.10.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
743
+ "model.visual.blocks.10.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
744
+ "model.visual.blocks.10.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
745
+ "model.visual.blocks.10.norm1.bias": "model-00014-of-00014.safetensors",
746
+ "model.visual.blocks.10.norm1.weight": "model-00014-of-00014.safetensors",
747
+ "model.visual.blocks.10.norm2.bias": "model-00014-of-00014.safetensors",
748
+ "model.visual.blocks.10.norm2.weight": "model-00014-of-00014.safetensors",
749
+ "model.visual.blocks.11.attn.proj.bias": "model-00014-of-00014.safetensors",
750
+ "model.visual.blocks.11.attn.proj.weight": "model-00014-of-00014.safetensors",
751
+ "model.visual.blocks.11.attn.qkv.bias": "model-00014-of-00014.safetensors",
752
+ "model.visual.blocks.11.attn.qkv.weight": "model-00014-of-00014.safetensors",
753
+ "model.visual.blocks.11.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
754
+ "model.visual.blocks.11.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
755
+ "model.visual.blocks.11.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
756
+ "model.visual.blocks.11.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
757
+ "model.visual.blocks.11.norm1.bias": "model-00014-of-00014.safetensors",
758
+ "model.visual.blocks.11.norm1.weight": "model-00014-of-00014.safetensors",
759
+ "model.visual.blocks.11.norm2.bias": "model-00014-of-00014.safetensors",
760
+ "model.visual.blocks.11.norm2.weight": "model-00014-of-00014.safetensors",
761
+ "model.visual.blocks.12.attn.proj.bias": "model-00014-of-00014.safetensors",
762
+ "model.visual.blocks.12.attn.proj.weight": "model-00014-of-00014.safetensors",
763
+ "model.visual.blocks.12.attn.qkv.bias": "model-00014-of-00014.safetensors",
764
+ "model.visual.blocks.12.attn.qkv.weight": "model-00014-of-00014.safetensors",
765
+ "model.visual.blocks.12.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
766
+ "model.visual.blocks.12.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
767
+ "model.visual.blocks.12.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
768
+ "model.visual.blocks.12.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
769
+ "model.visual.blocks.12.norm1.bias": "model-00014-of-00014.safetensors",
770
+ "model.visual.blocks.12.norm1.weight": "model-00014-of-00014.safetensors",
771
+ "model.visual.blocks.12.norm2.bias": "model-00014-of-00014.safetensors",
772
+ "model.visual.blocks.12.norm2.weight": "model-00014-of-00014.safetensors",
773
+ "model.visual.blocks.13.attn.proj.bias": "model-00014-of-00014.safetensors",
774
+ "model.visual.blocks.13.attn.proj.weight": "model-00014-of-00014.safetensors",
775
+ "model.visual.blocks.13.attn.qkv.bias": "model-00014-of-00014.safetensors",
776
+ "model.visual.blocks.13.attn.qkv.weight": "model-00014-of-00014.safetensors",
777
+ "model.visual.blocks.13.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
778
+ "model.visual.blocks.13.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
779
+ "model.visual.blocks.13.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
780
+ "model.visual.blocks.13.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
781
+ "model.visual.blocks.13.norm1.bias": "model-00014-of-00014.safetensors",
782
+ "model.visual.blocks.13.norm1.weight": "model-00014-of-00014.safetensors",
783
+ "model.visual.blocks.13.norm2.bias": "model-00014-of-00014.safetensors",
784
+ "model.visual.blocks.13.norm2.weight": "model-00014-of-00014.safetensors",
785
+ "model.visual.blocks.14.attn.proj.bias": "model-00014-of-00014.safetensors",
786
+ "model.visual.blocks.14.attn.proj.weight": "model-00014-of-00014.safetensors",
787
+ "model.visual.blocks.14.attn.qkv.bias": "model-00014-of-00014.safetensors",
788
+ "model.visual.blocks.14.attn.qkv.weight": "model-00014-of-00014.safetensors",
789
+ "model.visual.blocks.14.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
790
+ "model.visual.blocks.14.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
791
+ "model.visual.blocks.14.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
792
+ "model.visual.blocks.14.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
793
+ "model.visual.blocks.14.norm1.bias": "model-00014-of-00014.safetensors",
794
+ "model.visual.blocks.14.norm1.weight": "model-00014-of-00014.safetensors",
795
+ "model.visual.blocks.14.norm2.bias": "model-00014-of-00014.safetensors",
796
+ "model.visual.blocks.14.norm2.weight": "model-00014-of-00014.safetensors",
797
+ "model.visual.blocks.15.attn.proj.bias": "model-00014-of-00014.safetensors",
798
+ "model.visual.blocks.15.attn.proj.weight": "model-00014-of-00014.safetensors",
799
+ "model.visual.blocks.15.attn.qkv.bias": "model-00014-of-00014.safetensors",
800
+ "model.visual.blocks.15.attn.qkv.weight": "model-00014-of-00014.safetensors",
801
+ "model.visual.blocks.15.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
802
+ "model.visual.blocks.15.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
803
+ "model.visual.blocks.15.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
804
+ "model.visual.blocks.15.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
805
+ "model.visual.blocks.15.norm1.bias": "model-00014-of-00014.safetensors",
806
+ "model.visual.blocks.15.norm1.weight": "model-00014-of-00014.safetensors",
807
+ "model.visual.blocks.15.norm2.bias": "model-00014-of-00014.safetensors",
808
+ "model.visual.blocks.15.norm2.weight": "model-00014-of-00014.safetensors",
809
+ "model.visual.blocks.16.attn.proj.bias": "model-00014-of-00014.safetensors",
810
+ "model.visual.blocks.16.attn.proj.weight": "model-00014-of-00014.safetensors",
811
+ "model.visual.blocks.16.attn.qkv.bias": "model-00014-of-00014.safetensors",
812
+ "model.visual.blocks.16.attn.qkv.weight": "model-00014-of-00014.safetensors",
813
+ "model.visual.blocks.16.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
814
+ "model.visual.blocks.16.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
815
+ "model.visual.blocks.16.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
816
+ "model.visual.blocks.16.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
817
+ "model.visual.blocks.16.norm1.bias": "model-00014-of-00014.safetensors",
818
+ "model.visual.blocks.16.norm1.weight": "model-00014-of-00014.safetensors",
819
+ "model.visual.blocks.16.norm2.bias": "model-00014-of-00014.safetensors",
820
+ "model.visual.blocks.16.norm2.weight": "model-00014-of-00014.safetensors",
821
+ "model.visual.blocks.17.attn.proj.bias": "model-00014-of-00014.safetensors",
822
+ "model.visual.blocks.17.attn.proj.weight": "model-00014-of-00014.safetensors",
823
+ "model.visual.blocks.17.attn.qkv.bias": "model-00014-of-00014.safetensors",
824
+ "model.visual.blocks.17.attn.qkv.weight": "model-00014-of-00014.safetensors",
825
+ "model.visual.blocks.17.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
826
+ "model.visual.blocks.17.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
827
+ "model.visual.blocks.17.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
828
+ "model.visual.blocks.17.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
829
+ "model.visual.blocks.17.norm1.bias": "model-00014-of-00014.safetensors",
830
+ "model.visual.blocks.17.norm1.weight": "model-00014-of-00014.safetensors",
831
+ "model.visual.blocks.17.norm2.bias": "model-00014-of-00014.safetensors",
832
+ "model.visual.blocks.17.norm2.weight": "model-00014-of-00014.safetensors",
833
+ "model.visual.blocks.18.attn.proj.bias": "model-00014-of-00014.safetensors",
834
+ "model.visual.blocks.18.attn.proj.weight": "model-00014-of-00014.safetensors",
835
+ "model.visual.blocks.18.attn.qkv.bias": "model-00014-of-00014.safetensors",
836
+ "model.visual.blocks.18.attn.qkv.weight": "model-00014-of-00014.safetensors",
837
+ "model.visual.blocks.18.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
838
+ "model.visual.blocks.18.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
839
+ "model.visual.blocks.18.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
840
+ "model.visual.blocks.18.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
841
+ "model.visual.blocks.18.norm1.bias": "model-00014-of-00014.safetensors",
842
+ "model.visual.blocks.18.norm1.weight": "model-00014-of-00014.safetensors",
843
+ "model.visual.blocks.18.norm2.bias": "model-00014-of-00014.safetensors",
844
+ "model.visual.blocks.18.norm2.weight": "model-00014-of-00014.safetensors",
845
+ "model.visual.blocks.19.attn.proj.bias": "model-00014-of-00014.safetensors",
846
+ "model.visual.blocks.19.attn.proj.weight": "model-00014-of-00014.safetensors",
847
+ "model.visual.blocks.19.attn.qkv.bias": "model-00014-of-00014.safetensors",
848
+ "model.visual.blocks.19.attn.qkv.weight": "model-00014-of-00014.safetensors",
849
+ "model.visual.blocks.19.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
850
+ "model.visual.blocks.19.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
851
+ "model.visual.blocks.19.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
852
+ "model.visual.blocks.19.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
853
+ "model.visual.blocks.19.norm1.bias": "model-00014-of-00014.safetensors",
854
+ "model.visual.blocks.19.norm1.weight": "model-00014-of-00014.safetensors",
855
+ "model.visual.blocks.19.norm2.bias": "model-00014-of-00014.safetensors",
856
+ "model.visual.blocks.19.norm2.weight": "model-00014-of-00014.safetensors",
857
+ "model.visual.blocks.2.attn.proj.bias": "model-00014-of-00014.safetensors",
858
+ "model.visual.blocks.2.attn.proj.weight": "model-00014-of-00014.safetensors",
859
+ "model.visual.blocks.2.attn.qkv.bias": "model-00014-of-00014.safetensors",
860
+ "model.visual.blocks.2.attn.qkv.weight": "model-00014-of-00014.safetensors",
861
+ "model.visual.blocks.2.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
862
+ "model.visual.blocks.2.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
863
+ "model.visual.blocks.2.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
864
+ "model.visual.blocks.2.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
865
+ "model.visual.blocks.2.norm1.bias": "model-00014-of-00014.safetensors",
866
+ "model.visual.blocks.2.norm1.weight": "model-00014-of-00014.safetensors",
867
+ "model.visual.blocks.2.norm2.bias": "model-00014-of-00014.safetensors",
868
+ "model.visual.blocks.2.norm2.weight": "model-00014-of-00014.safetensors",
869
+ "model.visual.blocks.20.attn.proj.bias": "model-00014-of-00014.safetensors",
870
+ "model.visual.blocks.20.attn.proj.weight": "model-00014-of-00014.safetensors",
871
+ "model.visual.blocks.20.attn.qkv.bias": "model-00014-of-00014.safetensors",
872
+ "model.visual.blocks.20.attn.qkv.weight": "model-00014-of-00014.safetensors",
873
+ "model.visual.blocks.20.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
874
+ "model.visual.blocks.20.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
875
+ "model.visual.blocks.20.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
876
+ "model.visual.blocks.20.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
877
+ "model.visual.blocks.20.norm1.bias": "model-00014-of-00014.safetensors",
878
+ "model.visual.blocks.20.norm1.weight": "model-00014-of-00014.safetensors",
879
+ "model.visual.blocks.20.norm2.bias": "model-00014-of-00014.safetensors",
880
+ "model.visual.blocks.20.norm2.weight": "model-00014-of-00014.safetensors",
881
+ "model.visual.blocks.21.attn.proj.bias": "model-00014-of-00014.safetensors",
882
+ "model.visual.blocks.21.attn.proj.weight": "model-00014-of-00014.safetensors",
883
+ "model.visual.blocks.21.attn.qkv.bias": "model-00014-of-00014.safetensors",
884
+ "model.visual.blocks.21.attn.qkv.weight": "model-00014-of-00014.safetensors",
885
+ "model.visual.blocks.21.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
886
+ "model.visual.blocks.21.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
887
+ "model.visual.blocks.21.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
888
+ "model.visual.blocks.21.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
889
+ "model.visual.blocks.21.norm1.bias": "model-00014-of-00014.safetensors",
890
+ "model.visual.blocks.21.norm1.weight": "model-00014-of-00014.safetensors",
891
+ "model.visual.blocks.21.norm2.bias": "model-00014-of-00014.safetensors",
892
+ "model.visual.blocks.21.norm2.weight": "model-00014-of-00014.safetensors",
893
+ "model.visual.blocks.22.attn.proj.bias": "model-00014-of-00014.safetensors",
894
+ "model.visual.blocks.22.attn.proj.weight": "model-00014-of-00014.safetensors",
895
+ "model.visual.blocks.22.attn.qkv.bias": "model-00014-of-00014.safetensors",
896
+ "model.visual.blocks.22.attn.qkv.weight": "model-00014-of-00014.safetensors",
897
+ "model.visual.blocks.22.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
898
+ "model.visual.blocks.22.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
899
+ "model.visual.blocks.22.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
900
+ "model.visual.blocks.22.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
901
+ "model.visual.blocks.22.norm1.bias": "model-00014-of-00014.safetensors",
902
+ "model.visual.blocks.22.norm1.weight": "model-00014-of-00014.safetensors",
903
+ "model.visual.blocks.22.norm2.bias": "model-00014-of-00014.safetensors",
904
+ "model.visual.blocks.22.norm2.weight": "model-00014-of-00014.safetensors",
905
+ "model.visual.blocks.23.attn.proj.bias": "model-00014-of-00014.safetensors",
906
+ "model.visual.blocks.23.attn.proj.weight": "model-00014-of-00014.safetensors",
907
+ "model.visual.blocks.23.attn.qkv.bias": "model-00014-of-00014.safetensors",
908
+ "model.visual.blocks.23.attn.qkv.weight": "model-00014-of-00014.safetensors",
909
+ "model.visual.blocks.23.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
910
+ "model.visual.blocks.23.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
911
+ "model.visual.blocks.23.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
912
+ "model.visual.blocks.23.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
913
+ "model.visual.blocks.23.norm1.bias": "model-00014-of-00014.safetensors",
914
+ "model.visual.blocks.23.norm1.weight": "model-00014-of-00014.safetensors",
915
+ "model.visual.blocks.23.norm2.bias": "model-00014-of-00014.safetensors",
916
+ "model.visual.blocks.23.norm2.weight": "model-00014-of-00014.safetensors",
917
+ "model.visual.blocks.24.attn.proj.bias": "model-00014-of-00014.safetensors",
918
+ "model.visual.blocks.24.attn.proj.weight": "model-00014-of-00014.safetensors",
919
+ "model.visual.blocks.24.attn.qkv.bias": "model-00014-of-00014.safetensors",
920
+ "model.visual.blocks.24.attn.qkv.weight": "model-00014-of-00014.safetensors",
921
+ "model.visual.blocks.24.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
922
+ "model.visual.blocks.24.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
923
+ "model.visual.blocks.24.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
924
+ "model.visual.blocks.24.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
925
+ "model.visual.blocks.24.norm1.bias": "model-00014-of-00014.safetensors",
926
+ "model.visual.blocks.24.norm1.weight": "model-00014-of-00014.safetensors",
927
+ "model.visual.blocks.24.norm2.bias": "model-00014-of-00014.safetensors",
928
+ "model.visual.blocks.24.norm2.weight": "model-00014-of-00014.safetensors",
929
+ "model.visual.blocks.25.attn.proj.bias": "model-00014-of-00014.safetensors",
930
+ "model.visual.blocks.25.attn.proj.weight": "model-00014-of-00014.safetensors",
931
+ "model.visual.blocks.25.attn.qkv.bias": "model-00014-of-00014.safetensors",
932
+ "model.visual.blocks.25.attn.qkv.weight": "model-00014-of-00014.safetensors",
933
+ "model.visual.blocks.25.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
934
+ "model.visual.blocks.25.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
935
+ "model.visual.blocks.25.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
936
+ "model.visual.blocks.25.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
937
+ "model.visual.blocks.25.norm1.bias": "model-00014-of-00014.safetensors",
938
+ "model.visual.blocks.25.norm1.weight": "model-00014-of-00014.safetensors",
939
+ "model.visual.blocks.25.norm2.bias": "model-00014-of-00014.safetensors",
940
+ "model.visual.blocks.25.norm2.weight": "model-00014-of-00014.safetensors",
941
+ "model.visual.blocks.26.attn.proj.bias": "model-00014-of-00014.safetensors",
942
+ "model.visual.blocks.26.attn.proj.weight": "model-00014-of-00014.safetensors",
943
+ "model.visual.blocks.26.attn.qkv.bias": "model-00014-of-00014.safetensors",
944
+ "model.visual.blocks.26.attn.qkv.weight": "model-00014-of-00014.safetensors",
945
+ "model.visual.blocks.26.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
946
+ "model.visual.blocks.26.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
947
+ "model.visual.blocks.26.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
948
+ "model.visual.blocks.26.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
949
+ "model.visual.blocks.26.norm1.bias": "model-00014-of-00014.safetensors",
950
+ "model.visual.blocks.26.norm1.weight": "model-00014-of-00014.safetensors",
951
+ "model.visual.blocks.26.norm2.bias": "model-00014-of-00014.safetensors",
952
+ "model.visual.blocks.26.norm2.weight": "model-00014-of-00014.safetensors",
953
+ "model.visual.blocks.3.attn.proj.bias": "model-00014-of-00014.safetensors",
954
+ "model.visual.blocks.3.attn.proj.weight": "model-00014-of-00014.safetensors",
955
+ "model.visual.blocks.3.attn.qkv.bias": "model-00014-of-00014.safetensors",
956
+ "model.visual.blocks.3.attn.qkv.weight": "model-00014-of-00014.safetensors",
957
+ "model.visual.blocks.3.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
958
+ "model.visual.blocks.3.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
959
+ "model.visual.blocks.3.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
960
+ "model.visual.blocks.3.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
961
+ "model.visual.blocks.3.norm1.bias": "model-00014-of-00014.safetensors",
962
+ "model.visual.blocks.3.norm1.weight": "model-00014-of-00014.safetensors",
963
+ "model.visual.blocks.3.norm2.bias": "model-00014-of-00014.safetensors",
964
+ "model.visual.blocks.3.norm2.weight": "model-00014-of-00014.safetensors",
965
+ "model.visual.blocks.4.attn.proj.bias": "model-00014-of-00014.safetensors",
966
+ "model.visual.blocks.4.attn.proj.weight": "model-00014-of-00014.safetensors",
967
+ "model.visual.blocks.4.attn.qkv.bias": "model-00014-of-00014.safetensors",
968
+ "model.visual.blocks.4.attn.qkv.weight": "model-00014-of-00014.safetensors",
969
+ "model.visual.blocks.4.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
970
+ "model.visual.blocks.4.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
971
+ "model.visual.blocks.4.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
972
+ "model.visual.blocks.4.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
973
+ "model.visual.blocks.4.norm1.bias": "model-00014-of-00014.safetensors",
974
+ "model.visual.blocks.4.norm1.weight": "model-00014-of-00014.safetensors",
975
+ "model.visual.blocks.4.norm2.bias": "model-00014-of-00014.safetensors",
976
+ "model.visual.blocks.4.norm2.weight": "model-00014-of-00014.safetensors",
977
+ "model.visual.blocks.5.attn.proj.bias": "model-00014-of-00014.safetensors",
978
+ "model.visual.blocks.5.attn.proj.weight": "model-00014-of-00014.safetensors",
979
+ "model.visual.blocks.5.attn.qkv.bias": "model-00014-of-00014.safetensors",
980
+ "model.visual.blocks.5.attn.qkv.weight": "model-00014-of-00014.safetensors",
981
+ "model.visual.blocks.5.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
982
+ "model.visual.blocks.5.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
983
+ "model.visual.blocks.5.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
984
+ "model.visual.blocks.5.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
985
+ "model.visual.blocks.5.norm1.bias": "model-00014-of-00014.safetensors",
986
+ "model.visual.blocks.5.norm1.weight": "model-00014-of-00014.safetensors",
987
+ "model.visual.blocks.5.norm2.bias": "model-00014-of-00014.safetensors",
988
+ "model.visual.blocks.5.norm2.weight": "model-00014-of-00014.safetensors",
989
+ "model.visual.blocks.6.attn.proj.bias": "model-00014-of-00014.safetensors",
990
+ "model.visual.blocks.6.attn.proj.weight": "model-00014-of-00014.safetensors",
991
+ "model.visual.blocks.6.attn.qkv.bias": "model-00014-of-00014.safetensors",
992
+ "model.visual.blocks.6.attn.qkv.weight": "model-00014-of-00014.safetensors",
993
+ "model.visual.blocks.6.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
994
+ "model.visual.blocks.6.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
995
+ "model.visual.blocks.6.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
996
+ "model.visual.blocks.6.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
997
+ "model.visual.blocks.6.norm1.bias": "model-00014-of-00014.safetensors",
998
+ "model.visual.blocks.6.norm1.weight": "model-00014-of-00014.safetensors",
999
+ "model.visual.blocks.6.norm2.bias": "model-00014-of-00014.safetensors",
1000
+ "model.visual.blocks.6.norm2.weight": "model-00014-of-00014.safetensors",
1001
+ "model.visual.blocks.7.attn.proj.bias": "model-00014-of-00014.safetensors",
1002
+ "model.visual.blocks.7.attn.proj.weight": "model-00014-of-00014.safetensors",
1003
+ "model.visual.blocks.7.attn.qkv.bias": "model-00014-of-00014.safetensors",
1004
+ "model.visual.blocks.7.attn.qkv.weight": "model-00014-of-00014.safetensors",
1005
+ "model.visual.blocks.7.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
1006
+ "model.visual.blocks.7.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
1007
+ "model.visual.blocks.7.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
1008
+ "model.visual.blocks.7.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
1009
+ "model.visual.blocks.7.norm1.bias": "model-00014-of-00014.safetensors",
1010
+ "model.visual.blocks.7.norm1.weight": "model-00014-of-00014.safetensors",
1011
+ "model.visual.blocks.7.norm2.bias": "model-00014-of-00014.safetensors",
1012
+ "model.visual.blocks.7.norm2.weight": "model-00014-of-00014.safetensors",
1013
+ "model.visual.blocks.8.attn.proj.bias": "model-00014-of-00014.safetensors",
1014
+ "model.visual.blocks.8.attn.proj.weight": "model-00014-of-00014.safetensors",
1015
+ "model.visual.blocks.8.attn.qkv.bias": "model-00014-of-00014.safetensors",
1016
+ "model.visual.blocks.8.attn.qkv.weight": "model-00014-of-00014.safetensors",
1017
+ "model.visual.blocks.8.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
1018
+ "model.visual.blocks.8.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
1019
+ "model.visual.blocks.8.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
1020
+ "model.visual.blocks.8.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
1021
+ "model.visual.blocks.8.norm1.bias": "model-00014-of-00014.safetensors",
1022
+ "model.visual.blocks.8.norm1.weight": "model-00014-of-00014.safetensors",
1023
+ "model.visual.blocks.8.norm2.bias": "model-00014-of-00014.safetensors",
1024
+ "model.visual.blocks.8.norm2.weight": "model-00014-of-00014.safetensors",
1025
+ "model.visual.blocks.9.attn.proj.bias": "model-00014-of-00014.safetensors",
1026
+ "model.visual.blocks.9.attn.proj.weight": "model-00014-of-00014.safetensors",
1027
+ "model.visual.blocks.9.attn.qkv.bias": "model-00014-of-00014.safetensors",
1028
+ "model.visual.blocks.9.attn.qkv.weight": "model-00014-of-00014.safetensors",
1029
+ "model.visual.blocks.9.mlp.linear_fc1.bias": "model-00014-of-00014.safetensors",
1030
+ "model.visual.blocks.9.mlp.linear_fc1.weight": "model-00014-of-00014.safetensors",
1031
+ "model.visual.blocks.9.mlp.linear_fc2.bias": "model-00014-of-00014.safetensors",
1032
+ "model.visual.blocks.9.mlp.linear_fc2.weight": "model-00014-of-00014.safetensors",
1033
+ "model.visual.blocks.9.norm1.bias": "model-00014-of-00014.safetensors",
1034
+ "model.visual.blocks.9.norm1.weight": "model-00014-of-00014.safetensors",
1035
+ "model.visual.blocks.9.norm2.bias": "model-00014-of-00014.safetensors",
1036
+ "model.visual.blocks.9.norm2.weight": "model-00014-of-00014.safetensors",
1037
+ "model.visual.deepstack_merger_list.0.linear_fc1.bias": "model-00014-of-00014.safetensors",
1038
+ "model.visual.deepstack_merger_list.0.linear_fc1.weight": "model-00014-of-00014.safetensors",
1039
+ "model.visual.deepstack_merger_list.0.linear_fc2.bias": "model-00014-of-00014.safetensors",
1040
+ "model.visual.deepstack_merger_list.0.linear_fc2.weight": "model-00014-of-00014.safetensors",
1041
+ "model.visual.deepstack_merger_list.0.norm.bias": "model-00014-of-00014.safetensors",
1042
+ "model.visual.deepstack_merger_list.0.norm.weight": "model-00014-of-00014.safetensors",
1043
+ "model.visual.deepstack_merger_list.1.linear_fc1.bias": "model-00014-of-00014.safetensors",
1044
+ "model.visual.deepstack_merger_list.1.linear_fc1.weight": "model-00014-of-00014.safetensors",
1045
+ "model.visual.deepstack_merger_list.1.linear_fc2.bias": "model-00014-of-00014.safetensors",
1046
+ "model.visual.deepstack_merger_list.1.linear_fc2.weight": "model-00014-of-00014.safetensors",
1047
+ "model.visual.deepstack_merger_list.1.norm.bias": "model-00014-of-00014.safetensors",
1048
+ "model.visual.deepstack_merger_list.1.norm.weight": "model-00014-of-00014.safetensors",
1049
+ "model.visual.deepstack_merger_list.2.linear_fc1.bias": "model-00014-of-00014.safetensors",
1050
+ "model.visual.deepstack_merger_list.2.linear_fc1.weight": "model-00014-of-00014.safetensors",
1051
+ "model.visual.deepstack_merger_list.2.linear_fc2.bias": "model-00014-of-00014.safetensors",
1052
+ "model.visual.deepstack_merger_list.2.linear_fc2.weight": "model-00014-of-00014.safetensors",
1053
+ "model.visual.deepstack_merger_list.2.norm.bias": "model-00014-of-00014.safetensors",
1054
+ "model.visual.deepstack_merger_list.2.norm.weight": "model-00014-of-00014.safetensors",
1055
+ "model.visual.merger.linear_fc1.bias": "model-00014-of-00014.safetensors",
1056
+ "model.visual.merger.linear_fc1.weight": "model-00014-of-00014.safetensors",
1057
+ "model.visual.merger.linear_fc2.bias": "model-00014-of-00014.safetensors",
1058
+ "model.visual.merger.linear_fc2.weight": "model-00014-of-00014.safetensors",
1059
+ "model.visual.merger.norm.bias": "model-00014-of-00014.safetensors",
1060
+ "model.visual.merger.norm.weight": "model-00014-of-00014.safetensors",
1061
+ "model.visual.patch_embed.proj.bias": "model-00014-of-00014.safetensors",
1062
+ "model.visual.patch_embed.proj.weight": "model-00014-of-00014.safetensors",
1063
+ "model.visual.pos_embed.weight": "model-00014-of-00014.safetensors"
1064
+ }
1065
+ }
text_encoder/preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 16777216,
4
+ "shortest_edge": 65536
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "image_processor_type": "Qwen2VLImageProcessorFast"
21
+ }
text_encoder/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
text_encoder/tokenizer_config.json ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>",
228
+ "<d>",
229
+ "</d>",
230
+ "<|cutoff|>",
231
+ "<|lyrics_start|>",
232
+ "<|lyrics_end|>",
233
+ "<|caption_start|>",
234
+ "<|caption_end|>"
235
+ ],
236
+ "bos_token": null,
237
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
238
+ "clean_up_tokenization_spaces": false,
239
+ "eos_token": "<|im_end|>",
240
+ "errors": "replace",
241
+ "model_max_length": 262144,
242
+ "pad_token": "<|endoftext|>",
243
+ "split_special_tokens": false,
244
+ "tokenizer_class": "Qwen2Tokenizer",
245
+ "unk_token": null
246
+ }
text_encoder/video_preprocessor_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "size": {
3
+ "longest_edge": 25165824,
4
+ "shortest_edge": 4096
5
+ },
6
+ "patch_size": 16,
7
+ "temporal_patch_size": 2,
8
+ "merge_size": 2,
9
+ "image_mean": [
10
+ 0.5,
11
+ 0.5,
12
+ 0.5
13
+ ],
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "Qwen3VLProcessor",
20
+ "video_processor_type": "Qwen3VLVideoProcessor"
21
+ }
text_encoder/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,246 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ },
181
+ "151665": {
182
+ "content": "<tool_response>",
183
+ "lstrip": false,
184
+ "normalized": false,
185
+ "rstrip": false,
186
+ "single_word": false,
187
+ "special": false
188
+ },
189
+ "151666": {
190
+ "content": "</tool_response>",
191
+ "lstrip": false,
192
+ "normalized": false,
193
+ "rstrip": false,
194
+ "single_word": false,
195
+ "special": false
196
+ },
197
+ "151667": {
198
+ "content": "<think>",
199
+ "lstrip": false,
200
+ "normalized": false,
201
+ "rstrip": false,
202
+ "single_word": false,
203
+ "special": false
204
+ },
205
+ "151668": {
206
+ "content": "</think>",
207
+ "lstrip": false,
208
+ "normalized": false,
209
+ "rstrip": false,
210
+ "single_word": false,
211
+ "special": false
212
+ }
213
+ },
214
+ "additional_special_tokens": [
215
+ "<|im_start|>",
216
+ "<|im_end|>",
217
+ "<|object_ref_start|>",
218
+ "<|object_ref_end|>",
219
+ "<|box_start|>",
220
+ "<|box_end|>",
221
+ "<|quad_start|>",
222
+ "<|quad_end|>",
223
+ "<|vision_start|>",
224
+ "<|vision_end|>",
225
+ "<|vision_pad|>",
226
+ "<|image_pad|>",
227
+ "<|video_pad|>",
228
+ "<d>",
229
+ "</d>",
230
+ "<|cutoff|>",
231
+ "<|lyrics_start|>",
232
+ "<|lyrics_end|>",
233
+ "<|caption_start|>",
234
+ "<|caption_end|>"
235
+ ],
236
+ "bos_token": null,
237
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].role == 'system' %}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n\\n' }}\n {%- endif %}\n {{- \"# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0].role == 'system' %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0].content is string %}\n {{- messages[0].content }}\n {%- else %}\n {%- for content in messages[0].content %}\n {%- if 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- set image_count = namespace(value=0) %}\n{%- set video_count = namespace(value=0) %}\n{%- for message in messages %}\n {%- if message.role == \"user\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role + '\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content_item in message.content %}\n {%- if 'text' in content_item %}\n {{- content_item.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {%- if message.tool_calls %}\n {%- for tool_call in message.tool_calls %}\n {%- if (loop.first and message.content) or (not loop.first) %}\n {{- '\\n' }}\n {%- endif %}\n {%- if tool_call.function %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {%- if tool_call.arguments is string %}\n {{- tool_call.arguments }}\n {%- else %}\n {{- tool_call.arguments | tojson }}\n {%- endif %}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {%- endif %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if loop.first or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {%- if message.content is string %}\n {{- message.content }}\n {%- else %}\n {%- for content in message.content %}\n {%- if content.type == 'image' or 'image' in content or 'image_url' in content %}\n {%- set image_count.value = image_count.value + 1 %}\n {%- if add_vision_id %}Picture {{ image_count.value }}: {% endif -%}\n <|vision_start|><|image_pad|><|vision_end|>\n {%- elif content.type == 'video' or 'video' in content %}\n {%- set video_count.value = video_count.value + 1 %}\n {%- if add_vision_id %}Video {{ video_count.value }}: {% endif -%}\n <|vision_start|><|video_pad|><|vision_end|>\n {%- elif 'text' in content %}\n {{- content.text }}\n {%- endif %}\n {%- endfor %}\n {%- endif %}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
238
+ "clean_up_tokenization_spaces": false,
239
+ "eos_token": "<|im_end|>",
240
+ "errors": "replace",
241
+ "model_max_length": 262144,
242
+ "pad_token": "<|endoftext|>",
243
+ "split_special_tokens": false,
244
+ "tokenizer_class": "Qwen2Tokenizer",
245
+ "unk_token": null
246
+ }
tokenizer/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
transformer/config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "MiniMaxH3Transformer3DModel",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "num_attention_heads": 56,
5
+ "attention_head_dim": 128,
6
+ "hidden_size": 5376,
7
+ "num_layers": 50,
8
+ "num_refiner_layers": 2,
9
+ "ffn_dim": 14336,
10
+ "in_channels": 24,
11
+ "audio_in_channels": 32,
12
+ "patch_size": [
13
+ 1,
14
+ 2,
15
+ 2
16
+ ],
17
+ "text_dim": 5120,
18
+ "freq_dim": 256,
19
+ "time_embed_hidden_dim": 5376,
20
+ "time_embed_dim": 2688,
21
+ "rope_freq_dim": 16,
22
+ "rope_theta": 10000.0,
23
+ "norm_eps": 1e-05,
24
+ "qk_norm_eps": 1e-05,
25
+ "final_norm_eps": 1e-05
26
+ }
transformer/diffusion_pytorch_model-00002-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fdb4db67af50e554d63f6107eb25dffe05436b93d010fe7c73365a0daef7a495
3
+ size 3989259848
transformer/diffusion_pytorch_model-00003-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56589eb613578fc3b7630eccfe7f2c2096b063369aa7d4ed0328f0d378567a06
3
+ size 3989259864
transformer/diffusion_pytorch_model-00007-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14d416a288d5254035e76e42d5eb3b8cf56602bbcc595beb0c157124bb8e7044
3
+ size 3989259832
transformer/diffusion_pytorch_model-00008-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f8e479a96a692f1a04bdb4bd26c3ad2369c0bd076052067b8d613e0adcf7877
3
+ size 3989259864
transformer/diffusion_pytorch_model-00009-of-00014.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7daad24c9223ddfc42877366db947c8169f7f85d8f05dc415452a31e80c38c03
3
+ size 3546104680
transformer/diffusion_pytorch_model.safetensors.index.json ADDED
@@ -0,0 +1,895 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 70099502592
4
+ },
5
+ "weight_map": {
6
+ "audio_proj_in.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
7
+ "audio_proj_in.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
8
+ "audio_proj_out.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
9
+ "audio_proj_out.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
10
+ "context_embedder.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
11
+ "context_embedder.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
12
+ "norm_out.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
13
+ "norm_out.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
14
+ "norm_out.norm.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
15
+ "proj_in.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
16
+ "proj_in.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
17
+ "proj_out.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
18
+ "proj_out.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
19
+ "time_embedder.linear_1.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
20
+ "time_embedder.linear_1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
21
+ "time_embedder.linear_2.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
22
+ "time_embedder.linear_2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
23
+ "token_refiner.final_norm.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
24
+ "token_refiner.refiner_blocks.0.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
25
+ "token_refiner.refiner_blocks.0.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
26
+ "token_refiner.refiner_blocks.0.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
27
+ "token_refiner.refiner_blocks.0.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
28
+ "token_refiner.refiner_blocks.0.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
29
+ "token_refiner.refiner_blocks.0.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
30
+ "token_refiner.refiner_blocks.0.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
31
+ "token_refiner.refiner_blocks.0.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
32
+ "token_refiner.refiner_blocks.0.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
33
+ "token_refiner.refiner_blocks.0.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
34
+ "token_refiner.refiner_blocks.1.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
35
+ "token_refiner.refiner_blocks.1.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
36
+ "token_refiner.refiner_blocks.1.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
37
+ "token_refiner.refiner_blocks.1.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
38
+ "token_refiner.refiner_blocks.1.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
39
+ "token_refiner.refiner_blocks.1.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
40
+ "token_refiner.refiner_blocks.1.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
41
+ "token_refiner.refiner_blocks.1.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
42
+ "token_refiner.refiner_blocks.1.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
43
+ "token_refiner.refiner_blocks.1.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
44
+ "transformer_blocks.0.adaln_proj.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
45
+ "transformer_blocks.0.adaln_proj.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
46
+ "transformer_blocks.0.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
47
+ "transformer_blocks.0.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
48
+ "transformer_blocks.0.attn.to_gate_compress.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
49
+ "transformer_blocks.0.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
50
+ "transformer_blocks.0.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
51
+ "transformer_blocks.0.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
52
+ "transformer_blocks.0.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
53
+ "transformer_blocks.0.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
54
+ "transformer_blocks.0.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
55
+ "transformer_blocks.0.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
56
+ "transformer_blocks.0.ff.net.2.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
57
+ "transformer_blocks.0.ff.net.2.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
58
+ "transformer_blocks.0.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
59
+ "transformer_blocks.0.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
60
+ "transformer_blocks.0.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
61
+ "transformer_blocks.1.adaln_proj.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
62
+ "transformer_blocks.1.adaln_proj.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
63
+ "transformer_blocks.1.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
64
+ "transformer_blocks.1.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
65
+ "transformer_blocks.1.attn.to_gate_compress.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
66
+ "transformer_blocks.1.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
67
+ "transformer_blocks.1.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
68
+ "transformer_blocks.1.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
69
+ "transformer_blocks.1.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
70
+ "transformer_blocks.1.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
71
+ "transformer_blocks.1.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
72
+ "transformer_blocks.1.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
73
+ "transformer_blocks.1.ff.net.2.weight_packed": "diffusion_pytorch_model-00001-of-00014.safetensors",
74
+ "transformer_blocks.1.ff.net.2.weight_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
75
+ "transformer_blocks.1.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00001-of-00014.safetensors",
76
+ "transformer_blocks.1.norm1.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
77
+ "transformer_blocks.1.norm2.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
78
+ "transformer_blocks.10.adaln_proj.linear.bias": "diffusion_pytorch_model-00001-of-00014.safetensors",
79
+ "transformer_blocks.10.adaln_proj.linear.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
80
+ "transformer_blocks.10.attn.norm_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
81
+ "transformer_blocks.10.attn.norm_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
82
+ "transformer_blocks.10.attn.to_gate_compress.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
83
+ "transformer_blocks.10.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
84
+ "transformer_blocks.10.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
85
+ "transformer_blocks.10.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
86
+ "transformer_blocks.10.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00014.safetensors",
87
+ "transformer_blocks.10.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
88
+ "transformer_blocks.10.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
89
+ "transformer_blocks.10.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
90
+ "transformer_blocks.10.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
91
+ "transformer_blocks.10.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
92
+ "transformer_blocks.10.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
93
+ "transformer_blocks.10.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
94
+ "transformer_blocks.10.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
95
+ "transformer_blocks.11.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
96
+ "transformer_blocks.11.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
97
+ "transformer_blocks.11.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
98
+ "transformer_blocks.11.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
99
+ "transformer_blocks.11.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
100
+ "transformer_blocks.11.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
101
+ "transformer_blocks.11.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
102
+ "transformer_blocks.11.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
103
+ "transformer_blocks.11.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
104
+ "transformer_blocks.11.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
105
+ "transformer_blocks.11.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
106
+ "transformer_blocks.11.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
107
+ "transformer_blocks.11.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
108
+ "transformer_blocks.11.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
109
+ "transformer_blocks.11.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
110
+ "transformer_blocks.11.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
111
+ "transformer_blocks.11.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
112
+ "transformer_blocks.12.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
113
+ "transformer_blocks.12.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
114
+ "transformer_blocks.12.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
115
+ "transformer_blocks.12.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
116
+ "transformer_blocks.12.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
117
+ "transformer_blocks.12.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
118
+ "transformer_blocks.12.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
119
+ "transformer_blocks.12.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
120
+ "transformer_blocks.12.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
121
+ "transformer_blocks.12.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
122
+ "transformer_blocks.12.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
123
+ "transformer_blocks.12.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
124
+ "transformer_blocks.12.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
125
+ "transformer_blocks.12.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
126
+ "transformer_blocks.12.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
127
+ "transformer_blocks.12.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
128
+ "transformer_blocks.12.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
129
+ "transformer_blocks.13.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
130
+ "transformer_blocks.13.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
131
+ "transformer_blocks.13.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
132
+ "transformer_blocks.13.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
133
+ "transformer_blocks.13.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
134
+ "transformer_blocks.13.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
135
+ "transformer_blocks.13.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
136
+ "transformer_blocks.13.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
137
+ "transformer_blocks.13.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
138
+ "transformer_blocks.13.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
139
+ "transformer_blocks.13.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
140
+ "transformer_blocks.13.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
141
+ "transformer_blocks.13.ff.net.2.weight_packed": "diffusion_pytorch_model-00002-of-00014.safetensors",
142
+ "transformer_blocks.13.ff.net.2.weight_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
143
+ "transformer_blocks.13.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00002-of-00014.safetensors",
144
+ "transformer_blocks.13.norm1.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
145
+ "transformer_blocks.13.norm2.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
146
+ "transformer_blocks.14.adaln_proj.linear.bias": "diffusion_pytorch_model-00002-of-00014.safetensors",
147
+ "transformer_blocks.14.adaln_proj.linear.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
148
+ "transformer_blocks.14.attn.norm_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
149
+ "transformer_blocks.14.attn.norm_q.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
150
+ "transformer_blocks.14.attn.to_gate_compress.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
151
+ "transformer_blocks.14.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
152
+ "transformer_blocks.14.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00014.safetensors",
153
+ "transformer_blocks.14.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
154
+ "transformer_blocks.14.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
155
+ "transformer_blocks.14.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
156
+ "transformer_blocks.14.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
157
+ "transformer_blocks.14.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
158
+ "transformer_blocks.14.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
159
+ "transformer_blocks.14.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
160
+ "transformer_blocks.14.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
161
+ "transformer_blocks.14.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
162
+ "transformer_blocks.14.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
163
+ "transformer_blocks.15.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
164
+ "transformer_blocks.15.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
165
+ "transformer_blocks.15.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
166
+ "transformer_blocks.15.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
167
+ "transformer_blocks.15.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
168
+ "transformer_blocks.15.attn.to_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
169
+ "transformer_blocks.15.attn.to_out.0.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
170
+ "transformer_blocks.15.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
171
+ "transformer_blocks.15.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
172
+ "transformer_blocks.15.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
173
+ "transformer_blocks.15.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
174
+ "transformer_blocks.15.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
175
+ "transformer_blocks.15.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
176
+ "transformer_blocks.15.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
177
+ "transformer_blocks.15.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
178
+ "transformer_blocks.15.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
179
+ "transformer_blocks.15.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
180
+ "transformer_blocks.16.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
181
+ "transformer_blocks.16.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
182
+ "transformer_blocks.16.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
183
+ "transformer_blocks.16.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
184
+ "transformer_blocks.16.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
185
+ "transformer_blocks.16.attn.to_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
186
+ "transformer_blocks.16.attn.to_out.0.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
187
+ "transformer_blocks.16.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
188
+ "transformer_blocks.16.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
189
+ "transformer_blocks.16.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
190
+ "transformer_blocks.16.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
191
+ "transformer_blocks.16.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
192
+ "transformer_blocks.16.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
193
+ "transformer_blocks.16.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
194
+ "transformer_blocks.16.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
195
+ "transformer_blocks.16.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
196
+ "transformer_blocks.16.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
197
+ "transformer_blocks.17.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
198
+ "transformer_blocks.17.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
199
+ "transformer_blocks.17.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
200
+ "transformer_blocks.17.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
201
+ "transformer_blocks.17.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
202
+ "transformer_blocks.17.attn.to_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
203
+ "transformer_blocks.17.attn.to_out.0.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
204
+ "transformer_blocks.17.attn.to_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
205
+ "transformer_blocks.17.attn.to_v.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
206
+ "transformer_blocks.17.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
207
+ "transformer_blocks.17.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
208
+ "transformer_blocks.17.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
209
+ "transformer_blocks.17.ff.net.2.weight_packed": "diffusion_pytorch_model-00003-of-00014.safetensors",
210
+ "transformer_blocks.17.ff.net.2.weight_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
211
+ "transformer_blocks.17.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00003-of-00014.safetensors",
212
+ "transformer_blocks.17.norm1.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
213
+ "transformer_blocks.17.norm2.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
214
+ "transformer_blocks.18.adaln_proj.linear.bias": "diffusion_pytorch_model-00003-of-00014.safetensors",
215
+ "transformer_blocks.18.adaln_proj.linear.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
216
+ "transformer_blocks.18.attn.norm_k.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
217
+ "transformer_blocks.18.attn.norm_q.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
218
+ "transformer_blocks.18.attn.to_gate_compress.weight": "diffusion_pytorch_model-00003-of-00014.safetensors",
219
+ "transformer_blocks.18.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
220
+ "transformer_blocks.18.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
221
+ "transformer_blocks.18.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
222
+ "transformer_blocks.18.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
223
+ "transformer_blocks.18.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
224
+ "transformer_blocks.18.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
225
+ "transformer_blocks.18.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
226
+ "transformer_blocks.18.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
227
+ "transformer_blocks.18.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
228
+ "transformer_blocks.18.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
229
+ "transformer_blocks.18.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
230
+ "transformer_blocks.18.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
231
+ "transformer_blocks.19.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
232
+ "transformer_blocks.19.adaln_proj.linear.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
233
+ "transformer_blocks.19.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
234
+ "transformer_blocks.19.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
235
+ "transformer_blocks.19.attn.to_gate_compress.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
236
+ "transformer_blocks.19.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
237
+ "transformer_blocks.19.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
238
+ "transformer_blocks.19.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
239
+ "transformer_blocks.19.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
240
+ "transformer_blocks.19.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
241
+ "transformer_blocks.19.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
242
+ "transformer_blocks.19.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
243
+ "transformer_blocks.19.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
244
+ "transformer_blocks.19.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
245
+ "transformer_blocks.19.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
246
+ "transformer_blocks.19.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
247
+ "transformer_blocks.19.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
248
+ "transformer_blocks.2.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
249
+ "transformer_blocks.2.adaln_proj.linear.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
250
+ "transformer_blocks.2.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
251
+ "transformer_blocks.2.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
252
+ "transformer_blocks.2.attn.to_gate_compress.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
253
+ "transformer_blocks.2.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
254
+ "transformer_blocks.2.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
255
+ "transformer_blocks.2.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
256
+ "transformer_blocks.2.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
257
+ "transformer_blocks.2.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
258
+ "transformer_blocks.2.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
259
+ "transformer_blocks.2.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
260
+ "transformer_blocks.2.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
261
+ "transformer_blocks.2.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
262
+ "transformer_blocks.2.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
263
+ "transformer_blocks.2.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
264
+ "transformer_blocks.2.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
265
+ "transformer_blocks.20.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
266
+ "transformer_blocks.20.adaln_proj.linear.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
267
+ "transformer_blocks.20.attn.norm_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
268
+ "transformer_blocks.20.attn.norm_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
269
+ "transformer_blocks.20.attn.to_gate_compress.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
270
+ "transformer_blocks.20.attn.to_k.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
271
+ "transformer_blocks.20.attn.to_out.0.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
272
+ "transformer_blocks.20.attn.to_q.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
273
+ "transformer_blocks.20.attn.to_v.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
274
+ "transformer_blocks.20.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
275
+ "transformer_blocks.20.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
276
+ "transformer_blocks.20.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
277
+ "transformer_blocks.20.ff.net.2.weight_packed": "diffusion_pytorch_model-00004-of-00014.safetensors",
278
+ "transformer_blocks.20.ff.net.2.weight_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
279
+ "transformer_blocks.20.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00004-of-00014.safetensors",
280
+ "transformer_blocks.20.norm1.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
281
+ "transformer_blocks.20.norm2.weight": "diffusion_pytorch_model-00004-of-00014.safetensors",
282
+ "transformer_blocks.21.adaln_proj.linear.bias": "diffusion_pytorch_model-00004-of-00014.safetensors",
283
+ "transformer_blocks.21.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
284
+ "transformer_blocks.21.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
285
+ "transformer_blocks.21.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
286
+ "transformer_blocks.21.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
287
+ "transformer_blocks.21.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
288
+ "transformer_blocks.21.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
289
+ "transformer_blocks.21.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
290
+ "transformer_blocks.21.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
291
+ "transformer_blocks.21.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
292
+ "transformer_blocks.21.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
293
+ "transformer_blocks.21.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
294
+ "transformer_blocks.21.ff.net.2.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
295
+ "transformer_blocks.21.ff.net.2.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
296
+ "transformer_blocks.21.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
297
+ "transformer_blocks.21.norm1.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
298
+ "transformer_blocks.21.norm2.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
299
+ "transformer_blocks.22.adaln_proj.linear.bias": "diffusion_pytorch_model-00005-of-00014.safetensors",
300
+ "transformer_blocks.22.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
301
+ "transformer_blocks.22.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
302
+ "transformer_blocks.22.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
303
+ "transformer_blocks.22.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
304
+ "transformer_blocks.22.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
305
+ "transformer_blocks.22.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
306
+ "transformer_blocks.22.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
307
+ "transformer_blocks.22.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
308
+ "transformer_blocks.22.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
309
+ "transformer_blocks.22.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
310
+ "transformer_blocks.22.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
311
+ "transformer_blocks.22.ff.net.2.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
312
+ "transformer_blocks.22.ff.net.2.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
313
+ "transformer_blocks.22.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
314
+ "transformer_blocks.22.norm1.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
315
+ "transformer_blocks.22.norm2.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
316
+ "transformer_blocks.23.adaln_proj.linear.bias": "diffusion_pytorch_model-00005-of-00014.safetensors",
317
+ "transformer_blocks.23.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
318
+ "transformer_blocks.23.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
319
+ "transformer_blocks.23.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
320
+ "transformer_blocks.23.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
321
+ "transformer_blocks.23.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
322
+ "transformer_blocks.23.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
323
+ "transformer_blocks.23.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
324
+ "transformer_blocks.23.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
325
+ "transformer_blocks.23.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
326
+ "transformer_blocks.23.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
327
+ "transformer_blocks.23.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
328
+ "transformer_blocks.23.ff.net.2.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
329
+ "transformer_blocks.23.ff.net.2.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
330
+ "transformer_blocks.23.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
331
+ "transformer_blocks.23.norm1.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
332
+ "transformer_blocks.23.norm2.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
333
+ "transformer_blocks.24.adaln_proj.linear.bias": "diffusion_pytorch_model-00005-of-00014.safetensors",
334
+ "transformer_blocks.24.adaln_proj.linear.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
335
+ "transformer_blocks.24.attn.norm_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
336
+ "transformer_blocks.24.attn.norm_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
337
+ "transformer_blocks.24.attn.to_gate_compress.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
338
+ "transformer_blocks.24.attn.to_k.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
339
+ "transformer_blocks.24.attn.to_out.0.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
340
+ "transformer_blocks.24.attn.to_q.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
341
+ "transformer_blocks.24.attn.to_v.weight": "diffusion_pytorch_model-00005-of-00014.safetensors",
342
+ "transformer_blocks.24.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00005-of-00014.safetensors",
343
+ "transformer_blocks.24.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
344
+ "transformer_blocks.24.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00005-of-00014.safetensors",
345
+ "transformer_blocks.24.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
346
+ "transformer_blocks.24.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
347
+ "transformer_blocks.24.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
348
+ "transformer_blocks.24.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
349
+ "transformer_blocks.24.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
350
+ "transformer_blocks.25.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
351
+ "transformer_blocks.25.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
352
+ "transformer_blocks.25.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
353
+ "transformer_blocks.25.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
354
+ "transformer_blocks.25.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
355
+ "transformer_blocks.25.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
356
+ "transformer_blocks.25.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
357
+ "transformer_blocks.25.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
358
+ "transformer_blocks.25.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
359
+ "transformer_blocks.25.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
360
+ "transformer_blocks.25.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
361
+ "transformer_blocks.25.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
362
+ "transformer_blocks.25.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
363
+ "transformer_blocks.25.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
364
+ "transformer_blocks.25.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
365
+ "transformer_blocks.25.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
366
+ "transformer_blocks.25.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
367
+ "transformer_blocks.26.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
368
+ "transformer_blocks.26.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
369
+ "transformer_blocks.26.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
370
+ "transformer_blocks.26.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
371
+ "transformer_blocks.26.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
372
+ "transformer_blocks.26.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
373
+ "transformer_blocks.26.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
374
+ "transformer_blocks.26.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
375
+ "transformer_blocks.26.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
376
+ "transformer_blocks.26.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
377
+ "transformer_blocks.26.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
378
+ "transformer_blocks.26.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
379
+ "transformer_blocks.26.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
380
+ "transformer_blocks.26.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
381
+ "transformer_blocks.26.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
382
+ "transformer_blocks.26.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
383
+ "transformer_blocks.26.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
384
+ "transformer_blocks.27.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
385
+ "transformer_blocks.27.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
386
+ "transformer_blocks.27.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
387
+ "transformer_blocks.27.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
388
+ "transformer_blocks.27.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
389
+ "transformer_blocks.27.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
390
+ "transformer_blocks.27.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
391
+ "transformer_blocks.27.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
392
+ "transformer_blocks.27.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
393
+ "transformer_blocks.27.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
394
+ "transformer_blocks.27.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
395
+ "transformer_blocks.27.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
396
+ "transformer_blocks.27.ff.net.2.weight_packed": "diffusion_pytorch_model-00006-of-00014.safetensors",
397
+ "transformer_blocks.27.ff.net.2.weight_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
398
+ "transformer_blocks.27.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00006-of-00014.safetensors",
399
+ "transformer_blocks.27.norm1.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
400
+ "transformer_blocks.27.norm2.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
401
+ "transformer_blocks.28.adaln_proj.linear.bias": "diffusion_pytorch_model-00006-of-00014.safetensors",
402
+ "transformer_blocks.28.adaln_proj.linear.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
403
+ "transformer_blocks.28.attn.norm_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
404
+ "transformer_blocks.28.attn.norm_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
405
+ "transformer_blocks.28.attn.to_gate_compress.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
406
+ "transformer_blocks.28.attn.to_k.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
407
+ "transformer_blocks.28.attn.to_out.0.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
408
+ "transformer_blocks.28.attn.to_q.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
409
+ "transformer_blocks.28.attn.to_v.weight": "diffusion_pytorch_model-00006-of-00014.safetensors",
410
+ "transformer_blocks.28.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
411
+ "transformer_blocks.28.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
412
+ "transformer_blocks.28.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
413
+ "transformer_blocks.28.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
414
+ "transformer_blocks.28.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
415
+ "transformer_blocks.28.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
416
+ "transformer_blocks.28.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
417
+ "transformer_blocks.28.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
418
+ "transformer_blocks.29.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
419
+ "transformer_blocks.29.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
420
+ "transformer_blocks.29.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
421
+ "transformer_blocks.29.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
422
+ "transformer_blocks.29.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
423
+ "transformer_blocks.29.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
424
+ "transformer_blocks.29.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
425
+ "transformer_blocks.29.attn.to_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
426
+ "transformer_blocks.29.attn.to_v.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
427
+ "transformer_blocks.29.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
428
+ "transformer_blocks.29.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
429
+ "transformer_blocks.29.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
430
+ "transformer_blocks.29.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
431
+ "transformer_blocks.29.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
432
+ "transformer_blocks.29.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
433
+ "transformer_blocks.29.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
434
+ "transformer_blocks.29.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
435
+ "transformer_blocks.3.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
436
+ "transformer_blocks.3.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
437
+ "transformer_blocks.3.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
438
+ "transformer_blocks.3.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
439
+ "transformer_blocks.3.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
440
+ "transformer_blocks.3.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
441
+ "transformer_blocks.3.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
442
+ "transformer_blocks.3.attn.to_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
443
+ "transformer_blocks.3.attn.to_v.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
444
+ "transformer_blocks.3.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
445
+ "transformer_blocks.3.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
446
+ "transformer_blocks.3.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
447
+ "transformer_blocks.3.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
448
+ "transformer_blocks.3.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
449
+ "transformer_blocks.3.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
450
+ "transformer_blocks.3.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
451
+ "transformer_blocks.3.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
452
+ "transformer_blocks.30.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
453
+ "transformer_blocks.30.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
454
+ "transformer_blocks.30.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
455
+ "transformer_blocks.30.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
456
+ "transformer_blocks.30.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
457
+ "transformer_blocks.30.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
458
+ "transformer_blocks.30.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
459
+ "transformer_blocks.30.attn.to_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
460
+ "transformer_blocks.30.attn.to_v.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
461
+ "transformer_blocks.30.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
462
+ "transformer_blocks.30.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
463
+ "transformer_blocks.30.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
464
+ "transformer_blocks.30.ff.net.2.weight_packed": "diffusion_pytorch_model-00007-of-00014.safetensors",
465
+ "transformer_blocks.30.ff.net.2.weight_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
466
+ "transformer_blocks.30.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00007-of-00014.safetensors",
467
+ "transformer_blocks.30.norm1.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
468
+ "transformer_blocks.30.norm2.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
469
+ "transformer_blocks.31.adaln_proj.linear.bias": "diffusion_pytorch_model-00007-of-00014.safetensors",
470
+ "transformer_blocks.31.adaln_proj.linear.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
471
+ "transformer_blocks.31.attn.norm_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
472
+ "transformer_blocks.31.attn.norm_q.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
473
+ "transformer_blocks.31.attn.to_gate_compress.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
474
+ "transformer_blocks.31.attn.to_k.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
475
+ "transformer_blocks.31.attn.to_out.0.weight": "diffusion_pytorch_model-00007-of-00014.safetensors",
476
+ "transformer_blocks.31.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
477
+ "transformer_blocks.31.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
478
+ "transformer_blocks.31.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
479
+ "transformer_blocks.31.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
480
+ "transformer_blocks.31.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
481
+ "transformer_blocks.31.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
482
+ "transformer_blocks.31.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
483
+ "transformer_blocks.31.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
484
+ "transformer_blocks.31.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
485
+ "transformer_blocks.31.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
486
+ "transformer_blocks.32.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
487
+ "transformer_blocks.32.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
488
+ "transformer_blocks.32.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
489
+ "transformer_blocks.32.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
490
+ "transformer_blocks.32.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
491
+ "transformer_blocks.32.attn.to_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
492
+ "transformer_blocks.32.attn.to_out.0.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
493
+ "transformer_blocks.32.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
494
+ "transformer_blocks.32.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
495
+ "transformer_blocks.32.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
496
+ "transformer_blocks.32.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
497
+ "transformer_blocks.32.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
498
+ "transformer_blocks.32.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
499
+ "transformer_blocks.32.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
500
+ "transformer_blocks.32.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
501
+ "transformer_blocks.32.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
502
+ "transformer_blocks.32.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
503
+ "transformer_blocks.33.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
504
+ "transformer_blocks.33.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
505
+ "transformer_blocks.33.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
506
+ "transformer_blocks.33.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
507
+ "transformer_blocks.33.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
508
+ "transformer_blocks.33.attn.to_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
509
+ "transformer_blocks.33.attn.to_out.0.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
510
+ "transformer_blocks.33.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
511
+ "transformer_blocks.33.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
512
+ "transformer_blocks.33.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
513
+ "transformer_blocks.33.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
514
+ "transformer_blocks.33.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
515
+ "transformer_blocks.33.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
516
+ "transformer_blocks.33.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
517
+ "transformer_blocks.33.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
518
+ "transformer_blocks.33.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
519
+ "transformer_blocks.33.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
520
+ "transformer_blocks.34.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
521
+ "transformer_blocks.34.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
522
+ "transformer_blocks.34.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
523
+ "transformer_blocks.34.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
524
+ "transformer_blocks.34.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
525
+ "transformer_blocks.34.attn.to_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
526
+ "transformer_blocks.34.attn.to_out.0.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
527
+ "transformer_blocks.34.attn.to_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
528
+ "transformer_blocks.34.attn.to_v.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
529
+ "transformer_blocks.34.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
530
+ "transformer_blocks.34.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
531
+ "transformer_blocks.34.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
532
+ "transformer_blocks.34.ff.net.2.weight_packed": "diffusion_pytorch_model-00008-of-00014.safetensors",
533
+ "transformer_blocks.34.ff.net.2.weight_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
534
+ "transformer_blocks.34.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00008-of-00014.safetensors",
535
+ "transformer_blocks.34.norm1.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
536
+ "transformer_blocks.34.norm2.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
537
+ "transformer_blocks.35.adaln_proj.linear.bias": "diffusion_pytorch_model-00008-of-00014.safetensors",
538
+ "transformer_blocks.35.adaln_proj.linear.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
539
+ "transformer_blocks.35.attn.norm_k.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
540
+ "transformer_blocks.35.attn.norm_q.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
541
+ "transformer_blocks.35.attn.to_gate_compress.weight": "diffusion_pytorch_model-00008-of-00014.safetensors",
542
+ "transformer_blocks.35.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
543
+ "transformer_blocks.35.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
544
+ "transformer_blocks.35.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
545
+ "transformer_blocks.35.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
546
+ "transformer_blocks.35.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
547
+ "transformer_blocks.35.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
548
+ "transformer_blocks.35.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
549
+ "transformer_blocks.35.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
550
+ "transformer_blocks.35.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
551
+ "transformer_blocks.35.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
552
+ "transformer_blocks.35.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
553
+ "transformer_blocks.35.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
554
+ "transformer_blocks.36.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
555
+ "transformer_blocks.36.adaln_proj.linear.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
556
+ "transformer_blocks.36.attn.norm_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
557
+ "transformer_blocks.36.attn.norm_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
558
+ "transformer_blocks.36.attn.to_gate_compress.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
559
+ "transformer_blocks.36.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
560
+ "transformer_blocks.36.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
561
+ "transformer_blocks.36.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
562
+ "transformer_blocks.36.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
563
+ "transformer_blocks.36.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
564
+ "transformer_blocks.36.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
565
+ "transformer_blocks.36.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
566
+ "transformer_blocks.36.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
567
+ "transformer_blocks.36.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
568
+ "transformer_blocks.36.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
569
+ "transformer_blocks.36.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
570
+ "transformer_blocks.36.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
571
+ "transformer_blocks.37.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
572
+ "transformer_blocks.37.adaln_proj.linear.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
573
+ "transformer_blocks.37.attn.norm_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
574
+ "transformer_blocks.37.attn.norm_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
575
+ "transformer_blocks.37.attn.to_gate_compress.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
576
+ "transformer_blocks.37.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
577
+ "transformer_blocks.37.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
578
+ "transformer_blocks.37.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
579
+ "transformer_blocks.37.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
580
+ "transformer_blocks.37.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
581
+ "transformer_blocks.37.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
582
+ "transformer_blocks.37.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
583
+ "transformer_blocks.37.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
584
+ "transformer_blocks.37.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
585
+ "transformer_blocks.37.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
586
+ "transformer_blocks.37.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
587
+ "transformer_blocks.37.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
588
+ "transformer_blocks.38.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
589
+ "transformer_blocks.38.adaln_proj.linear.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
590
+ "transformer_blocks.38.attn.norm_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
591
+ "transformer_blocks.38.attn.norm_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
592
+ "transformer_blocks.38.attn.to_gate_compress.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
593
+ "transformer_blocks.38.attn.to_k.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
594
+ "transformer_blocks.38.attn.to_out.0.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
595
+ "transformer_blocks.38.attn.to_q.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
596
+ "transformer_blocks.38.attn.to_v.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
597
+ "transformer_blocks.38.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
598
+ "transformer_blocks.38.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
599
+ "transformer_blocks.38.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
600
+ "transformer_blocks.38.ff.net.2.weight_packed": "diffusion_pytorch_model-00009-of-00014.safetensors",
601
+ "transformer_blocks.38.ff.net.2.weight_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
602
+ "transformer_blocks.38.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00009-of-00014.safetensors",
603
+ "transformer_blocks.38.norm1.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
604
+ "transformer_blocks.38.norm2.weight": "diffusion_pytorch_model-00009-of-00014.safetensors",
605
+ "transformer_blocks.39.adaln_proj.linear.bias": "diffusion_pytorch_model-00009-of-00014.safetensors",
606
+ "transformer_blocks.39.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
607
+ "transformer_blocks.39.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
608
+ "transformer_blocks.39.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
609
+ "transformer_blocks.39.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
610
+ "transformer_blocks.39.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
611
+ "transformer_blocks.39.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
612
+ "transformer_blocks.39.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
613
+ "transformer_blocks.39.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
614
+ "transformer_blocks.39.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
615
+ "transformer_blocks.39.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
616
+ "transformer_blocks.39.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
617
+ "transformer_blocks.39.ff.net.2.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
618
+ "transformer_blocks.39.ff.net.2.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
619
+ "transformer_blocks.39.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
620
+ "transformer_blocks.39.norm1.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
621
+ "transformer_blocks.39.norm2.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
622
+ "transformer_blocks.4.adaln_proj.linear.bias": "diffusion_pytorch_model-00010-of-00014.safetensors",
623
+ "transformer_blocks.4.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
624
+ "transformer_blocks.4.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
625
+ "transformer_blocks.4.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
626
+ "transformer_blocks.4.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
627
+ "transformer_blocks.4.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
628
+ "transformer_blocks.4.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
629
+ "transformer_blocks.4.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
630
+ "transformer_blocks.4.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
631
+ "transformer_blocks.4.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
632
+ "transformer_blocks.4.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
633
+ "transformer_blocks.4.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
634
+ "transformer_blocks.4.ff.net.2.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
635
+ "transformer_blocks.4.ff.net.2.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
636
+ "transformer_blocks.4.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
637
+ "transformer_blocks.4.norm1.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
638
+ "transformer_blocks.4.norm2.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
639
+ "transformer_blocks.40.adaln_proj.linear.bias": "diffusion_pytorch_model-00010-of-00014.safetensors",
640
+ "transformer_blocks.40.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
641
+ "transformer_blocks.40.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
642
+ "transformer_blocks.40.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
643
+ "transformer_blocks.40.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
644
+ "transformer_blocks.40.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
645
+ "transformer_blocks.40.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
646
+ "transformer_blocks.40.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
647
+ "transformer_blocks.40.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
648
+ "transformer_blocks.40.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
649
+ "transformer_blocks.40.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
650
+ "transformer_blocks.40.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
651
+ "transformer_blocks.40.ff.net.2.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
652
+ "transformer_blocks.40.ff.net.2.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
653
+ "transformer_blocks.40.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
654
+ "transformer_blocks.40.norm1.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
655
+ "transformer_blocks.40.norm2.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
656
+ "transformer_blocks.41.adaln_proj.linear.bias": "diffusion_pytorch_model-00010-of-00014.safetensors",
657
+ "transformer_blocks.41.adaln_proj.linear.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
658
+ "transformer_blocks.41.attn.norm_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
659
+ "transformer_blocks.41.attn.norm_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
660
+ "transformer_blocks.41.attn.to_gate_compress.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
661
+ "transformer_blocks.41.attn.to_k.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
662
+ "transformer_blocks.41.attn.to_out.0.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
663
+ "transformer_blocks.41.attn.to_q.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
664
+ "transformer_blocks.41.attn.to_v.weight": "diffusion_pytorch_model-00010-of-00014.safetensors",
665
+ "transformer_blocks.41.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00010-of-00014.safetensors",
666
+ "transformer_blocks.41.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
667
+ "transformer_blocks.41.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00010-of-00014.safetensors",
668
+ "transformer_blocks.41.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
669
+ "transformer_blocks.41.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
670
+ "transformer_blocks.41.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
671
+ "transformer_blocks.41.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
672
+ "transformer_blocks.41.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
673
+ "transformer_blocks.42.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
674
+ "transformer_blocks.42.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
675
+ "transformer_blocks.42.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
676
+ "transformer_blocks.42.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
677
+ "transformer_blocks.42.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
678
+ "transformer_blocks.42.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
679
+ "transformer_blocks.42.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
680
+ "transformer_blocks.42.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
681
+ "transformer_blocks.42.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
682
+ "transformer_blocks.42.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
683
+ "transformer_blocks.42.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
684
+ "transformer_blocks.42.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
685
+ "transformer_blocks.42.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
686
+ "transformer_blocks.42.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
687
+ "transformer_blocks.42.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
688
+ "transformer_blocks.42.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
689
+ "transformer_blocks.42.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
690
+ "transformer_blocks.43.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
691
+ "transformer_blocks.43.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
692
+ "transformer_blocks.43.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
693
+ "transformer_blocks.43.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
694
+ "transformer_blocks.43.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
695
+ "transformer_blocks.43.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
696
+ "transformer_blocks.43.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
697
+ "transformer_blocks.43.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
698
+ "transformer_blocks.43.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
699
+ "transformer_blocks.43.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
700
+ "transformer_blocks.43.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
701
+ "transformer_blocks.43.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
702
+ "transformer_blocks.43.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
703
+ "transformer_blocks.43.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
704
+ "transformer_blocks.43.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
705
+ "transformer_blocks.43.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
706
+ "transformer_blocks.43.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
707
+ "transformer_blocks.44.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
708
+ "transformer_blocks.44.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
709
+ "transformer_blocks.44.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
710
+ "transformer_blocks.44.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
711
+ "transformer_blocks.44.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
712
+ "transformer_blocks.44.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
713
+ "transformer_blocks.44.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
714
+ "transformer_blocks.44.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
715
+ "transformer_blocks.44.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
716
+ "transformer_blocks.44.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
717
+ "transformer_blocks.44.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
718
+ "transformer_blocks.44.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
719
+ "transformer_blocks.44.ff.net.2.weight_packed": "diffusion_pytorch_model-00011-of-00014.safetensors",
720
+ "transformer_blocks.44.ff.net.2.weight_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
721
+ "transformer_blocks.44.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00011-of-00014.safetensors",
722
+ "transformer_blocks.44.norm1.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
723
+ "transformer_blocks.44.norm2.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
724
+ "transformer_blocks.45.adaln_proj.linear.bias": "diffusion_pytorch_model-00011-of-00014.safetensors",
725
+ "transformer_blocks.45.adaln_proj.linear.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
726
+ "transformer_blocks.45.attn.norm_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
727
+ "transformer_blocks.45.attn.norm_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
728
+ "transformer_blocks.45.attn.to_gate_compress.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
729
+ "transformer_blocks.45.attn.to_k.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
730
+ "transformer_blocks.45.attn.to_out.0.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
731
+ "transformer_blocks.45.attn.to_q.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
732
+ "transformer_blocks.45.attn.to_v.weight": "diffusion_pytorch_model-00011-of-00014.safetensors",
733
+ "transformer_blocks.45.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
734
+ "transformer_blocks.45.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
735
+ "transformer_blocks.45.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
736
+ "transformer_blocks.45.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
737
+ "transformer_blocks.45.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
738
+ "transformer_blocks.45.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
739
+ "transformer_blocks.45.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
740
+ "transformer_blocks.45.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
741
+ "transformer_blocks.46.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
742
+ "transformer_blocks.46.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
743
+ "transformer_blocks.46.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
744
+ "transformer_blocks.46.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
745
+ "transformer_blocks.46.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
746
+ "transformer_blocks.46.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
747
+ "transformer_blocks.46.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
748
+ "transformer_blocks.46.attn.to_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
749
+ "transformer_blocks.46.attn.to_v.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
750
+ "transformer_blocks.46.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
751
+ "transformer_blocks.46.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
752
+ "transformer_blocks.46.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
753
+ "transformer_blocks.46.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
754
+ "transformer_blocks.46.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
755
+ "transformer_blocks.46.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
756
+ "transformer_blocks.46.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
757
+ "transformer_blocks.46.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
758
+ "transformer_blocks.47.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
759
+ "transformer_blocks.47.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
760
+ "transformer_blocks.47.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
761
+ "transformer_blocks.47.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
762
+ "transformer_blocks.47.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
763
+ "transformer_blocks.47.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
764
+ "transformer_blocks.47.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
765
+ "transformer_blocks.47.attn.to_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
766
+ "transformer_blocks.47.attn.to_v.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
767
+ "transformer_blocks.47.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
768
+ "transformer_blocks.47.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
769
+ "transformer_blocks.47.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
770
+ "transformer_blocks.47.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
771
+ "transformer_blocks.47.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
772
+ "transformer_blocks.47.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
773
+ "transformer_blocks.47.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
774
+ "transformer_blocks.47.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
775
+ "transformer_blocks.48.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
776
+ "transformer_blocks.48.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
777
+ "transformer_blocks.48.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
778
+ "transformer_blocks.48.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
779
+ "transformer_blocks.48.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
780
+ "transformer_blocks.48.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
781
+ "transformer_blocks.48.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
782
+ "transformer_blocks.48.attn.to_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
783
+ "transformer_blocks.48.attn.to_v.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
784
+ "transformer_blocks.48.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
785
+ "transformer_blocks.48.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
786
+ "transformer_blocks.48.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
787
+ "transformer_blocks.48.ff.net.2.weight_packed": "diffusion_pytorch_model-00012-of-00014.safetensors",
788
+ "transformer_blocks.48.ff.net.2.weight_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
789
+ "transformer_blocks.48.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00012-of-00014.safetensors",
790
+ "transformer_blocks.48.norm1.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
791
+ "transformer_blocks.48.norm2.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
792
+ "transformer_blocks.49.adaln_proj.linear.bias": "diffusion_pytorch_model-00012-of-00014.safetensors",
793
+ "transformer_blocks.49.adaln_proj.linear.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
794
+ "transformer_blocks.49.attn.norm_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
795
+ "transformer_blocks.49.attn.norm_q.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
796
+ "transformer_blocks.49.attn.to_gate_compress.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
797
+ "transformer_blocks.49.attn.to_k.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
798
+ "transformer_blocks.49.attn.to_out.0.weight": "diffusion_pytorch_model-00012-of-00014.safetensors",
799
+ "transformer_blocks.49.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
800
+ "transformer_blocks.49.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
801
+ "transformer_blocks.49.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
802
+ "transformer_blocks.49.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
803
+ "transformer_blocks.49.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
804
+ "transformer_blocks.49.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
805
+ "transformer_blocks.49.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
806
+ "transformer_blocks.49.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
807
+ "transformer_blocks.49.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
808
+ "transformer_blocks.49.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
809
+ "transformer_blocks.5.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
810
+ "transformer_blocks.5.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
811
+ "transformer_blocks.5.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
812
+ "transformer_blocks.5.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
813
+ "transformer_blocks.5.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
814
+ "transformer_blocks.5.attn.to_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
815
+ "transformer_blocks.5.attn.to_out.0.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
816
+ "transformer_blocks.5.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
817
+ "transformer_blocks.5.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
818
+ "transformer_blocks.5.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
819
+ "transformer_blocks.5.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
820
+ "transformer_blocks.5.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
821
+ "transformer_blocks.5.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
822
+ "transformer_blocks.5.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
823
+ "transformer_blocks.5.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
824
+ "transformer_blocks.5.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
825
+ "transformer_blocks.5.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
826
+ "transformer_blocks.6.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
827
+ "transformer_blocks.6.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
828
+ "transformer_blocks.6.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
829
+ "transformer_blocks.6.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
830
+ "transformer_blocks.6.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
831
+ "transformer_blocks.6.attn.to_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
832
+ "transformer_blocks.6.attn.to_out.0.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
833
+ "transformer_blocks.6.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
834
+ "transformer_blocks.6.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
835
+ "transformer_blocks.6.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
836
+ "transformer_blocks.6.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
837
+ "transformer_blocks.6.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
838
+ "transformer_blocks.6.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
839
+ "transformer_blocks.6.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
840
+ "transformer_blocks.6.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
841
+ "transformer_blocks.6.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
842
+ "transformer_blocks.6.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
843
+ "transformer_blocks.7.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
844
+ "transformer_blocks.7.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
845
+ "transformer_blocks.7.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
846
+ "transformer_blocks.7.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
847
+ "transformer_blocks.7.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
848
+ "transformer_blocks.7.attn.to_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
849
+ "transformer_blocks.7.attn.to_out.0.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
850
+ "transformer_blocks.7.attn.to_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
851
+ "transformer_blocks.7.attn.to_v.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
852
+ "transformer_blocks.7.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
853
+ "transformer_blocks.7.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
854
+ "transformer_blocks.7.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
855
+ "transformer_blocks.7.ff.net.2.weight_packed": "diffusion_pytorch_model-00013-of-00014.safetensors",
856
+ "transformer_blocks.7.ff.net.2.weight_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
857
+ "transformer_blocks.7.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00013-of-00014.safetensors",
858
+ "transformer_blocks.7.norm1.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
859
+ "transformer_blocks.7.norm2.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
860
+ "transformer_blocks.8.adaln_proj.linear.bias": "diffusion_pytorch_model-00013-of-00014.safetensors",
861
+ "transformer_blocks.8.adaln_proj.linear.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
862
+ "transformer_blocks.8.attn.norm_k.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
863
+ "transformer_blocks.8.attn.norm_q.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
864
+ "transformer_blocks.8.attn.to_gate_compress.weight": "diffusion_pytorch_model-00013-of-00014.safetensors",
865
+ "transformer_blocks.8.attn.to_k.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
866
+ "transformer_blocks.8.attn.to_out.0.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
867
+ "transformer_blocks.8.attn.to_q.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
868
+ "transformer_blocks.8.attn.to_v.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
869
+ "transformer_blocks.8.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
870
+ "transformer_blocks.8.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
871
+ "transformer_blocks.8.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
872
+ "transformer_blocks.8.ff.net.2.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
873
+ "transformer_blocks.8.ff.net.2.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
874
+ "transformer_blocks.8.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
875
+ "transformer_blocks.8.norm1.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
876
+ "transformer_blocks.8.norm2.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
877
+ "transformer_blocks.9.adaln_proj.linear.bias": "diffusion_pytorch_model-00014-of-00014.safetensors",
878
+ "transformer_blocks.9.adaln_proj.linear.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
879
+ "transformer_blocks.9.attn.norm_k.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
880
+ "transformer_blocks.9.attn.norm_q.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
881
+ "transformer_blocks.9.attn.to_gate_compress.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
882
+ "transformer_blocks.9.attn.to_k.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
883
+ "transformer_blocks.9.attn.to_out.0.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
884
+ "transformer_blocks.9.attn.to_q.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
885
+ "transformer_blocks.9.attn.to_v.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
886
+ "transformer_blocks.9.ff.net.0.proj.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
887
+ "transformer_blocks.9.ff.net.0.proj.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
888
+ "transformer_blocks.9.ff.net.0.proj.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
889
+ "transformer_blocks.9.ff.net.2.weight_packed": "diffusion_pytorch_model-00014-of-00014.safetensors",
890
+ "transformer_blocks.9.ff.net.2.weight_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
891
+ "transformer_blocks.9.ff.net.2.weight_tensor_scale": "diffusion_pytorch_model-00014-of-00014.safetensors",
892
+ "transformer_blocks.9.norm1.weight": "diffusion_pytorch_model-00014-of-00014.safetensors",
893
+ "transformer_blocks.9.norm2.weight": "diffusion_pytorch_model-00014-of-00014.safetensors"
894
+ }
895
+ }
transformer/modelopt-component-manifest.json ADDED
@@ -0,0 +1,1483 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "component": "denoiser",
3
+ "files": {
4
+ "config.json": {
5
+ "bytes": 546,
6
+ "sha256": "74c11bff524336576096993cbfcdcdc2ef4fa2fa4409df693bdcbc6c666282ae"
7
+ },
8
+ "diffusion_pytorch_model-00001-of-00014.safetensors": {
9
+ "bytes": 4666277856,
10
+ "sha256": "f3a79f3595b95742c9c6e5a3724e77a0fe0aaca4ae537ebfcade89308c166665"
11
+ },
12
+ "diffusion_pytorch_model-00002-of-00014.safetensors": {
13
+ "bytes": 3989259848,
14
+ "sha256": "fdb4db67af50e554d63f6107eb25dffe05436b93d010fe7c73365a0daef7a495"
15
+ },
16
+ "diffusion_pytorch_model-00003-of-00014.safetensors": {
17
+ "bytes": 3989259864,
18
+ "sha256": "56589eb613578fc3b7630eccfe7f2c2096b063369aa7d4ed0328f0d378567a06"
19
+ },
20
+ "diffusion_pytorch_model-00004-of-00014.safetensors": {
21
+ "bytes": 3546104664,
22
+ "sha256": "f038d4150846450ac163758d0635118c6c36bb2f3c79bf488b0494a76ad74ddb"
23
+ },
24
+ "diffusion_pytorch_model-00005-of-00014.safetensors": {
25
+ "bytes": 4099832988,
26
+ "sha256": "4fe3e9e0a089af378667cc44b2fa19441db52eedd6a793d581cfc3f819ad520d"
27
+ },
28
+ "diffusion_pytorch_model-00006-of-00014.safetensors": {
29
+ "bytes": 4056696260,
30
+ "sha256": "7db50a3eb46b0de753c004bbaa1721a7b435029b5e2c1b9e3c0b17a87e733162"
31
+ },
32
+ "diffusion_pytorch_model-00007-of-00014.safetensors": {
33
+ "bytes": 3989259832,
34
+ "sha256": "14d416a288d5254035e76e42d5eb3b8cf56602bbcc595beb0c157124bb8e7044"
35
+ },
36
+ "diffusion_pytorch_model-00008-of-00014.safetensors": {
37
+ "bytes": 3989259864,
38
+ "sha256": "4f8e479a96a692f1a04bdb4bd26c3ad2369c0bd076052067b8d613e0adcf7877"
39
+ },
40
+ "diffusion_pytorch_model-00009-of-00014.safetensors": {
41
+ "bytes": 3546104680,
42
+ "sha256": "7daad24c9223ddfc42877366db947c8169f7f85d8f05dc415452a31e80c38c03"
43
+ },
44
+ "diffusion_pytorch_model-00010-of-00014.safetensors": {
45
+ "bytes": 4099832972,
46
+ "sha256": "b22e6dec4f82b45cffc9d9b6e4120b3a079e77091e15372a887b2100c9eeb106"
47
+ },
48
+ "diffusion_pytorch_model-00011-of-00014.safetensors": {
49
+ "bytes": 4056696260,
50
+ "sha256": "98cae8b90b04fe4bcba477743bc22962548d48121f6af3162f8f305f1a6bdb3f"
51
+ },
52
+ "diffusion_pytorch_model-00012-of-00014.safetensors": {
53
+ "bytes": 3989259848,
54
+ "sha256": "a18ffec34c86f2ecb912c331b4abed52954a5d2457e3c41e9fb2047889449c2b"
55
+ },
56
+ "diffusion_pytorch_model-00013-of-00014.safetensors": {
57
+ "bytes": 3989259808,
58
+ "sha256": "bb17854e105c6ec6c2bbed886f2d0b83eb6ab85141d075cfe42ae87b84140d2c"
59
+ },
60
+ "diffusion_pytorch_model-00014-of-00014.safetensors": {
61
+ "bytes": 1474210592,
62
+ "sha256": "76381efde9e6fc799a43bc8026dad9fbc8d69c1bb530a6f6783c7645967aee8e"
63
+ },
64
+ "diffusion_pytorch_model.safetensors.index.json": {
65
+ "bytes": 92939,
66
+ "sha256": "af2cfa36eeae8bc371c908b658526d9599a548663e6a87eb3495a1f32377aa98"
67
+ }
68
+ },
69
+ "modelopt_commit": "6a4b3f147e14a6fec690fedbced8df402344085d",
70
+ "numerical_format": {
71
+ "activation": "a4",
72
+ "block_scale": "fp8_e4m3",
73
+ "block_size": 16,
74
+ "output": "bf16",
75
+ "tensor_scale": "fp32",
76
+ "values": "e2m1",
77
+ "weight": "w4"
78
+ },
79
+ "source": "/workspace/models/FastVideo-FastH3-8-Step-V2/transformer",
80
+ "target_weights": 100,
81
+ "weights": {
82
+ "transformer_blocks.0.ff.net.0.proj.weight": {
83
+ "block_scale_max": 448.0,
84
+ "block_scale_mean": 16.472810745239258,
85
+ "block_scale_min": 0.375,
86
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
87
+ "shape": [
88
+ 28672,
89
+ 5376
90
+ ],
91
+ "source_dtype": "bfloat16",
92
+ "weight_global_amax": 8.375,
93
+ "weight_saturation_rate": 0.0635531023144722,
94
+ "weight_tensor_scale": 0.0031156993936747313
95
+ },
96
+ "transformer_blocks.0.ff.net.2.weight": {
97
+ "block_scale_max": 448.0,
98
+ "block_scale_mean": 33.92570114135742,
99
+ "block_scale_min": 5.0,
100
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
101
+ "shape": [
102
+ 5376,
103
+ 14336
104
+ ],
105
+ "source_dtype": "bfloat16",
106
+ "weight_global_amax": 4.8125,
107
+ "weight_saturation_rate": 0.06495505571365356,
108
+ "weight_tensor_scale": 0.0017903646221384406
109
+ },
110
+ "transformer_blocks.1.ff.net.0.proj.weight": {
111
+ "block_scale_max": 448.0,
112
+ "block_scale_mean": 28.016780853271484,
113
+ "block_scale_min": 0.6875,
114
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
115
+ "shape": [
116
+ 28672,
117
+ 5376
118
+ ],
119
+ "source_dtype": "bfloat16",
120
+ "weight_global_amax": 4.40625,
121
+ "weight_saturation_rate": 0.06361329555511475,
122
+ "weight_tensor_scale": 0.0016392299439758062
123
+ },
124
+ "transformer_blocks.1.ff.net.2.weight": {
125
+ "block_scale_max": 448.0,
126
+ "block_scale_mean": 17.47043800354004,
127
+ "block_scale_min": 2.25,
128
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
129
+ "shape": [
130
+ 5376,
131
+ 14336
132
+ ],
133
+ "source_dtype": "bfloat16",
134
+ "weight_global_amax": 8.4375,
135
+ "weight_saturation_rate": 0.06422059237957001,
136
+ "weight_tensor_scale": 0.003138951025903225
137
+ },
138
+ "transformer_blocks.10.ff.net.0.proj.weight": {
139
+ "block_scale_max": 448.0,
140
+ "block_scale_mean": 44.30693054199219,
141
+ "block_scale_min": 1.375,
142
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
143
+ "shape": [
144
+ 28672,
145
+ 5376
146
+ ],
147
+ "source_dtype": "bfloat16",
148
+ "weight_global_amax": 3.609375,
149
+ "weight_saturation_rate": 0.0634210854768753,
150
+ "weight_tensor_scale": 0.0013427734375
151
+ },
152
+ "transformer_blocks.10.ff.net.2.weight": {
153
+ "block_scale_max": 448.0,
154
+ "block_scale_mean": 70.12564849853516,
155
+ "block_scale_min": 8.0,
156
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
157
+ "shape": [
158
+ 5376,
159
+ 14336
160
+ ],
161
+ "source_dtype": "bfloat16",
162
+ "weight_global_amax": 2.40625,
163
+ "weight_saturation_rate": 0.06392490118741989,
164
+ "weight_tensor_scale": 0.0008951823110692203
165
+ },
166
+ "transformer_blocks.11.ff.net.0.proj.weight": {
167
+ "block_scale_max": 448.0,
168
+ "block_scale_mean": 26.48586654663086,
169
+ "block_scale_min": 0.75,
170
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
171
+ "shape": [
172
+ 28672,
173
+ 5376
174
+ ],
175
+ "source_dtype": "bfloat16",
176
+ "weight_global_amax": 5.9375,
177
+ "weight_saturation_rate": 0.06343300640583038,
178
+ "weight_tensor_scale": 0.002208891324698925
179
+ },
180
+ "transformer_blocks.11.ff.net.2.weight": {
181
+ "block_scale_max": 448.0,
182
+ "block_scale_mean": 36.13872146606445,
183
+ "block_scale_min": 3.0,
184
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
185
+ "shape": [
186
+ 5376,
187
+ 14336
188
+ ],
189
+ "source_dtype": "bfloat16",
190
+ "weight_global_amax": 4.5625,
191
+ "weight_saturation_rate": 0.06391296535730362,
192
+ "weight_tensor_scale": 0.001697358675301075
193
+ },
194
+ "transformer_blocks.12.ff.net.0.proj.weight": {
195
+ "block_scale_max": 448.0,
196
+ "block_scale_mean": 38.98491287231445,
197
+ "block_scale_min": 1.125,
198
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
199
+ "shape": [
200
+ 28672,
201
+ 5376
202
+ ],
203
+ "source_dtype": "bfloat16",
204
+ "weight_global_amax": 3.953125,
205
+ "weight_saturation_rate": 0.06354884803295135,
206
+ "weight_tensor_scale": 0.0014706565998494625
207
+ },
208
+ "transformer_blocks.12.ff.net.2.weight": {
209
+ "block_scale_max": 448.0,
210
+ "block_scale_mean": 41.33897399902344,
211
+ "block_scale_min": 3.25,
212
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
213
+ "shape": [
214
+ 5376,
215
+ 14336
216
+ ],
217
+ "source_dtype": "bfloat16",
218
+ "weight_global_amax": 3.921875,
219
+ "weight_saturation_rate": 0.06375382840633392,
220
+ "weight_tensor_scale": 0.0014590309001505375
221
+ },
222
+ "transformer_blocks.13.ff.net.0.proj.weight": {
223
+ "block_scale_max": 448.0,
224
+ "block_scale_mean": 12.657387733459473,
225
+ "block_scale_min": 0.375,
226
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
227
+ "shape": [
228
+ 28672,
229
+ 5376
230
+ ],
231
+ "source_dtype": "bfloat16",
232
+ "weight_global_amax": 12.125,
233
+ "weight_saturation_rate": 0.06352940201759338,
234
+ "weight_tensor_scale": 0.0045107887126505375
235
+ },
236
+ "transformer_blocks.13.ff.net.2.weight": {
237
+ "block_scale_max": 448.0,
238
+ "block_scale_mean": 10.395673751831055,
239
+ "block_scale_min": 0.625,
240
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
241
+ "shape": [
242
+ 5376,
243
+ 14336
244
+ ],
245
+ "source_dtype": "bfloat16",
246
+ "weight_global_amax": 15.375,
247
+ "weight_saturation_rate": 0.06361401826143265,
248
+ "weight_tensor_scale": 0.0057198661379516125
249
+ },
250
+ "transformer_blocks.14.ff.net.0.proj.weight": {
251
+ "block_scale_max": 448.0,
252
+ "block_scale_mean": 32.54780578613281,
253
+ "block_scale_min": 0.9375,
254
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
255
+ "shape": [
256
+ 28672,
257
+ 5376
258
+ ],
259
+ "source_dtype": "bfloat16",
260
+ "weight_global_amax": 4.75,
261
+ "weight_saturation_rate": 0.06362705677747726,
262
+ "weight_tensor_scale": 0.0017671131063252687
263
+ },
264
+ "transformer_blocks.14.ff.net.2.weight": {
265
+ "block_scale_max": 448.0,
266
+ "block_scale_mean": 40.63705062866211,
267
+ "block_scale_min": 2.5,
268
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
269
+ "shape": [
270
+ 5376,
271
+ 14336
272
+ ],
273
+ "source_dtype": "bfloat16",
274
+ "weight_global_amax": 3.921875,
275
+ "weight_saturation_rate": 0.06358229368925095,
276
+ "weight_tensor_scale": 0.0014590309001505375
277
+ },
278
+ "transformer_blocks.15.ff.net.0.proj.weight": {
279
+ "block_scale_max": 448.0,
280
+ "block_scale_mean": 26.840002059936523,
281
+ "block_scale_min": 0.75,
282
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
283
+ "shape": [
284
+ 28672,
285
+ 5376
286
+ ],
287
+ "source_dtype": "bfloat16",
288
+ "weight_global_amax": 5.71875,
289
+ "weight_saturation_rate": 0.06362160295248032,
290
+ "weight_tensor_scale": 0.0021275111939758062
291
+ },
292
+ "transformer_blocks.15.ff.net.2.weight": {
293
+ "block_scale_max": 448.0,
294
+ "block_scale_mean": 30.485427856445312,
295
+ "block_scale_min": 1.375,
296
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
297
+ "shape": [
298
+ 5376,
299
+ 14336
300
+ ],
301
+ "source_dtype": "bfloat16",
302
+ "weight_global_amax": 5.0625,
303
+ "weight_saturation_rate": 0.06376612931489944,
304
+ "weight_tensor_scale": 0.0018833705689758062
305
+ },
306
+ "transformer_blocks.16.ff.net.0.proj.weight": {
307
+ "block_scale_max": 448.0,
308
+ "block_scale_mean": 29.40296173095703,
309
+ "block_scale_min": 0.9375,
310
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
311
+ "shape": [
312
+ 28672,
313
+ 5376
314
+ ],
315
+ "source_dtype": "bfloat16",
316
+ "weight_global_amax": 5.21875,
317
+ "weight_saturation_rate": 0.06359194219112396,
318
+ "weight_tensor_scale": 0.001941499300301075
319
+ },
320
+ "transformer_blocks.16.ff.net.2.weight": {
321
+ "block_scale_max": 448.0,
322
+ "block_scale_mean": 41.52627182006836,
323
+ "block_scale_min": 2.5,
324
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
325
+ "shape": [
326
+ 5376,
327
+ 14336
328
+ ],
329
+ "source_dtype": "bfloat16",
330
+ "weight_global_amax": 3.671875,
331
+ "weight_saturation_rate": 0.06345530599355698,
332
+ "weight_tensor_scale": 0.0013660249533131719
333
+ },
334
+ "transformer_blocks.17.ff.net.0.proj.weight": {
335
+ "block_scale_max": 448.0,
336
+ "block_scale_mean": 35.89411163330078,
337
+ "block_scale_min": 0.9375,
338
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
339
+ "shape": [
340
+ 28672,
341
+ 5376
342
+ ],
343
+ "source_dtype": "bfloat16",
344
+ "weight_global_amax": 4.34375,
345
+ "weight_saturation_rate": 0.06361914426088333,
346
+ "weight_tensor_scale": 0.0016159784281626344
347
+ },
348
+ "transformer_blocks.17.ff.net.2.weight": {
349
+ "block_scale_max": 448.0,
350
+ "block_scale_mean": 34.49273681640625,
351
+ "block_scale_min": 1.875,
352
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
353
+ "shape": [
354
+ 5376,
355
+ 14336
356
+ ],
357
+ "source_dtype": "bfloat16",
358
+ "weight_global_amax": 4.46875,
359
+ "weight_saturation_rate": 0.0636821910738945,
360
+ "weight_tensor_scale": 0.001662481459788978
361
+ },
362
+ "transformer_blocks.18.ff.net.0.proj.weight": {
363
+ "block_scale_max": 448.0,
364
+ "block_scale_mean": 37.41980743408203,
365
+ "block_scale_min": 1.0,
366
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
367
+ "shape": [
368
+ 28672,
369
+ 5376
370
+ ],
371
+ "source_dtype": "bfloat16",
372
+ "weight_global_amax": 4.28125,
373
+ "weight_saturation_rate": 0.06366817653179169,
374
+ "weight_tensor_scale": 0.0015927269123494625
375
+ },
376
+ "transformer_blocks.18.ff.net.2.weight": {
377
+ "block_scale_max": 448.0,
378
+ "block_scale_mean": 17.07464027404785,
379
+ "block_scale_min": 1.125,
380
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
381
+ "shape": [
382
+ 5376,
383
+ 14336
384
+ ],
385
+ "source_dtype": "bfloat16",
386
+ "weight_global_amax": 9.3125,
387
+ "weight_saturation_rate": 0.0635707899928093,
388
+ "weight_tensor_scale": 0.0034644717816263437
389
+ },
390
+ "transformer_blocks.19.ff.net.0.proj.weight": {
391
+ "block_scale_max": 448.0,
392
+ "block_scale_mean": 53.71031951904297,
393
+ "block_scale_min": 1.625,
394
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
395
+ "shape": [
396
+ 28672,
397
+ 5376
398
+ ],
399
+ "source_dtype": "bfloat16",
400
+ "weight_global_amax": 3.03125,
401
+ "weight_saturation_rate": 0.06346447020769119,
402
+ "weight_tensor_scale": 0.0011276971781626344
403
+ },
404
+ "transformer_blocks.19.ff.net.2.weight": {
405
+ "block_scale_max": 448.0,
406
+ "block_scale_mean": 44.21475601196289,
407
+ "block_scale_min": 3.25,
408
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
409
+ "shape": [
410
+ 5376,
411
+ 14336
412
+ ],
413
+ "source_dtype": "bfloat16",
414
+ "weight_global_amax": 3.640625,
415
+ "weight_saturation_rate": 0.06315609812736511,
416
+ "weight_tensor_scale": 0.0013543992536142468
417
+ },
418
+ "transformer_blocks.2.ff.net.0.proj.weight": {
419
+ "block_scale_max": 448.0,
420
+ "block_scale_mean": 33.50969696044922,
421
+ "block_scale_min": 0.875,
422
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
423
+ "shape": [
424
+ 28672,
425
+ 5376
426
+ ],
427
+ "source_dtype": "bfloat16",
428
+ "weight_global_amax": 4.34375,
429
+ "weight_saturation_rate": 0.06351633369922638,
430
+ "weight_tensor_scale": 0.0016159784281626344
431
+ },
432
+ "transformer_blocks.2.ff.net.2.weight": {
433
+ "block_scale_max": 448.0,
434
+ "block_scale_mean": 23.832735061645508,
435
+ "block_scale_min": 4.0,
436
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
437
+ "shape": [
438
+ 5376,
439
+ 14336
440
+ ],
441
+ "source_dtype": "bfloat16",
442
+ "weight_global_amax": 7.21875,
443
+ "weight_saturation_rate": 0.06375302374362946,
444
+ "weight_tensor_scale": 0.002685546875
445
+ },
446
+ "transformer_blocks.20.ff.net.0.proj.weight": {
447
+ "block_scale_max": 448.0,
448
+ "block_scale_mean": 36.75448989868164,
449
+ "block_scale_min": 1.5,
450
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
451
+ "shape": [
452
+ 28672,
453
+ 5376
454
+ ],
455
+ "source_dtype": "bfloat16",
456
+ "weight_global_amax": 4.46875,
457
+ "weight_saturation_rate": 0.06357189267873764,
458
+ "weight_tensor_scale": 0.001662481459788978
459
+ },
460
+ "transformer_blocks.20.ff.net.2.weight": {
461
+ "block_scale_max": 448.0,
462
+ "block_scale_mean": 40.20512008666992,
463
+ "block_scale_min": 4.5,
464
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
465
+ "shape": [
466
+ 5376,
467
+ 14336
468
+ ],
469
+ "source_dtype": "bfloat16",
470
+ "weight_global_amax": 4.03125,
471
+ "weight_saturation_rate": 0.06329139322042465,
472
+ "weight_tensor_scale": 0.0014997209655120969
473
+ },
474
+ "transformer_blocks.21.ff.net.0.proj.weight": {
475
+ "block_scale_max": 448.0,
476
+ "block_scale_mean": 28.327739715576172,
477
+ "block_scale_min": 0.875,
478
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
479
+ "shape": [
480
+ 28672,
481
+ 5376
482
+ ],
483
+ "source_dtype": "bfloat16",
484
+ "weight_global_amax": 5.90625,
485
+ "weight_saturation_rate": 0.0633908212184906,
486
+ "weight_tensor_scale": 0.002197265625
487
+ },
488
+ "transformer_blocks.21.ff.net.2.weight": {
489
+ "block_scale_max": 448.0,
490
+ "block_scale_mean": 34.72657012939453,
491
+ "block_scale_min": 3.5,
492
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
493
+ "shape": [
494
+ 5376,
495
+ 14336
496
+ ],
497
+ "source_dtype": "bfloat16",
498
+ "weight_global_amax": 4.6875,
499
+ "weight_saturation_rate": 0.06354440748691559,
500
+ "weight_tensor_scale": 0.0017438615905120969
501
+ },
502
+ "transformer_blocks.22.ff.net.0.proj.weight": {
503
+ "block_scale_max": 448.0,
504
+ "block_scale_mean": 46.91795349121094,
505
+ "block_scale_min": 1.375,
506
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
507
+ "shape": [
508
+ 28672,
509
+ 5376
510
+ ],
511
+ "source_dtype": "bfloat16",
512
+ "weight_global_amax": 3.640625,
513
+ "weight_saturation_rate": 0.06337294727563858,
514
+ "weight_tensor_scale": 0.0013543992536142468
515
+ },
516
+ "transformer_blocks.22.ff.net.2.weight": {
517
+ "block_scale_max": 448.0,
518
+ "block_scale_mean": 54.79737091064453,
519
+ "block_scale_min": 5.5,
520
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
521
+ "shape": [
522
+ 5376,
523
+ 14336
524
+ ],
525
+ "source_dtype": "bfloat16",
526
+ "weight_global_amax": 3.015625,
527
+ "weight_saturation_rate": 0.06334823369979858,
528
+ "weight_tensor_scale": 0.0011218843283131719
529
+ },
530
+ "transformer_blocks.23.ff.net.0.proj.weight": {
531
+ "block_scale_max": 448.0,
532
+ "block_scale_mean": 32.75905227661133,
533
+ "block_scale_min": 2.25,
534
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
535
+ "shape": [
536
+ 28672,
537
+ 5376
538
+ ],
539
+ "source_dtype": "bfloat16",
540
+ "weight_global_amax": 5.3125,
541
+ "weight_saturation_rate": 0.06352945417165756,
542
+ "weight_tensor_scale": 0.0019763766322284937
543
+ },
544
+ "transformer_blocks.23.ff.net.2.weight": {
545
+ "block_scale_max": 448.0,
546
+ "block_scale_mean": 61.83649444580078,
547
+ "block_scale_min": 7.0,
548
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
549
+ "shape": [
550
+ 5376,
551
+ 14336
552
+ ],
553
+ "source_dtype": "bfloat16",
554
+ "weight_global_amax": 2.71875,
555
+ "weight_saturation_rate": 0.06354671716690063,
556
+ "weight_tensor_scale": 0.0010114397155120969
557
+ },
558
+ "transformer_blocks.24.ff.net.0.proj.weight": {
559
+ "block_scale_max": 448.0,
560
+ "block_scale_mean": 27.764474868774414,
561
+ "block_scale_min": 2.5,
562
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
563
+ "shape": [
564
+ 28672,
565
+ 5376
566
+ ],
567
+ "source_dtype": "bfloat16",
568
+ "weight_global_amax": 6.375,
569
+ "weight_saturation_rate": 0.0633118748664856,
570
+ "weight_tensor_scale": 0.0023716518189758062
571
+ },
572
+ "transformer_blocks.24.ff.net.2.weight": {
573
+ "block_scale_max": 448.0,
574
+ "block_scale_mean": 55.93125534057617,
575
+ "block_scale_min": 5.5,
576
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
577
+ "shape": [
578
+ 5376,
579
+ 14336
580
+ ],
581
+ "source_dtype": "bfloat16",
582
+ "weight_global_amax": 3.03125,
583
+ "weight_saturation_rate": 0.06340514868497849,
584
+ "weight_tensor_scale": 0.0011276971781626344
585
+ },
586
+ "transformer_blocks.25.ff.net.0.proj.weight": {
587
+ "block_scale_max": 448.0,
588
+ "block_scale_mean": 39.748191833496094,
589
+ "block_scale_min": 4.5,
590
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
591
+ "shape": [
592
+ 28672,
593
+ 5376
594
+ ],
595
+ "source_dtype": "bfloat16",
596
+ "weight_global_amax": 4.53125,
597
+ "weight_saturation_rate": 0.06359779834747314,
598
+ "weight_tensor_scale": 0.00168573297560215
599
+ },
600
+ "transformer_blocks.25.ff.net.2.weight": {
601
+ "block_scale_max": 448.0,
602
+ "block_scale_mean": 53.71021270751953,
603
+ "block_scale_min": 5.0,
604
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
605
+ "shape": [
606
+ 5376,
607
+ 14336
608
+ ],
609
+ "source_dtype": "bfloat16",
610
+ "weight_global_amax": 3.21875,
611
+ "weight_saturation_rate": 0.0632067546248436,
612
+ "weight_tensor_scale": 0.0011974516091868281
613
+ },
614
+ "transformer_blocks.26.ff.net.0.proj.weight": {
615
+ "block_scale_max": 448.0,
616
+ "block_scale_mean": 41.97430419921875,
617
+ "block_scale_min": 1.125,
618
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
619
+ "shape": [
620
+ 28672,
621
+ 5376
622
+ ],
623
+ "source_dtype": "bfloat16",
624
+ "weight_global_amax": 4.375,
625
+ "weight_saturation_rate": 0.06354731321334839,
626
+ "weight_tensor_scale": 0.0016276042442768812
627
+ },
628
+ "transformer_blocks.26.ff.net.2.weight": {
629
+ "block_scale_max": 448.0,
630
+ "block_scale_mean": 31.096267700195312,
631
+ "block_scale_min": 3.75,
632
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
633
+ "shape": [
634
+ 5376,
635
+ 14336
636
+ ],
637
+ "source_dtype": "bfloat16",
638
+ "weight_global_amax": 5.6875,
639
+ "weight_saturation_rate": 0.0635245144367218,
640
+ "weight_tensor_scale": 0.0021158854942768812
641
+ },
642
+ "transformer_blocks.27.ff.net.0.proj.weight": {
643
+ "block_scale_max": 448.0,
644
+ "block_scale_mean": 38.585418701171875,
645
+ "block_scale_min": 1.75,
646
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
647
+ "shape": [
648
+ 28672,
649
+ 5376
650
+ ],
651
+ "source_dtype": "bfloat16",
652
+ "weight_global_amax": 4.8125,
653
+ "weight_saturation_rate": 0.06368626654148102,
654
+ "weight_tensor_scale": 0.0017903646221384406
655
+ },
656
+ "transformer_blocks.27.ff.net.2.weight": {
657
+ "block_scale_max": 448.0,
658
+ "block_scale_mean": 17.185791015625,
659
+ "block_scale_min": 2.25,
660
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
661
+ "shape": [
662
+ 5376,
663
+ 14336
664
+ ],
665
+ "source_dtype": "bfloat16",
666
+ "weight_global_amax": 10.5,
667
+ "weight_saturation_rate": 0.06366415321826935,
668
+ "weight_tensor_scale": 0.00390625
669
+ },
670
+ "transformer_blocks.28.ff.net.0.proj.weight": {
671
+ "block_scale_max": 448.0,
672
+ "block_scale_mean": 26.90459442138672,
673
+ "block_scale_min": 1.625,
674
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
675
+ "shape": [
676
+ 28672,
677
+ 5376
678
+ ],
679
+ "source_dtype": "bfloat16",
680
+ "weight_global_amax": 7.09375,
681
+ "weight_saturation_rate": 0.0631420835852623,
682
+ "weight_tensor_scale": 0.0026390438433736563
683
+ },
684
+ "transformer_blocks.28.ff.net.2.weight": {
685
+ "block_scale_max": 448.0,
686
+ "block_scale_mean": 25.527729034423828,
687
+ "block_scale_min": 3.5,
688
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
689
+ "shape": [
690
+ 5376,
691
+ 14336
692
+ ],
693
+ "source_dtype": "bfloat16",
694
+ "weight_global_amax": 7.3125,
695
+ "weight_saturation_rate": 0.06289058923721313,
696
+ "weight_tensor_scale": 0.0027204242069274187
697
+ },
698
+ "transformer_blocks.29.ff.net.0.proj.weight": {
699
+ "block_scale_max": 448.0,
700
+ "block_scale_mean": 27.099689483642578,
701
+ "block_scale_min": 4.5,
702
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
703
+ "shape": [
704
+ 28672,
705
+ 5376
706
+ ],
707
+ "source_dtype": "bfloat16",
708
+ "weight_global_amax": 7.0625,
709
+ "weight_saturation_rate": 0.06317268311977386,
710
+ "weight_tensor_scale": 0.0026274181436747313
711
+ },
712
+ "transformer_blocks.29.ff.net.2.weight": {
713
+ "block_scale_max": 448.0,
714
+ "block_scale_mean": 39.74492263793945,
715
+ "block_scale_min": 6.0,
716
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
717
+ "shape": [
718
+ 5376,
719
+ 14336
720
+ ],
721
+ "source_dtype": "bfloat16",
722
+ "weight_global_amax": 4.78125,
723
+ "weight_saturation_rate": 0.06351079046726227,
724
+ "weight_tensor_scale": 0.0017787389224395156
725
+ },
726
+ "transformer_blocks.3.ff.net.0.proj.weight": {
727
+ "block_scale_max": 448.0,
728
+ "block_scale_mean": 37.32854461669922,
729
+ "block_scale_min": 1.125,
730
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
731
+ "shape": [
732
+ 28672,
733
+ 5376
734
+ ],
735
+ "source_dtype": "bfloat16",
736
+ "weight_global_amax": 4.3125,
737
+ "weight_saturation_rate": 0.06356970965862274,
738
+ "weight_tensor_scale": 0.0016043527284637094
739
+ },
740
+ "transformer_blocks.3.ff.net.2.weight": {
741
+ "block_scale_max": 448.0,
742
+ "block_scale_mean": 61.829490661621094,
743
+ "block_scale_min": 11.0,
744
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
745
+ "shape": [
746
+ 5376,
747
+ 14336
748
+ ],
749
+ "source_dtype": "bfloat16",
750
+ "weight_global_amax": 2.859375,
751
+ "weight_saturation_rate": 0.06367290019989014,
752
+ "weight_tensor_scale": 0.0010637555969879031
753
+ },
754
+ "transformer_blocks.30.ff.net.0.proj.weight": {
755
+ "block_scale_max": 448.0,
756
+ "block_scale_mean": 30.47406005859375,
757
+ "block_scale_min": 5.0,
758
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
759
+ "shape": [
760
+ 28672,
761
+ 5376
762
+ ],
763
+ "source_dtype": "bfloat16",
764
+ "weight_global_amax": 6.3125,
765
+ "weight_saturation_rate": 0.06351572275161743,
766
+ "weight_tensor_scale": 0.002348400419577956
767
+ },
768
+ "transformer_blocks.30.ff.net.2.weight": {
769
+ "block_scale_max": 448.0,
770
+ "block_scale_mean": 15.345965385437012,
771
+ "block_scale_min": 2.25,
772
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
773
+ "shape": [
774
+ 5376,
775
+ 14336
776
+ ],
777
+ "source_dtype": "bfloat16",
778
+ "weight_global_amax": 12.3125,
779
+ "weight_saturation_rate": 0.0635567456483841,
780
+ "weight_tensor_scale": 0.004580543376505375
781
+ },
782
+ "transformer_blocks.31.ff.net.0.proj.weight": {
783
+ "block_scale_max": 448.0,
784
+ "block_scale_mean": 27.601680755615234,
785
+ "block_scale_min": 4.5,
786
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
787
+ "shape": [
788
+ 28672,
789
+ 5376
790
+ ],
791
+ "source_dtype": "bfloat16",
792
+ "weight_global_amax": 7.0,
793
+ "weight_saturation_rate": 0.0632418766617775,
794
+ "weight_tensor_scale": 0.0026041667442768812
795
+ },
796
+ "transformer_blocks.31.ff.net.2.weight": {
797
+ "block_scale_max": 448.0,
798
+ "block_scale_mean": 25.32246971130371,
799
+ "block_scale_min": 3.5,
800
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
801
+ "shape": [
802
+ 5376,
803
+ 14336
804
+ ],
805
+ "source_dtype": "bfloat16",
806
+ "weight_global_amax": 7.5,
807
+ "weight_saturation_rate": 0.06294618546962738,
808
+ "weight_tensor_scale": 0.0027901786379516125
809
+ },
810
+ "transformer_blocks.32.ff.net.0.proj.weight": {
811
+ "block_scale_max": 448.0,
812
+ "block_scale_mean": 15.44709587097168,
813
+ "block_scale_min": 2.75,
814
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
815
+ "shape": [
816
+ 28672,
817
+ 5376
818
+ ],
819
+ "source_dtype": "bfloat16",
820
+ "weight_global_amax": 12.5,
821
+ "weight_saturation_rate": 0.0635404884815216,
822
+ "weight_tensor_scale": 0.004650297574698925
823
+ },
824
+ "transformer_blocks.32.ff.net.2.weight": {
825
+ "block_scale_max": 448.0,
826
+ "block_scale_mean": 24.05265998840332,
827
+ "block_scale_min": 4.0,
828
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
829
+ "shape": [
830
+ 5376,
831
+ 14336
832
+ ],
833
+ "source_dtype": "bfloat16",
834
+ "weight_global_amax": 8.0,
835
+ "weight_saturation_rate": 0.06287529319524765,
836
+ "weight_tensor_scale": 0.0029761905316263437
837
+ },
838
+ "transformer_blocks.33.ff.net.0.proj.weight": {
839
+ "block_scale_max": 448.0,
840
+ "block_scale_mean": 23.434585571289062,
841
+ "block_scale_min": 4.5,
842
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
843
+ "shape": [
844
+ 28672,
845
+ 5376
846
+ ],
847
+ "source_dtype": "bfloat16",
848
+ "weight_global_amax": 8.3125,
849
+ "weight_saturation_rate": 0.06324472278356552,
850
+ "weight_tensor_scale": 0.0030924479942768812
851
+ },
852
+ "transformer_blocks.33.ff.net.2.weight": {
853
+ "block_scale_max": 448.0,
854
+ "block_scale_mean": 17.680030822753906,
855
+ "block_scale_min": 3.25,
856
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
857
+ "shape": [
858
+ 5376,
859
+ 14336
860
+ ],
861
+ "source_dtype": "bfloat16",
862
+ "weight_global_amax": 10.875,
863
+ "weight_saturation_rate": 0.06367697566747665,
864
+ "weight_tensor_scale": 0.0040457588620483875
865
+ },
866
+ "transformer_blocks.34.ff.net.0.proj.weight": {
867
+ "block_scale_max": 448.0,
868
+ "block_scale_mean": 23.52639389038086,
869
+ "block_scale_min": 3.75,
870
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
871
+ "shape": [
872
+ 28672,
873
+ 5376
874
+ ],
875
+ "source_dtype": "bfloat16",
876
+ "weight_global_amax": 8.3125,
877
+ "weight_saturation_rate": 0.06323325634002686,
878
+ "weight_tensor_scale": 0.0030924479942768812
879
+ },
880
+ "transformer_blocks.34.ff.net.2.weight": {
881
+ "block_scale_max": 448.0,
882
+ "block_scale_mean": 30.29164695739746,
883
+ "block_scale_min": 5.5,
884
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
885
+ "shape": [
886
+ 5376,
887
+ 14336
888
+ ],
889
+ "source_dtype": "bfloat16",
890
+ "weight_global_amax": 6.375,
891
+ "weight_saturation_rate": 0.06337087601423264,
892
+ "weight_tensor_scale": 0.0023716518189758062
893
+ },
894
+ "transformer_blocks.35.ff.net.0.proj.weight": {
895
+ "block_scale_max": 448.0,
896
+ "block_scale_mean": 25.029024124145508,
897
+ "block_scale_min": 4.0,
898
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
899
+ "shape": [
900
+ 28672,
901
+ 5376
902
+ ],
903
+ "source_dtype": "bfloat16",
904
+ "weight_global_amax": 7.875,
905
+ "weight_saturation_rate": 0.0632198303937912,
906
+ "weight_tensor_scale": 0.0029296875
907
+ },
908
+ "transformer_blocks.35.ff.net.2.weight": {
909
+ "block_scale_max": 448.0,
910
+ "block_scale_mean": 29.030969619750977,
911
+ "block_scale_min": 5.0,
912
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
913
+ "shape": [
914
+ 5376,
915
+ 14336
916
+ ],
917
+ "source_dtype": "bfloat16",
918
+ "weight_global_amax": 6.75,
919
+ "weight_saturation_rate": 0.0631941705942154,
920
+ "weight_tensor_scale": 0.0025111606810241938
921
+ },
922
+ "transformer_blocks.36.ff.net.0.proj.weight": {
923
+ "block_scale_max": 448.0,
924
+ "block_scale_mean": 16.119003295898438,
925
+ "block_scale_min": 2.25,
926
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
927
+ "shape": [
928
+ 28672,
929
+ 5376
930
+ ],
931
+ "source_dtype": "bfloat16",
932
+ "weight_global_amax": 12.1875,
933
+ "weight_saturation_rate": 0.06349044293165207,
934
+ "weight_tensor_scale": 0.0045340401120483875
935
+ },
936
+ "transformer_blocks.36.ff.net.2.weight": {
937
+ "block_scale_max": 448.0,
938
+ "block_scale_mean": 13.287566184997559,
939
+ "block_scale_min": 2.25,
940
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
941
+ "shape": [
942
+ 5376,
943
+ 14336
944
+ ],
945
+ "source_dtype": "bfloat16",
946
+ "weight_global_amax": 15.0,
947
+ "weight_saturation_rate": 0.06300721317529678,
948
+ "weight_tensor_scale": 0.005580357275903225
949
+ },
950
+ "transformer_blocks.37.ff.net.0.proj.weight": {
951
+ "block_scale_max": 448.0,
952
+ "block_scale_mean": 22.187801361083984,
953
+ "block_scale_min": 2.75,
954
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
955
+ "shape": [
956
+ 28672,
957
+ 5376
958
+ ],
959
+ "source_dtype": "bfloat16",
960
+ "weight_global_amax": 8.875,
961
+ "weight_saturation_rate": 0.06334291398525238,
962
+ "weight_tensor_scale": 0.0033017112873494625
963
+ },
964
+ "transformer_blocks.37.ff.net.2.weight": {
965
+ "block_scale_max": 448.0,
966
+ "block_scale_mean": 20.606719970703125,
967
+ "block_scale_min": 3.5,
968
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
969
+ "shape": [
970
+ 5376,
971
+ 14336
972
+ ],
973
+ "source_dtype": "bfloat16",
974
+ "weight_global_amax": 9.875,
975
+ "weight_saturation_rate": 0.06330295652151108,
976
+ "weight_tensor_scale": 0.003673735074698925
977
+ },
978
+ "transformer_blocks.38.ff.net.0.proj.weight": {
979
+ "block_scale_max": 448.0,
980
+ "block_scale_mean": 25.024084091186523,
981
+ "block_scale_min": 3.5,
982
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
983
+ "shape": [
984
+ 28672,
985
+ 5376
986
+ ],
987
+ "source_dtype": "bfloat16",
988
+ "weight_global_amax": 7.84375,
989
+ "weight_saturation_rate": 0.06324666738510132,
990
+ "weight_tensor_scale": 0.002918061800301075
991
+ },
992
+ "transformer_blocks.38.ff.net.2.weight": {
993
+ "block_scale_max": 448.0,
994
+ "block_scale_mean": 20.838666915893555,
995
+ "block_scale_min": 3.5,
996
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
997
+ "shape": [
998
+ 5376,
999
+ 14336
1000
+ ],
1001
+ "source_dtype": "bfloat16",
1002
+ "weight_global_amax": 9.6875,
1003
+ "weight_saturation_rate": 0.06329508870840073,
1004
+ "weight_tensor_scale": 0.0036039806436747313
1005
+ },
1006
+ "transformer_blocks.39.ff.net.0.proj.weight": {
1007
+ "block_scale_max": 448.0,
1008
+ "block_scale_mean": 16.792165756225586,
1009
+ "block_scale_min": 2.5,
1010
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1011
+ "shape": [
1012
+ 28672,
1013
+ 5376
1014
+ ],
1015
+ "source_dtype": "bfloat16",
1016
+ "weight_global_amax": 11.75,
1017
+ "weight_saturation_rate": 0.0635409727692604,
1018
+ "weight_tensor_scale": 0.00437127985060215
1019
+ },
1020
+ "transformer_blocks.39.ff.net.2.weight": {
1021
+ "block_scale_max": 448.0,
1022
+ "block_scale_mean": 12.181222915649414,
1023
+ "block_scale_min": 1.875,
1024
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1025
+ "shape": [
1026
+ 5376,
1027
+ 14336
1028
+ ],
1029
+ "source_dtype": "bfloat16",
1030
+ "weight_global_amax": 16.75,
1031
+ "weight_saturation_rate": 0.06287138909101486,
1032
+ "weight_tensor_scale": 0.0062313987873494625
1033
+ },
1034
+ "transformer_blocks.4.ff.net.0.proj.weight": {
1035
+ "block_scale_max": 448.0,
1036
+ "block_scale_mean": 52.5825080871582,
1037
+ "block_scale_min": 1.5,
1038
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1039
+ "shape": [
1040
+ 28672,
1041
+ 5376
1042
+ ],
1043
+ "source_dtype": "bfloat16",
1044
+ "weight_global_amax": 3.140625,
1045
+ "weight_saturation_rate": 0.06332661956548691,
1046
+ "weight_tensor_scale": 0.0011683872435241938
1047
+ },
1048
+ "transformer_blocks.4.ff.net.2.weight": {
1049
+ "block_scale_max": 448.0,
1050
+ "block_scale_mean": 66.93856048583984,
1051
+ "block_scale_min": 10.0,
1052
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1053
+ "shape": [
1054
+ 5376,
1055
+ 14336
1056
+ ],
1057
+ "source_dtype": "bfloat16",
1058
+ "weight_global_amax": 2.640625,
1059
+ "weight_saturation_rate": 0.06381122022867203,
1060
+ "weight_tensor_scale": 0.0009823753498494625
1061
+ },
1062
+ "transformer_blocks.40.ff.net.0.proj.weight": {
1063
+ "block_scale_max": 448.0,
1064
+ "block_scale_mean": 18.87808609008789,
1065
+ "block_scale_min": 2.75,
1066
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1067
+ "shape": [
1068
+ 28672,
1069
+ 5376
1070
+ ],
1071
+ "source_dtype": "bfloat16",
1072
+ "weight_global_amax": 10.4375,
1073
+ "weight_saturation_rate": 0.06349419802427292,
1074
+ "weight_tensor_scale": 0.00388299860060215
1075
+ },
1076
+ "transformer_blocks.40.ff.net.2.weight": {
1077
+ "block_scale_max": 448.0,
1078
+ "block_scale_mean": 21.494401931762695,
1079
+ "block_scale_min": 3.75,
1080
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1081
+ "shape": [
1082
+ 5376,
1083
+ 14336
1084
+ ],
1085
+ "source_dtype": "bfloat16",
1086
+ "weight_global_amax": 9.4375,
1087
+ "weight_saturation_rate": 0.0632006973028183,
1088
+ "weight_tensor_scale": 0.0035109748132526875
1089
+ },
1090
+ "transformer_blocks.41.ff.net.0.proj.weight": {
1091
+ "block_scale_max": 448.0,
1092
+ "block_scale_mean": 13.759920120239258,
1093
+ "block_scale_min": 2.0,
1094
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1095
+ "shape": [
1096
+ 28672,
1097
+ 5376
1098
+ ],
1099
+ "source_dtype": "bfloat16",
1100
+ "weight_global_amax": 14.3125,
1101
+ "weight_saturation_rate": 0.06333687901496887,
1102
+ "weight_tensor_scale": 0.0053245909512043
1103
+ },
1104
+ "transformer_blocks.41.ff.net.2.weight": {
1105
+ "block_scale_max": 448.0,
1106
+ "block_scale_mean": 18.74883460998535,
1107
+ "block_scale_min": 2.0,
1108
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1109
+ "shape": [
1110
+ 5376,
1111
+ 14336
1112
+ ],
1113
+ "source_dtype": "bfloat16",
1114
+ "weight_global_amax": 10.8125,
1115
+ "weight_saturation_rate": 0.06360317021608353,
1116
+ "weight_tensor_scale": 0.0040225074626505375
1117
+ },
1118
+ "transformer_blocks.42.ff.net.0.proj.weight": {
1119
+ "block_scale_max": 448.0,
1120
+ "block_scale_mean": 14.955082893371582,
1121
+ "block_scale_min": 1.25,
1122
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1123
+ "shape": [
1124
+ 28672,
1125
+ 5376
1126
+ ],
1127
+ "source_dtype": "bfloat16",
1128
+ "weight_global_amax": 12.9375,
1129
+ "weight_saturation_rate": 0.06348460912704468,
1130
+ "weight_tensor_scale": 0.00481305830180645
1131
+ },
1132
+ "transformer_blocks.42.ff.net.2.weight": {
1133
+ "block_scale_max": 448.0,
1134
+ "block_scale_mean": 20.942235946655273,
1135
+ "block_scale_min": 3.0,
1136
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1137
+ "shape": [
1138
+ 5376,
1139
+ 14336
1140
+ ],
1141
+ "source_dtype": "bfloat16",
1142
+ "weight_global_amax": 9.8125,
1143
+ "weight_saturation_rate": 0.06326696276664734,
1144
+ "weight_tensor_scale": 0.003650483675301075
1145
+ },
1146
+ "transformer_blocks.43.ff.net.0.proj.weight": {
1147
+ "block_scale_max": 448.0,
1148
+ "block_scale_mean": 9.634349822998047,
1149
+ "block_scale_min": 0.625,
1150
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1151
+ "shape": [
1152
+ 28672,
1153
+ 5376
1154
+ ],
1155
+ "source_dtype": "bfloat16",
1156
+ "weight_global_amax": 20.0,
1157
+ "weight_saturation_rate": 0.06337322294712067,
1158
+ "weight_tensor_scale": 0.0074404762126505375
1159
+ },
1160
+ "transformer_blocks.43.ff.net.2.weight": {
1161
+ "block_scale_max": 448.0,
1162
+ "block_scale_mean": 11.070377349853516,
1163
+ "block_scale_min": 1.375,
1164
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1165
+ "shape": [
1166
+ 5376,
1167
+ 14336
1168
+ ],
1169
+ "source_dtype": "bfloat16",
1170
+ "weight_global_amax": 19.0,
1171
+ "weight_saturation_rate": 0.06310083717107773,
1172
+ "weight_tensor_scale": 0.007068452425301075
1173
+ },
1174
+ "transformer_blocks.44.ff.net.0.proj.weight": {
1175
+ "block_scale_max": 448.0,
1176
+ "block_scale_mean": 24.597610473632812,
1177
+ "block_scale_min": 1.25,
1178
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1179
+ "shape": [
1180
+ 28672,
1181
+ 5376
1182
+ ],
1183
+ "source_dtype": "bfloat16",
1184
+ "weight_global_amax": 7.75,
1185
+ "weight_saturation_rate": 0.06331908702850342,
1186
+ "weight_tensor_scale": 0.0028831844683736563
1187
+ },
1188
+ "transformer_blocks.44.ff.net.2.weight": {
1189
+ "block_scale_max": 448.0,
1190
+ "block_scale_mean": 14.781803131103516,
1191
+ "block_scale_min": 1.75,
1192
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1193
+ "shape": [
1194
+ 5376,
1195
+ 14336
1196
+ ],
1197
+ "source_dtype": "bfloat16",
1198
+ "weight_global_amax": 14.3125,
1199
+ "weight_saturation_rate": 0.06344391405582428,
1200
+ "weight_tensor_scale": 0.0053245909512043
1201
+ },
1202
+ "transformer_blocks.45.ff.net.0.proj.weight": {
1203
+ "block_scale_max": 448.0,
1204
+ "block_scale_mean": 23.468597412109375,
1205
+ "block_scale_min": 1.625,
1206
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1207
+ "shape": [
1208
+ 28672,
1209
+ 5376
1210
+ ],
1211
+ "source_dtype": "bfloat16",
1212
+ "weight_global_amax": 8.0625,
1213
+ "weight_saturation_rate": 0.06321724504232407,
1214
+ "weight_tensor_scale": 0.0029994419310241938
1215
+ },
1216
+ "transformer_blocks.45.ff.net.2.weight": {
1217
+ "block_scale_max": 448.0,
1218
+ "block_scale_mean": 12.229371070861816,
1219
+ "block_scale_min": 1.625,
1220
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1221
+ "shape": [
1222
+ 5376,
1223
+ 14336
1224
+ ],
1225
+ "source_dtype": "bfloat16",
1226
+ "weight_global_amax": 17.375,
1227
+ "weight_saturation_rate": 0.06304023414850235,
1228
+ "weight_tensor_scale": 0.0064639137126505375
1229
+ },
1230
+ "transformer_blocks.46.ff.net.0.proj.weight": {
1231
+ "block_scale_max": 448.0,
1232
+ "block_scale_mean": 18.223373413085938,
1233
+ "block_scale_min": 1.0,
1234
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1235
+ "shape": [
1236
+ 28672,
1237
+ 5376
1238
+ ],
1239
+ "source_dtype": "bfloat16",
1240
+ "weight_global_amax": 10.25,
1241
+ "weight_saturation_rate": 0.06341905146837234,
1242
+ "weight_tensor_scale": 0.003813244169577956
1243
+ },
1244
+ "transformer_blocks.46.ff.net.2.weight": {
1245
+ "block_scale_max": 448.0,
1246
+ "block_scale_mean": 15.13412094116211,
1247
+ "block_scale_min": 1.875,
1248
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1249
+ "shape": [
1250
+ 5376,
1251
+ 14336
1252
+ ],
1253
+ "source_dtype": "bfloat16",
1254
+ "weight_global_amax": 13.75,
1255
+ "weight_saturation_rate": 0.06356246024370193,
1256
+ "weight_tensor_scale": 0.005115327425301075
1257
+ },
1258
+ "transformer_blocks.47.ff.net.0.proj.weight": {
1259
+ "block_scale_max": 448.0,
1260
+ "block_scale_mean": 12.56476879119873,
1261
+ "block_scale_min": 0.8125,
1262
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1263
+ "shape": [
1264
+ 28672,
1265
+ 5376
1266
+ ],
1267
+ "source_dtype": "bfloat16",
1268
+ "weight_global_amax": 14.375,
1269
+ "weight_saturation_rate": 0.0632820799946785,
1270
+ "weight_tensor_scale": 0.00534784235060215
1271
+ },
1272
+ "transformer_blocks.47.ff.net.2.weight": {
1273
+ "block_scale_max": 448.0,
1274
+ "block_scale_mean": 10.440226554870605,
1275
+ "block_scale_min": 1.0,
1276
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1277
+ "shape": [
1278
+ 5376,
1279
+ 14336
1280
+ ],
1281
+ "source_dtype": "bfloat16",
1282
+ "weight_global_amax": 19.5,
1283
+ "weight_saturation_rate": 0.06381946802139282,
1284
+ "weight_tensor_scale": 0.00725446455180645
1285
+ },
1286
+ "transformer_blocks.48.ff.net.0.proj.weight": {
1287
+ "block_scale_max": 448.0,
1288
+ "block_scale_mean": 16.88715362548828,
1289
+ "block_scale_min": 0.9375,
1290
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1291
+ "shape": [
1292
+ 28672,
1293
+ 5376
1294
+ ],
1295
+ "source_dtype": "bfloat16",
1296
+ "weight_global_amax": 10.25,
1297
+ "weight_saturation_rate": 0.06342049688100815,
1298
+ "weight_tensor_scale": 0.003813244169577956
1299
+ },
1300
+ "transformer_blocks.48.ff.net.2.weight": {
1301
+ "block_scale_max": 448.0,
1302
+ "block_scale_mean": 13.379511833190918,
1303
+ "block_scale_min": 0.8125,
1304
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1305
+ "shape": [
1306
+ 5376,
1307
+ 14336
1308
+ ],
1309
+ "source_dtype": "bfloat16",
1310
+ "weight_global_amax": 14.125,
1311
+ "weight_saturation_rate": 0.06343971192836761,
1312
+ "weight_tensor_scale": 0.0052548362873494625
1313
+ },
1314
+ "transformer_blocks.49.ff.net.0.proj.weight": {
1315
+ "block_scale_max": 448.0,
1316
+ "block_scale_mean": 11.566972732543945,
1317
+ "block_scale_min": 0.875,
1318
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1319
+ "shape": [
1320
+ 28672,
1321
+ 5376
1322
+ ],
1323
+ "source_dtype": "bfloat16",
1324
+ "weight_global_amax": 13.1875,
1325
+ "weight_saturation_rate": 0.0632794201374054,
1326
+ "weight_tensor_scale": 0.00490606389939785
1327
+ },
1328
+ "transformer_blocks.49.ff.net.2.weight": {
1329
+ "block_scale_max": 448.0,
1330
+ "block_scale_mean": 7.344248294830322,
1331
+ "block_scale_min": 0.5625,
1332
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1333
+ "shape": [
1334
+ 5376,
1335
+ 14336
1336
+ ],
1337
+ "source_dtype": "bfloat16",
1338
+ "weight_global_amax": 7.8125,
1339
+ "weight_saturation_rate": 0.06335751712322235,
1340
+ "weight_tensor_scale": 0.00290643610060215
1341
+ },
1342
+ "transformer_blocks.5.ff.net.0.proj.weight": {
1343
+ "block_scale_max": 448.0,
1344
+ "block_scale_mean": 40.42057800292969,
1345
+ "block_scale_min": 1.25,
1346
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1347
+ "shape": [
1348
+ 28672,
1349
+ 5376
1350
+ ],
1351
+ "source_dtype": "bfloat16",
1352
+ "weight_global_amax": 4.15625,
1353
+ "weight_saturation_rate": 0.06342287361621857,
1354
+ "weight_tensor_scale": 0.0015462239971384406
1355
+ },
1356
+ "transformer_blocks.5.ff.net.2.weight": {
1357
+ "block_scale_max": 448.0,
1358
+ "block_scale_mean": 50.37886428833008,
1359
+ "block_scale_min": 7.0,
1360
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1361
+ "shape": [
1362
+ 5376,
1363
+ 14336
1364
+ ],
1365
+ "source_dtype": "bfloat16",
1366
+ "weight_global_amax": 3.515625,
1367
+ "weight_saturation_rate": 0.06323392689228058,
1368
+ "weight_tensor_scale": 0.0013078962219879031
1369
+ },
1370
+ "transformer_blocks.6.ff.net.0.proj.weight": {
1371
+ "block_scale_max": 448.0,
1372
+ "block_scale_mean": 44.86915588378906,
1373
+ "block_scale_min": 1.5,
1374
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1375
+ "shape": [
1376
+ 28672,
1377
+ 5376
1378
+ ],
1379
+ "source_dtype": "bfloat16",
1380
+ "weight_global_amax": 3.734375,
1381
+ "weight_saturation_rate": 0.06323476135730743,
1382
+ "weight_tensor_scale": 0.0013892764691263437
1383
+ },
1384
+ "transformer_blocks.6.ff.net.2.weight": {
1385
+ "block_scale_max": 448.0,
1386
+ "block_scale_mean": 34.11444854736328,
1387
+ "block_scale_min": 3.75,
1388
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1389
+ "shape": [
1390
+ 5376,
1391
+ 14336
1392
+ ],
1393
+ "source_dtype": "bfloat16",
1394
+ "weight_global_amax": 5.15625,
1395
+ "weight_saturation_rate": 0.06395499408245087,
1396
+ "weight_tensor_scale": 0.0019182477844879031
1397
+ },
1398
+ "transformer_blocks.7.ff.net.0.proj.weight": {
1399
+ "block_scale_max": 448.0,
1400
+ "block_scale_mean": 36.13459396362305,
1401
+ "block_scale_min": 1.0,
1402
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1403
+ "shape": [
1404
+ 28672,
1405
+ 5376
1406
+ ],
1407
+ "source_dtype": "bfloat16",
1408
+ "weight_global_amax": 4.625,
1409
+ "weight_saturation_rate": 0.06365320831537247,
1410
+ "weight_tensor_scale": 0.0017206101911142468
1411
+ },
1412
+ "transformer_blocks.7.ff.net.2.weight": {
1413
+ "block_scale_max": 448.0,
1414
+ "block_scale_mean": 36.49217224121094,
1415
+ "block_scale_min": 6.0,
1416
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1417
+ "shape": [
1418
+ 5376,
1419
+ 14336
1420
+ ],
1421
+ "source_dtype": "bfloat16",
1422
+ "weight_global_amax": 4.8125,
1423
+ "weight_saturation_rate": 0.06392399966716766,
1424
+ "weight_tensor_scale": 0.0017903646221384406
1425
+ },
1426
+ "transformer_blocks.8.ff.net.0.proj.weight": {
1427
+ "block_scale_max": 448.0,
1428
+ "block_scale_mean": 59.09828567504883,
1429
+ "block_scale_min": 1.375,
1430
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1431
+ "shape": [
1432
+ 28672,
1433
+ 5376
1434
+ ],
1435
+ "source_dtype": "bfloat16",
1436
+ "weight_global_amax": 2.796875,
1437
+ "weight_saturation_rate": 0.06344044208526611,
1438
+ "weight_tensor_scale": 0.0010405040811747313
1439
+ },
1440
+ "transformer_blocks.8.ff.net.2.weight": {
1441
+ "block_scale_max": 448.0,
1442
+ "block_scale_mean": 73.22042083740234,
1443
+ "block_scale_min": 9.0,
1444
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1445
+ "shape": [
1446
+ 5376,
1447
+ 14336
1448
+ ],
1449
+ "source_dtype": "bfloat16",
1450
+ "weight_global_amax": 2.359375,
1451
+ "weight_saturation_rate": 0.06389103829860687,
1452
+ "weight_tensor_scale": 0.0008777437033131719
1453
+ },
1454
+ "transformer_blocks.9.ff.net.0.proj.weight": {
1455
+ "block_scale_max": 448.0,
1456
+ "block_scale_mean": 34.58192443847656,
1457
+ "block_scale_min": 0.875,
1458
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1459
+ "shape": [
1460
+ 28672,
1461
+ 5376
1462
+ ],
1463
+ "source_dtype": "bfloat16",
1464
+ "weight_global_amax": 4.65625,
1465
+ "weight_saturation_rate": 0.06360290199518204,
1466
+ "weight_tensor_scale": 0.0017322358908131719
1467
+ },
1468
+ "transformer_blocks.9.ff.net.2.weight": {
1469
+ "block_scale_max": 448.0,
1470
+ "block_scale_mean": 50.91958236694336,
1471
+ "block_scale_min": 6.0,
1472
+ "calibration": "static_mse_fp8_e4m3_scale_sweep_126_candidates",
1473
+ "shape": [
1474
+ 5376,
1475
+ 14336
1476
+ ],
1477
+ "source_dtype": "bfloat16",
1478
+ "weight_global_amax": 3.3125,
1479
+ "weight_saturation_rate": 0.0634537786245346,
1480
+ "weight_tensor_scale": 0.0012323289411142468
1481
+ }
1482
+ }
1483
+ }
vae/config.json ADDED
@@ -0,0 +1,97 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKLMiniMaxH3",
3
+ "_diffusers_version": "0.36.0.dev0",
4
+ "in_channels": 3,
5
+ "out_channels": 3,
6
+ "latent_channels": 24,
7
+ "block_out_channels": [
8
+ 128,
9
+ 256,
10
+ 256,
11
+ 512,
12
+ 512,
13
+ 1024
14
+ ],
15
+ "layers_per_block": 2,
16
+ "spatial_downsample_factors": [
17
+ 2,
18
+ 2,
19
+ 2,
20
+ 2,
21
+ 1,
22
+ 1
23
+ ],
24
+ "temporal_downsample_factors": [
25
+ 1,
26
+ 2,
27
+ 2,
28
+ 1,
29
+ 1,
30
+ 1
31
+ ],
32
+ "norm_num_groups": 32,
33
+ "norm_eps": 1e-06,
34
+ "spatial_padding_mode": "reflect",
35
+ "decoder_num_layers": 36,
36
+ "decoder_num_attention_heads": 32,
37
+ "decoder_attention_head_dim": 64,
38
+ "decoder_num_register_tokens": 4,
39
+ "decoder_ffn_mult": 4,
40
+ "decoder_rope_theta": 100.0,
41
+ "decoder_rope_dim_ratio": 0.75,
42
+ "decoder_norm_eps": 1e-05,
43
+ "clip_length": 17,
44
+ "token_drop": 3,
45
+ "latents_mean": [
46
+ 0.858090341091156,
47
+ -0.9606591463088989,
48
+ 1.0661640167236328,
49
+ -0.5090325474739075,
50
+ -0.2727581858634949,
51
+ -1.3675414323806763,
52
+ -0.2553254961967468,
53
+ -0.26907554268836975,
54
+ -0.5376840829849243,
55
+ -0.0464097298681736,
56
+ 0.6657370328903198,
57
+ 0.19690127670764923,
58
+ -0.5460608005523682,
59
+ -0.4035342037677765,
60
+ -0.23683024942874908,
61
+ 0.25928452610969543,
62
+ -0.30133944749832153,
63
+ 0.211341992020607,
64
+ -1.1206848621368408,
65
+ 0.3581933379173279,
66
+ -0.04225143790245056,
67
+ 0.2604829967021942,
68
+ 0.22864092886447906,
69
+ 0.7056031823158264
70
+ ],
71
+ "latents_std": [
72
+ 1.2223774194717407,
73
+ 1.2767263650894165,
74
+ 1.6831774711608887,
75
+ 1.7549455165863037,
76
+ 1.5636216402053833,
77
+ 2.194143533706665,
78
+ 0.9653137922286987,
79
+ 1.0569885969161987,
80
+ 0.841948926448822,
81
+ 0.7729952931404114,
82
+ 1.8955937623977661,
83
+ 0.946841835975647,
84
+ 0.7996809482574463,
85
+ 0.44988900423049927,
86
+ 0.7197399735450745,
87
+ 0.6936293244361877,
88
+ 2.961095094680786,
89
+ 2.7694199085235596,
90
+ 3.0496184825897217,
91
+ 2.1088054180145264,
92
+ 3.276226282119751,
93
+ 3.1627357006073,
94
+ 2.2816812992095947,
95
+ 2.6127843856811523
96
+ ]
97
+ }
vae/diffusion_pytorch_model.safetensors.index.json ADDED
@@ -0,0 +1,710 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "metadata": {
3
+ "total_size": 10415475936
4
+ },
5
+ "weight_map": {
6
+ "decoder.norm_out.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
7
+ "decoder.norm_out.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
8
+ "decoder.proj_in.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
9
+ "decoder.proj_in.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
10
+ "decoder.proj_out.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
11
+ "decoder.proj_out.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
12
+ "decoder.register_tokens": "diffusion_pytorch_model-00001-of-00003.safetensors",
13
+ "decoder.transformer_blocks.0.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
14
+ "decoder.transformer_blocks.0.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
15
+ "decoder.transformer_blocks.0.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
16
+ "decoder.transformer_blocks.0.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
17
+ "decoder.transformer_blocks.0.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
18
+ "decoder.transformer_blocks.0.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
19
+ "decoder.transformer_blocks.0.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
20
+ "decoder.transformer_blocks.0.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
21
+ "decoder.transformer_blocks.0.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
22
+ "decoder.transformer_blocks.0.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
23
+ "decoder.transformer_blocks.0.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
24
+ "decoder.transformer_blocks.0.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
25
+ "decoder.transformer_blocks.0.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
26
+ "decoder.transformer_blocks.0.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
27
+ "decoder.transformer_blocks.0.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
28
+ "decoder.transformer_blocks.0.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
29
+ "decoder.transformer_blocks.1.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
30
+ "decoder.transformer_blocks.1.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
31
+ "decoder.transformer_blocks.1.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
32
+ "decoder.transformer_blocks.1.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
33
+ "decoder.transformer_blocks.1.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
34
+ "decoder.transformer_blocks.1.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
35
+ "decoder.transformer_blocks.1.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
36
+ "decoder.transformer_blocks.1.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
37
+ "decoder.transformer_blocks.1.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
38
+ "decoder.transformer_blocks.1.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
39
+ "decoder.transformer_blocks.1.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
40
+ "decoder.transformer_blocks.1.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
41
+ "decoder.transformer_blocks.1.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
42
+ "decoder.transformer_blocks.1.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
43
+ "decoder.transformer_blocks.1.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
44
+ "decoder.transformer_blocks.1.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
45
+ "decoder.transformer_blocks.10.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
46
+ "decoder.transformer_blocks.10.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
47
+ "decoder.transformer_blocks.10.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
48
+ "decoder.transformer_blocks.10.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
49
+ "decoder.transformer_blocks.10.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
50
+ "decoder.transformer_blocks.10.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
51
+ "decoder.transformer_blocks.10.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
52
+ "decoder.transformer_blocks.10.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
53
+ "decoder.transformer_blocks.10.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
54
+ "decoder.transformer_blocks.10.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
55
+ "decoder.transformer_blocks.10.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
56
+ "decoder.transformer_blocks.10.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
57
+ "decoder.transformer_blocks.10.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
58
+ "decoder.transformer_blocks.10.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
59
+ "decoder.transformer_blocks.10.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
60
+ "decoder.transformer_blocks.10.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
61
+ "decoder.transformer_blocks.11.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
62
+ "decoder.transformer_blocks.11.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
63
+ "decoder.transformer_blocks.11.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
64
+ "decoder.transformer_blocks.11.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
65
+ "decoder.transformer_blocks.11.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
66
+ "decoder.transformer_blocks.11.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
67
+ "decoder.transformer_blocks.11.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
68
+ "decoder.transformer_blocks.11.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
69
+ "decoder.transformer_blocks.11.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
70
+ "decoder.transformer_blocks.11.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
71
+ "decoder.transformer_blocks.11.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
72
+ "decoder.transformer_blocks.11.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
73
+ "decoder.transformer_blocks.11.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
74
+ "decoder.transformer_blocks.11.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
75
+ "decoder.transformer_blocks.11.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
76
+ "decoder.transformer_blocks.11.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
77
+ "decoder.transformer_blocks.12.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
78
+ "decoder.transformer_blocks.12.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
79
+ "decoder.transformer_blocks.12.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
80
+ "decoder.transformer_blocks.12.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
81
+ "decoder.transformer_blocks.12.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
82
+ "decoder.transformer_blocks.12.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
83
+ "decoder.transformer_blocks.12.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
84
+ "decoder.transformer_blocks.12.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
85
+ "decoder.transformer_blocks.12.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
86
+ "decoder.transformer_blocks.12.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
87
+ "decoder.transformer_blocks.12.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
88
+ "decoder.transformer_blocks.12.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
89
+ "decoder.transformer_blocks.12.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
90
+ "decoder.transformer_blocks.12.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
91
+ "decoder.transformer_blocks.12.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
92
+ "decoder.transformer_blocks.12.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
93
+ "decoder.transformer_blocks.13.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
94
+ "decoder.transformer_blocks.13.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
95
+ "decoder.transformer_blocks.13.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
96
+ "decoder.transformer_blocks.13.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
97
+ "decoder.transformer_blocks.13.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
98
+ "decoder.transformer_blocks.13.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
99
+ "decoder.transformer_blocks.13.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
100
+ "decoder.transformer_blocks.13.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
101
+ "decoder.transformer_blocks.13.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
102
+ "decoder.transformer_blocks.13.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
103
+ "decoder.transformer_blocks.13.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
104
+ "decoder.transformer_blocks.13.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
105
+ "decoder.transformer_blocks.13.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
106
+ "decoder.transformer_blocks.13.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
107
+ "decoder.transformer_blocks.13.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
108
+ "decoder.transformer_blocks.13.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
109
+ "decoder.transformer_blocks.14.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
110
+ "decoder.transformer_blocks.14.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
111
+ "decoder.transformer_blocks.14.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
112
+ "decoder.transformer_blocks.14.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
113
+ "decoder.transformer_blocks.14.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
114
+ "decoder.transformer_blocks.14.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
115
+ "decoder.transformer_blocks.14.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
116
+ "decoder.transformer_blocks.14.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
117
+ "decoder.transformer_blocks.14.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
118
+ "decoder.transformer_blocks.14.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
119
+ "decoder.transformer_blocks.14.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
120
+ "decoder.transformer_blocks.14.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
121
+ "decoder.transformer_blocks.14.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
122
+ "decoder.transformer_blocks.14.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
123
+ "decoder.transformer_blocks.14.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
124
+ "decoder.transformer_blocks.14.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
125
+ "decoder.transformer_blocks.15.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
126
+ "decoder.transformer_blocks.15.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
127
+ "decoder.transformer_blocks.15.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
128
+ "decoder.transformer_blocks.15.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
129
+ "decoder.transformer_blocks.15.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
130
+ "decoder.transformer_blocks.15.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
131
+ "decoder.transformer_blocks.15.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
132
+ "decoder.transformer_blocks.15.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
133
+ "decoder.transformer_blocks.15.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
134
+ "decoder.transformer_blocks.15.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
135
+ "decoder.transformer_blocks.15.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
136
+ "decoder.transformer_blocks.15.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
137
+ "decoder.transformer_blocks.15.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
138
+ "decoder.transformer_blocks.15.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
139
+ "decoder.transformer_blocks.15.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
140
+ "decoder.transformer_blocks.15.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
141
+ "decoder.transformer_blocks.16.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
142
+ "decoder.transformer_blocks.16.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
143
+ "decoder.transformer_blocks.16.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
144
+ "decoder.transformer_blocks.16.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
145
+ "decoder.transformer_blocks.16.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
146
+ "decoder.transformer_blocks.16.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
147
+ "decoder.transformer_blocks.16.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
148
+ "decoder.transformer_blocks.16.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
149
+ "decoder.transformer_blocks.16.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
150
+ "decoder.transformer_blocks.16.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
151
+ "decoder.transformer_blocks.16.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
152
+ "decoder.transformer_blocks.16.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
153
+ "decoder.transformer_blocks.16.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
154
+ "decoder.transformer_blocks.16.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
155
+ "decoder.transformer_blocks.16.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
156
+ "decoder.transformer_blocks.16.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
157
+ "decoder.transformer_blocks.17.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
158
+ "decoder.transformer_blocks.17.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
159
+ "decoder.transformer_blocks.17.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
160
+ "decoder.transformer_blocks.17.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
161
+ "decoder.transformer_blocks.17.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
162
+ "decoder.transformer_blocks.17.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
163
+ "decoder.transformer_blocks.17.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
164
+ "decoder.transformer_blocks.17.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
165
+ "decoder.transformer_blocks.17.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
166
+ "decoder.transformer_blocks.17.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
167
+ "decoder.transformer_blocks.17.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
168
+ "decoder.transformer_blocks.17.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
169
+ "decoder.transformer_blocks.17.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
170
+ "decoder.transformer_blocks.17.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
171
+ "decoder.transformer_blocks.17.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
172
+ "decoder.transformer_blocks.17.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
173
+ "decoder.transformer_blocks.18.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
174
+ "decoder.transformer_blocks.18.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
175
+ "decoder.transformer_blocks.18.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
176
+ "decoder.transformer_blocks.18.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
177
+ "decoder.transformer_blocks.18.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
178
+ "decoder.transformer_blocks.18.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
179
+ "decoder.transformer_blocks.18.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
180
+ "decoder.transformer_blocks.18.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
181
+ "decoder.transformer_blocks.18.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
182
+ "decoder.transformer_blocks.18.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
183
+ "decoder.transformer_blocks.18.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
184
+ "decoder.transformer_blocks.18.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
185
+ "decoder.transformer_blocks.18.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
186
+ "decoder.transformer_blocks.18.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
187
+ "decoder.transformer_blocks.18.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
188
+ "decoder.transformer_blocks.18.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
189
+ "decoder.transformer_blocks.19.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
190
+ "decoder.transformer_blocks.19.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
191
+ "decoder.transformer_blocks.19.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
192
+ "decoder.transformer_blocks.19.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
193
+ "decoder.transformer_blocks.19.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
194
+ "decoder.transformer_blocks.19.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
195
+ "decoder.transformer_blocks.19.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
196
+ "decoder.transformer_blocks.19.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
197
+ "decoder.transformer_blocks.19.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
198
+ "decoder.transformer_blocks.19.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
199
+ "decoder.transformer_blocks.19.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
200
+ "decoder.transformer_blocks.19.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
201
+ "decoder.transformer_blocks.19.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
202
+ "decoder.transformer_blocks.19.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
203
+ "decoder.transformer_blocks.19.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
204
+ "decoder.transformer_blocks.19.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
205
+ "decoder.transformer_blocks.2.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
206
+ "decoder.transformer_blocks.2.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
207
+ "decoder.transformer_blocks.2.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
208
+ "decoder.transformer_blocks.2.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
209
+ "decoder.transformer_blocks.2.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
210
+ "decoder.transformer_blocks.2.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
211
+ "decoder.transformer_blocks.2.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
212
+ "decoder.transformer_blocks.2.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
213
+ "decoder.transformer_blocks.2.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
214
+ "decoder.transformer_blocks.2.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
215
+ "decoder.transformer_blocks.2.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
216
+ "decoder.transformer_blocks.2.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
217
+ "decoder.transformer_blocks.2.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
218
+ "decoder.transformer_blocks.2.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
219
+ "decoder.transformer_blocks.2.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
220
+ "decoder.transformer_blocks.2.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
221
+ "decoder.transformer_blocks.20.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
222
+ "decoder.transformer_blocks.20.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
223
+ "decoder.transformer_blocks.20.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
224
+ "decoder.transformer_blocks.20.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
225
+ "decoder.transformer_blocks.20.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
226
+ "decoder.transformer_blocks.20.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
227
+ "decoder.transformer_blocks.20.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
228
+ "decoder.transformer_blocks.20.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
229
+ "decoder.transformer_blocks.20.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
230
+ "decoder.transformer_blocks.20.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
231
+ "decoder.transformer_blocks.20.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
232
+ "decoder.transformer_blocks.20.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
233
+ "decoder.transformer_blocks.20.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
234
+ "decoder.transformer_blocks.20.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
235
+ "decoder.transformer_blocks.20.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
236
+ "decoder.transformer_blocks.20.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
237
+ "decoder.transformer_blocks.21.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
238
+ "decoder.transformer_blocks.21.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
239
+ "decoder.transformer_blocks.21.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
240
+ "decoder.transformer_blocks.21.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
241
+ "decoder.transformer_blocks.21.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
242
+ "decoder.transformer_blocks.21.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
243
+ "decoder.transformer_blocks.21.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
244
+ "decoder.transformer_blocks.21.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
245
+ "decoder.transformer_blocks.21.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
246
+ "decoder.transformer_blocks.21.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
247
+ "decoder.transformer_blocks.21.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
248
+ "decoder.transformer_blocks.21.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
249
+ "decoder.transformer_blocks.21.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
250
+ "decoder.transformer_blocks.21.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
251
+ "decoder.transformer_blocks.21.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
252
+ "decoder.transformer_blocks.21.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
253
+ "decoder.transformer_blocks.22.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
254
+ "decoder.transformer_blocks.22.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
255
+ "decoder.transformer_blocks.22.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
256
+ "decoder.transformer_blocks.22.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
257
+ "decoder.transformer_blocks.22.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
258
+ "decoder.transformer_blocks.22.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
259
+ "decoder.transformer_blocks.22.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
260
+ "decoder.transformer_blocks.22.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
261
+ "decoder.transformer_blocks.22.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
262
+ "decoder.transformer_blocks.22.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
263
+ "decoder.transformer_blocks.22.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
264
+ "decoder.transformer_blocks.22.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
265
+ "decoder.transformer_blocks.22.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
266
+ "decoder.transformer_blocks.22.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
267
+ "decoder.transformer_blocks.22.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
268
+ "decoder.transformer_blocks.22.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
269
+ "decoder.transformer_blocks.23.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
270
+ "decoder.transformer_blocks.23.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
271
+ "decoder.transformer_blocks.23.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
272
+ "decoder.transformer_blocks.23.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
273
+ "decoder.transformer_blocks.23.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
274
+ "decoder.transformer_blocks.23.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
275
+ "decoder.transformer_blocks.23.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
276
+ "decoder.transformer_blocks.23.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
277
+ "decoder.transformer_blocks.23.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
278
+ "decoder.transformer_blocks.23.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
279
+ "decoder.transformer_blocks.23.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
280
+ "decoder.transformer_blocks.23.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
281
+ "decoder.transformer_blocks.23.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
282
+ "decoder.transformer_blocks.23.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
283
+ "decoder.transformer_blocks.23.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
284
+ "decoder.transformer_blocks.23.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
285
+ "decoder.transformer_blocks.24.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
286
+ "decoder.transformer_blocks.24.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
287
+ "decoder.transformer_blocks.24.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
288
+ "decoder.transformer_blocks.24.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
289
+ "decoder.transformer_blocks.24.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
290
+ "decoder.transformer_blocks.24.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
291
+ "decoder.transformer_blocks.24.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
292
+ "decoder.transformer_blocks.24.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
293
+ "decoder.transformer_blocks.24.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
294
+ "decoder.transformer_blocks.24.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
295
+ "decoder.transformer_blocks.24.ff.net.2.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
296
+ "decoder.transformer_blocks.24.ff.net.2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
297
+ "decoder.transformer_blocks.24.norm1.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
298
+ "decoder.transformer_blocks.24.norm2.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
299
+ "decoder.transformer_blocks.24.scale1": "diffusion_pytorch_model-00001-of-00003.safetensors",
300
+ "decoder.transformer_blocks.24.scale2": "diffusion_pytorch_model-00001-of-00003.safetensors",
301
+ "decoder.transformer_blocks.25.attn.to_k.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
302
+ "decoder.transformer_blocks.25.attn.to_k.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
303
+ "decoder.transformer_blocks.25.attn.to_out.0.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
304
+ "decoder.transformer_blocks.25.attn.to_out.0.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
305
+ "decoder.transformer_blocks.25.attn.to_q.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
306
+ "decoder.transformer_blocks.25.attn.to_q.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
307
+ "decoder.transformer_blocks.25.attn.to_v.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
308
+ "decoder.transformer_blocks.25.attn.to_v.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
309
+ "decoder.transformer_blocks.25.ff.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00003.safetensors",
310
+ "decoder.transformer_blocks.25.ff.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00003.safetensors",
311
+ "decoder.transformer_blocks.25.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
312
+ "decoder.transformer_blocks.25.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
313
+ "decoder.transformer_blocks.25.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
314
+ "decoder.transformer_blocks.25.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
315
+ "decoder.transformer_blocks.25.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
316
+ "decoder.transformer_blocks.25.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
317
+ "decoder.transformer_blocks.26.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
318
+ "decoder.transformer_blocks.26.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
319
+ "decoder.transformer_blocks.26.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
320
+ "decoder.transformer_blocks.26.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
321
+ "decoder.transformer_blocks.26.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
322
+ "decoder.transformer_blocks.26.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
323
+ "decoder.transformer_blocks.26.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
324
+ "decoder.transformer_blocks.26.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
325
+ "decoder.transformer_blocks.26.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
326
+ "decoder.transformer_blocks.26.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
327
+ "decoder.transformer_blocks.26.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
328
+ "decoder.transformer_blocks.26.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
329
+ "decoder.transformer_blocks.26.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
330
+ "decoder.transformer_blocks.26.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
331
+ "decoder.transformer_blocks.26.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
332
+ "decoder.transformer_blocks.26.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
333
+ "decoder.transformer_blocks.27.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
334
+ "decoder.transformer_blocks.27.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
335
+ "decoder.transformer_blocks.27.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
336
+ "decoder.transformer_blocks.27.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
337
+ "decoder.transformer_blocks.27.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
338
+ "decoder.transformer_blocks.27.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
339
+ "decoder.transformer_blocks.27.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
340
+ "decoder.transformer_blocks.27.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
341
+ "decoder.transformer_blocks.27.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
342
+ "decoder.transformer_blocks.27.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
343
+ "decoder.transformer_blocks.27.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
344
+ "decoder.transformer_blocks.27.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
345
+ "decoder.transformer_blocks.27.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
346
+ "decoder.transformer_blocks.27.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
347
+ "decoder.transformer_blocks.27.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
348
+ "decoder.transformer_blocks.27.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
349
+ "decoder.transformer_blocks.28.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
350
+ "decoder.transformer_blocks.28.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
351
+ "decoder.transformer_blocks.28.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
352
+ "decoder.transformer_blocks.28.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
353
+ "decoder.transformer_blocks.28.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
354
+ "decoder.transformer_blocks.28.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
355
+ "decoder.transformer_blocks.28.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
356
+ "decoder.transformer_blocks.28.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
357
+ "decoder.transformer_blocks.28.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
358
+ "decoder.transformer_blocks.28.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
359
+ "decoder.transformer_blocks.28.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
360
+ "decoder.transformer_blocks.28.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
361
+ "decoder.transformer_blocks.28.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
362
+ "decoder.transformer_blocks.28.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
363
+ "decoder.transformer_blocks.28.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
364
+ "decoder.transformer_blocks.28.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
365
+ "decoder.transformer_blocks.29.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
366
+ "decoder.transformer_blocks.29.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
367
+ "decoder.transformer_blocks.29.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
368
+ "decoder.transformer_blocks.29.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
369
+ "decoder.transformer_blocks.29.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
370
+ "decoder.transformer_blocks.29.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
371
+ "decoder.transformer_blocks.29.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
372
+ "decoder.transformer_blocks.29.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
373
+ "decoder.transformer_blocks.29.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
374
+ "decoder.transformer_blocks.29.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
375
+ "decoder.transformer_blocks.29.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
376
+ "decoder.transformer_blocks.29.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
377
+ "decoder.transformer_blocks.29.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
378
+ "decoder.transformer_blocks.29.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
379
+ "decoder.transformer_blocks.29.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
380
+ "decoder.transformer_blocks.29.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
381
+ "decoder.transformer_blocks.3.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
382
+ "decoder.transformer_blocks.3.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
383
+ "decoder.transformer_blocks.3.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
384
+ "decoder.transformer_blocks.3.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
385
+ "decoder.transformer_blocks.3.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
386
+ "decoder.transformer_blocks.3.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
387
+ "decoder.transformer_blocks.3.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
388
+ "decoder.transformer_blocks.3.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
389
+ "decoder.transformer_blocks.3.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
390
+ "decoder.transformer_blocks.3.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
391
+ "decoder.transformer_blocks.3.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
392
+ "decoder.transformer_blocks.3.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
393
+ "decoder.transformer_blocks.3.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
394
+ "decoder.transformer_blocks.3.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
395
+ "decoder.transformer_blocks.3.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
396
+ "decoder.transformer_blocks.3.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
397
+ "decoder.transformer_blocks.30.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
398
+ "decoder.transformer_blocks.30.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
399
+ "decoder.transformer_blocks.30.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
400
+ "decoder.transformer_blocks.30.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
401
+ "decoder.transformer_blocks.30.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
402
+ "decoder.transformer_blocks.30.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
403
+ "decoder.transformer_blocks.30.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
404
+ "decoder.transformer_blocks.30.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
405
+ "decoder.transformer_blocks.30.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
406
+ "decoder.transformer_blocks.30.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
407
+ "decoder.transformer_blocks.30.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
408
+ "decoder.transformer_blocks.30.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
409
+ "decoder.transformer_blocks.30.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
410
+ "decoder.transformer_blocks.30.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
411
+ "decoder.transformer_blocks.30.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
412
+ "decoder.transformer_blocks.30.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
413
+ "decoder.transformer_blocks.31.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
414
+ "decoder.transformer_blocks.31.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
415
+ "decoder.transformer_blocks.31.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
416
+ "decoder.transformer_blocks.31.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
417
+ "decoder.transformer_blocks.31.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
418
+ "decoder.transformer_blocks.31.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
419
+ "decoder.transformer_blocks.31.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
420
+ "decoder.transformer_blocks.31.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
421
+ "decoder.transformer_blocks.31.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
422
+ "decoder.transformer_blocks.31.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
423
+ "decoder.transformer_blocks.31.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
424
+ "decoder.transformer_blocks.31.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
425
+ "decoder.transformer_blocks.31.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
426
+ "decoder.transformer_blocks.31.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
427
+ "decoder.transformer_blocks.31.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
428
+ "decoder.transformer_blocks.31.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
429
+ "decoder.transformer_blocks.32.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
430
+ "decoder.transformer_blocks.32.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
431
+ "decoder.transformer_blocks.32.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
432
+ "decoder.transformer_blocks.32.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
433
+ "decoder.transformer_blocks.32.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
434
+ "decoder.transformer_blocks.32.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
435
+ "decoder.transformer_blocks.32.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
436
+ "decoder.transformer_blocks.32.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
437
+ "decoder.transformer_blocks.32.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
438
+ "decoder.transformer_blocks.32.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
439
+ "decoder.transformer_blocks.32.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
440
+ "decoder.transformer_blocks.32.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
441
+ "decoder.transformer_blocks.32.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
442
+ "decoder.transformer_blocks.32.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
443
+ "decoder.transformer_blocks.32.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
444
+ "decoder.transformer_blocks.32.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
445
+ "decoder.transformer_blocks.33.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
446
+ "decoder.transformer_blocks.33.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
447
+ "decoder.transformer_blocks.33.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
448
+ "decoder.transformer_blocks.33.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
449
+ "decoder.transformer_blocks.33.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
450
+ "decoder.transformer_blocks.33.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
451
+ "decoder.transformer_blocks.33.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
452
+ "decoder.transformer_blocks.33.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
453
+ "decoder.transformer_blocks.33.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
454
+ "decoder.transformer_blocks.33.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
455
+ "decoder.transformer_blocks.33.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
456
+ "decoder.transformer_blocks.33.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
457
+ "decoder.transformer_blocks.33.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
458
+ "decoder.transformer_blocks.33.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
459
+ "decoder.transformer_blocks.33.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
460
+ "decoder.transformer_blocks.33.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
461
+ "decoder.transformer_blocks.34.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
462
+ "decoder.transformer_blocks.34.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
463
+ "decoder.transformer_blocks.34.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
464
+ "decoder.transformer_blocks.34.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
465
+ "decoder.transformer_blocks.34.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
466
+ "decoder.transformer_blocks.34.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
467
+ "decoder.transformer_blocks.34.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
468
+ "decoder.transformer_blocks.34.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
469
+ "decoder.transformer_blocks.34.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
470
+ "decoder.transformer_blocks.34.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
471
+ "decoder.transformer_blocks.34.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
472
+ "decoder.transformer_blocks.34.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
473
+ "decoder.transformer_blocks.34.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
474
+ "decoder.transformer_blocks.34.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
475
+ "decoder.transformer_blocks.34.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
476
+ "decoder.transformer_blocks.34.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
477
+ "decoder.transformer_blocks.35.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
478
+ "decoder.transformer_blocks.35.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
479
+ "decoder.transformer_blocks.35.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
480
+ "decoder.transformer_blocks.35.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
481
+ "decoder.transformer_blocks.35.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
482
+ "decoder.transformer_blocks.35.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
483
+ "decoder.transformer_blocks.35.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
484
+ "decoder.transformer_blocks.35.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
485
+ "decoder.transformer_blocks.35.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
486
+ "decoder.transformer_blocks.35.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
487
+ "decoder.transformer_blocks.35.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
488
+ "decoder.transformer_blocks.35.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
489
+ "decoder.transformer_blocks.35.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
490
+ "decoder.transformer_blocks.35.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
491
+ "decoder.transformer_blocks.35.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
492
+ "decoder.transformer_blocks.35.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
493
+ "decoder.transformer_blocks.4.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
494
+ "decoder.transformer_blocks.4.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
495
+ "decoder.transformer_blocks.4.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
496
+ "decoder.transformer_blocks.4.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
497
+ "decoder.transformer_blocks.4.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
498
+ "decoder.transformer_blocks.4.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
499
+ "decoder.transformer_blocks.4.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
500
+ "decoder.transformer_blocks.4.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
501
+ "decoder.transformer_blocks.4.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
502
+ "decoder.transformer_blocks.4.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
503
+ "decoder.transformer_blocks.4.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
504
+ "decoder.transformer_blocks.4.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
505
+ "decoder.transformer_blocks.4.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
506
+ "decoder.transformer_blocks.4.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
507
+ "decoder.transformer_blocks.4.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
508
+ "decoder.transformer_blocks.4.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
509
+ "decoder.transformer_blocks.5.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
510
+ "decoder.transformer_blocks.5.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
511
+ "decoder.transformer_blocks.5.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
512
+ "decoder.transformer_blocks.5.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
513
+ "decoder.transformer_blocks.5.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
514
+ "decoder.transformer_blocks.5.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
515
+ "decoder.transformer_blocks.5.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
516
+ "decoder.transformer_blocks.5.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
517
+ "decoder.transformer_blocks.5.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
518
+ "decoder.transformer_blocks.5.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
519
+ "decoder.transformer_blocks.5.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
520
+ "decoder.transformer_blocks.5.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
521
+ "decoder.transformer_blocks.5.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
522
+ "decoder.transformer_blocks.5.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
523
+ "decoder.transformer_blocks.5.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
524
+ "decoder.transformer_blocks.5.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
525
+ "decoder.transformer_blocks.6.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
526
+ "decoder.transformer_blocks.6.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
527
+ "decoder.transformer_blocks.6.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
528
+ "decoder.transformer_blocks.6.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
529
+ "decoder.transformer_blocks.6.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
530
+ "decoder.transformer_blocks.6.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
531
+ "decoder.transformer_blocks.6.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
532
+ "decoder.transformer_blocks.6.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
533
+ "decoder.transformer_blocks.6.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
534
+ "decoder.transformer_blocks.6.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
535
+ "decoder.transformer_blocks.6.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
536
+ "decoder.transformer_blocks.6.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
537
+ "decoder.transformer_blocks.6.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
538
+ "decoder.transformer_blocks.6.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
539
+ "decoder.transformer_blocks.6.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
540
+ "decoder.transformer_blocks.6.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
541
+ "decoder.transformer_blocks.7.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
542
+ "decoder.transformer_blocks.7.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
543
+ "decoder.transformer_blocks.7.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
544
+ "decoder.transformer_blocks.7.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
545
+ "decoder.transformer_blocks.7.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
546
+ "decoder.transformer_blocks.7.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
547
+ "decoder.transformer_blocks.7.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
548
+ "decoder.transformer_blocks.7.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
549
+ "decoder.transformer_blocks.7.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
550
+ "decoder.transformer_blocks.7.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
551
+ "decoder.transformer_blocks.7.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
552
+ "decoder.transformer_blocks.7.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
553
+ "decoder.transformer_blocks.7.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
554
+ "decoder.transformer_blocks.7.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
555
+ "decoder.transformer_blocks.7.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
556
+ "decoder.transformer_blocks.7.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
557
+ "decoder.transformer_blocks.8.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
558
+ "decoder.transformer_blocks.8.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
559
+ "decoder.transformer_blocks.8.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
560
+ "decoder.transformer_blocks.8.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
561
+ "decoder.transformer_blocks.8.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
562
+ "decoder.transformer_blocks.8.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
563
+ "decoder.transformer_blocks.8.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
564
+ "decoder.transformer_blocks.8.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
565
+ "decoder.transformer_blocks.8.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
566
+ "decoder.transformer_blocks.8.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
567
+ "decoder.transformer_blocks.8.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
568
+ "decoder.transformer_blocks.8.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
569
+ "decoder.transformer_blocks.8.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
570
+ "decoder.transformer_blocks.8.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
571
+ "decoder.transformer_blocks.8.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
572
+ "decoder.transformer_blocks.8.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
573
+ "decoder.transformer_blocks.9.attn.to_k.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
574
+ "decoder.transformer_blocks.9.attn.to_k.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
575
+ "decoder.transformer_blocks.9.attn.to_out.0.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
576
+ "decoder.transformer_blocks.9.attn.to_out.0.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
577
+ "decoder.transformer_blocks.9.attn.to_q.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
578
+ "decoder.transformer_blocks.9.attn.to_q.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
579
+ "decoder.transformer_blocks.9.attn.to_v.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
580
+ "decoder.transformer_blocks.9.attn.to_v.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
581
+ "decoder.transformer_blocks.9.ff.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
582
+ "decoder.transformer_blocks.9.ff.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
583
+ "decoder.transformer_blocks.9.ff.net.2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
584
+ "decoder.transformer_blocks.9.ff.net.2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
585
+ "decoder.transformer_blocks.9.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
586
+ "decoder.transformer_blocks.9.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
587
+ "decoder.transformer_blocks.9.scale1": "diffusion_pytorch_model-00002-of-00003.safetensors",
588
+ "decoder.transformer_blocks.9.scale2": "diffusion_pytorch_model-00002-of-00003.safetensors",
589
+ "encoder.conv_in.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
590
+ "encoder.conv_in.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
591
+ "encoder.conv_out.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
592
+ "encoder.conv_out.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
593
+ "encoder.down_blocks.0.downsamplers.0.conv.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
594
+ "encoder.down_blocks.0.downsamplers.0.conv.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
595
+ "encoder.down_blocks.0.resnets.0.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
596
+ "encoder.down_blocks.0.resnets.0.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
597
+ "encoder.down_blocks.0.resnets.0.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
598
+ "encoder.down_blocks.0.resnets.0.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
599
+ "encoder.down_blocks.0.resnets.0.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
600
+ "encoder.down_blocks.0.resnets.0.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
601
+ "encoder.down_blocks.0.resnets.0.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
602
+ "encoder.down_blocks.0.resnets.0.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
603
+ "encoder.down_blocks.0.resnets.1.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
604
+ "encoder.down_blocks.0.resnets.1.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
605
+ "encoder.down_blocks.0.resnets.1.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
606
+ "encoder.down_blocks.0.resnets.1.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
607
+ "encoder.down_blocks.0.resnets.1.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
608
+ "encoder.down_blocks.0.resnets.1.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
609
+ "encoder.down_blocks.0.resnets.1.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
610
+ "encoder.down_blocks.0.resnets.1.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
611
+ "encoder.down_blocks.1.downsamplers.0.conv.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
612
+ "encoder.down_blocks.1.downsamplers.0.conv.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
613
+ "encoder.down_blocks.1.resnets.0.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
614
+ "encoder.down_blocks.1.resnets.0.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
615
+ "encoder.down_blocks.1.resnets.0.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
616
+ "encoder.down_blocks.1.resnets.0.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
617
+ "encoder.down_blocks.1.resnets.0.conv_shortcut.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
618
+ "encoder.down_blocks.1.resnets.0.conv_shortcut.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
619
+ "encoder.down_blocks.1.resnets.0.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
620
+ "encoder.down_blocks.1.resnets.0.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
621
+ "encoder.down_blocks.1.resnets.0.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
622
+ "encoder.down_blocks.1.resnets.0.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
623
+ "encoder.down_blocks.1.resnets.1.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
624
+ "encoder.down_blocks.1.resnets.1.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
625
+ "encoder.down_blocks.1.resnets.1.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
626
+ "encoder.down_blocks.1.resnets.1.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
627
+ "encoder.down_blocks.1.resnets.1.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
628
+ "encoder.down_blocks.1.resnets.1.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
629
+ "encoder.down_blocks.1.resnets.1.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
630
+ "encoder.down_blocks.1.resnets.1.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
631
+ "encoder.down_blocks.2.downsamplers.0.conv.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
632
+ "encoder.down_blocks.2.downsamplers.0.conv.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
633
+ "encoder.down_blocks.2.resnets.0.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
634
+ "encoder.down_blocks.2.resnets.0.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
635
+ "encoder.down_blocks.2.resnets.0.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
636
+ "encoder.down_blocks.2.resnets.0.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
637
+ "encoder.down_blocks.2.resnets.0.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
638
+ "encoder.down_blocks.2.resnets.0.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
639
+ "encoder.down_blocks.2.resnets.0.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
640
+ "encoder.down_blocks.2.resnets.0.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
641
+ "encoder.down_blocks.2.resnets.1.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
642
+ "encoder.down_blocks.2.resnets.1.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
643
+ "encoder.down_blocks.2.resnets.1.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
644
+ "encoder.down_blocks.2.resnets.1.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
645
+ "encoder.down_blocks.2.resnets.1.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
646
+ "encoder.down_blocks.2.resnets.1.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
647
+ "encoder.down_blocks.2.resnets.1.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
648
+ "encoder.down_blocks.2.resnets.1.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
649
+ "encoder.down_blocks.3.downsamplers.0.conv.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
650
+ "encoder.down_blocks.3.downsamplers.0.conv.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
651
+ "encoder.down_blocks.3.resnets.0.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
652
+ "encoder.down_blocks.3.resnets.0.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
653
+ "encoder.down_blocks.3.resnets.0.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
654
+ "encoder.down_blocks.3.resnets.0.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
655
+ "encoder.down_blocks.3.resnets.0.conv_shortcut.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
656
+ "encoder.down_blocks.3.resnets.0.conv_shortcut.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
657
+ "encoder.down_blocks.3.resnets.0.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
658
+ "encoder.down_blocks.3.resnets.0.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
659
+ "encoder.down_blocks.3.resnets.0.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
660
+ "encoder.down_blocks.3.resnets.0.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
661
+ "encoder.down_blocks.3.resnets.1.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
662
+ "encoder.down_blocks.3.resnets.1.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
663
+ "encoder.down_blocks.3.resnets.1.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
664
+ "encoder.down_blocks.3.resnets.1.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
665
+ "encoder.down_blocks.3.resnets.1.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
666
+ "encoder.down_blocks.3.resnets.1.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
667
+ "encoder.down_blocks.3.resnets.1.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
668
+ "encoder.down_blocks.3.resnets.1.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
669
+ "encoder.down_blocks.4.resnets.0.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
670
+ "encoder.down_blocks.4.resnets.0.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
671
+ "encoder.down_blocks.4.resnets.0.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
672
+ "encoder.down_blocks.4.resnets.0.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
673
+ "encoder.down_blocks.4.resnets.0.norm1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
674
+ "encoder.down_blocks.4.resnets.0.norm1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
675
+ "encoder.down_blocks.4.resnets.0.norm2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
676
+ "encoder.down_blocks.4.resnets.0.norm2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
677
+ "encoder.down_blocks.4.resnets.1.conv1.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
678
+ "encoder.down_blocks.4.resnets.1.conv1.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
679
+ "encoder.down_blocks.4.resnets.1.conv2.bias": "diffusion_pytorch_model-00002-of-00003.safetensors",
680
+ "encoder.down_blocks.4.resnets.1.conv2.weight": "diffusion_pytorch_model-00002-of-00003.safetensors",
681
+ "encoder.down_blocks.4.resnets.1.norm1.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
682
+ "encoder.down_blocks.4.resnets.1.norm1.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
683
+ "encoder.down_blocks.4.resnets.1.norm2.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
684
+ "encoder.down_blocks.4.resnets.1.norm2.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
685
+ "encoder.down_blocks.5.resnets.0.conv1.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
686
+ "encoder.down_blocks.5.resnets.0.conv1.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
687
+ "encoder.down_blocks.5.resnets.0.conv2.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
688
+ "encoder.down_blocks.5.resnets.0.conv2.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
689
+ "encoder.down_blocks.5.resnets.0.conv_shortcut.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
690
+ "encoder.down_blocks.5.resnets.0.conv_shortcut.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
691
+ "encoder.down_blocks.5.resnets.0.norm1.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
692
+ "encoder.down_blocks.5.resnets.0.norm1.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
693
+ "encoder.down_blocks.5.resnets.0.norm2.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
694
+ "encoder.down_blocks.5.resnets.0.norm2.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
695
+ "encoder.down_blocks.5.resnets.1.conv1.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
696
+ "encoder.down_blocks.5.resnets.1.conv1.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
697
+ "encoder.down_blocks.5.resnets.1.conv2.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
698
+ "encoder.down_blocks.5.resnets.1.conv2.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
699
+ "encoder.down_blocks.5.resnets.1.norm1.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
700
+ "encoder.down_blocks.5.resnets.1.norm1.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
701
+ "encoder.down_blocks.5.resnets.1.norm2.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
702
+ "encoder.down_blocks.5.resnets.1.norm2.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
703
+ "encoder.norm_out.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
704
+ "encoder.norm_out.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
705
+ "post_quant_conv.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
706
+ "post_quant_conv.weight": "diffusion_pytorch_model-00003-of-00003.safetensors",
707
+ "quant_conv.bias": "diffusion_pytorch_model-00003-of-00003.safetensors",
708
+ "quant_conv.weight": "diffusion_pytorch_model-00003-of-00003.safetensors"
709
+ }
710
+ }