Repository navigation
[Issue] When generating a model using Trellis2 GGUF error cannot find tqdm appears v0.3.4 #129
Description
When generating a model with Trellis2 GGUF on version v0.3.4 the following error is displayed.
It seems like Trellis2 GGUF repository might have been updated but the fork was not.
Error: Traceback (most recent call last): File "C:\Program Files\Modly\resources\api\routers\generation.py", line 153, in _run_generation output_path = await loop.run_in_executor( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Modly\resources\python-embed\Lib\concurrent\futures\thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Modly\resources\api\routers\generation.py", line 155, in <lambda> lambda: gen.generate(image_bytes, params, progress_cb, cancel_event) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Modly\resources\api\services\extension_process.py", line 232, in generate raise RuntimeError(msg.get("traceback") or msg.get("message", "Unknown error")) RuntimeError: Traceback (most recent call last): File "C:\Program Files\Modly\resources\api\runner.py", line 160, in main output_path = gen.generate(image_bytes, params, progress_cb, cancel_evt) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 680, in generate return self._run_generate(image_bytes, params, progress_cb, cancel_event) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 724, in _run_generate mesh_with_voxel = self._model.run( ^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 1369, in run out_mesh = self.decode_latent(shape_slat, None, res, use_tiled=use_tiled) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 1024, in decode_latent meshes, subs = self.decode_shape_slat(shape_slat, resolution, use_tiled=use_tiled) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 886, in decode_shape_slat ret = self.models['shape_slat_decoder'](slat, return_subs=True, useTiled=use_tiled) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\models\sc_vaes\fdg_vae.py", line 126, in forward mesh = [Mesh(*tiled_flexible_dual_grid_to_mesh( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\models\sc_vaes\fdg_vae.py", line 126, in <listcomp> mesh = [Mesh(*tiled_flexible_dual_grid_to_mesh( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\o_voxel\convert\__init__.py", line 25, in tiled_flexible_dual_grid_to_mesh pbar = tqdm(total=len(x_range)*len(y_range)*len(z_range), desc="Fast Tiled Decoding") ^^^^ NameError: name 'tqdm' is not defined
Metadata
Metadata
Assignees
Labels
Projects
- StatusShow more project fieldsDone
Activity
Lorchie commentedon May 26, 2026
We are working in Trellis2 GGUF.
What are the components of the computer, the operating system...?
audiblemaple commentedon May 27, 2026
Its an Asus laptop running:
OS is Windows 11
CPU: Ryzen 5 some 16 core one I dont remmember
GPU: RTX 3060 mobile
RAM: 16GB
All drivers are installed, I first compiled Modly from sources and then when it did not work deleted and installed the release executable which also did not work.
Lorchie commentedon May 28, 2026
Hi @audiblemaple ,
This should be fixed in the latest version of the Trellis2 GGUF extension. The tqdm import was missing in the patched o_voxel/convert/init.py for installs
where the function was already injected by a previous setup run.
Could you try the Repair action on the extension? This will re-run setup.py, which now detects the "function present but tqdm missing" case and prepends the import
automatically (fix in commit c0cbfe9).
Let us know if the error persists after the repair.
audiblemaple commentedon May 29, 2026
Hi @Lorchie
I Redownload the Trellis GGUF with the Fix.
However, Now the generation fails before I could ge to the tqdm part that was failing before, with tensor sizes mismatch errors, see log:
Error: Traceback (most recent call last):
File "C:\Program Files\Modly\resources\api\routers\generation.py", line 170, in _run_generation
output_path = await loop.run_in_executor(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Modly\resources\python-embed\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Modly\resources\api\routers\generation.py", line 172, in
lambda: gen.generate(image_bytes, params, progress_cb, cancel_event)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\Modly\resources\api\services\extension_process.py", line 240, in generate
raise RuntimeError(msg.get("traceback") or msg.get("message", "Unknown error"))
RuntimeError: Traceback (most recent call last):
File "C:\Program Files\Modly\resources\api\runner.py", line 160, in main
output_path = gen.generate(image_bytes, params, progress_cb, cancel_evt)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 680, in generate
return self._run_generate(image_bytes, params, progress_cb, cancel_event)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 724, in _run_generate
mesh_with_voxel = self.model.run(
^^^^^^^^^^^^^^^^
File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 1643, in run
self.load_sparse_structure_model()
File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 727, in load_sparse_structure_model
self.models['sparse_structure_flow_model'] = models.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\models_init.py", line 353, in from_pretrained
model.load_state_dict(sd, strict=False)
File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\nn\modules\module.py", line 2593, in load_state_dict
raise RuntimeError(
RuntimeError: Error(s) in loading state_dict for SparseStructureFlowModel:
While copying the parameter named "blocks.0.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.0.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.0.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.0.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.0.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.0.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.0.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.1.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.1.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.1.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.1.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.1.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.1.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.1.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.2.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.2.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.2.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.2.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.2.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.2.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.2.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.3.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.3.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.3.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.3.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.3.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.3.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.3.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.4.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.4.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.4.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.4.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.4.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.4.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.4.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.5.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.5.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.5.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.5.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.5.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.5.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.5.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.6.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.6.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.6.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.6.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.6.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.6.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.6.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.7.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.7.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.7.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.7.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.7.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.7.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.7.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.8.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.8.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.8.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.8.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.8.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.8.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.8.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.9.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.9.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.9.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.9.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.9.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.9.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.9.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.10.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.10.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.10.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.10.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.10.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.10.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.10.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.11.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.11.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.11.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.11.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.11.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.11.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.11.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.12.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.12.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.12.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.12.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.12.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.12.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.12.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.13.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.13.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.13.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.13.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.13.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.13.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.13.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.14.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.14.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.14.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.14.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.14.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.14.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.14.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.15.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.15.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.15.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.15.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.15.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.15.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.15.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.16.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.16.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.16.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.16.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.16.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.16.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.16.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.17.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.17.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.17.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.17.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.17.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.17.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.17.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.18.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.18.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.18.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.18.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.18.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.18.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.18.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.19.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.19.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.19.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.19.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.19.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.19.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.19.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.20.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.20.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.20.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.20.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.20.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.20.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.20.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.21.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.21.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.21.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.21.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.21.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.21.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.21.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.22.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.22.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.22.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.22.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.22.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.22.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.22.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.23.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.23.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.23.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.23.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.23.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.23.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.23.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.24.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.24.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.24.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.24.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.24.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.24.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.24.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.25.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.25.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.25.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.25.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.25.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.25.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.25.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.26.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.26.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.26.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.26.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.26.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.26.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.26.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.27.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.27.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.27.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.27.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.27.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.27.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.27.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.28.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.28.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.28.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.28.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.28.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.28.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.28.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
While copying the parameter named "blocks.29.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.29.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.29.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.29.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
While copying the parameter named "blocks.29.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.29.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
While copying the parameter named "blocks.29.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
Lorchie commentedon Jun 11, 2026
I create new version of trellis GGUF,
Can you uninstall and install the new version
Lorchie commentedon Jun 26, 2026
I's works ?
audiblemaple commentedon Jun 28, 2026
Hi,
Sorry for taking some time, I was preocupied with some other things.
It still does not work with the same error as before.
I will try redownloading everything from scratch in case there were some leftovers from previous versions of modly / extensions
Lorchie commentedon Oct 18, 2026
That error came from quantized GGUF weights being copied into a plain
nn.Linearwhen ComfyUI's GGUF ops were not importable. Fixed since 1.0.8: setup patches the standalone GGUF fallback layer and installs city96's GGUF ops wheretrellis2_gguflooks for them, on Windows and Linux. We re-ran a full generate + texture pass on 1.0.9 without the error. Please Repair or reinstall the extension; closing, feel free to reopen if it comes back.