Skip to content

[Issue] When generating a model using Trellis2 GGUF error cannot find tqdm appears v0.3.4 #129

Closed

Description

@audiblemaple

When generating a model with Trellis2 GGUF on version v0.3.4 the following error is displayed.
It seems like Trellis2 GGUF repository might have been updated but the fork was not.

Error: Traceback (most recent call last): File "C:\Program Files\Modly\resources\api\routers\generation.py", line 153, in _run_generation output_path = await loop.run_in_executor( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Modly\resources\python-embed\Lib\concurrent\futures\thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Modly\resources\api\routers\generation.py", line 155, in <lambda> lambda: gen.generate(image_bytes, params, progress_cb, cancel_event) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\Modly\resources\api\services\extension_process.py", line 232, in generate raise RuntimeError(msg.get("traceback") or msg.get("message", "Unknown error")) RuntimeError: Traceback (most recent call last): File "C:\Program Files\Modly\resources\api\runner.py", line 160, in main output_path = gen.generate(image_bytes, params, progress_cb, cancel_evt) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 680, in generate return self._run_generate(image_bytes, params, progress_cb, cancel_event) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 724, in _run_generate mesh_with_voxel = self._model.run( ^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 1369, in run out_mesh = self.decode_latent(shape_slat, None, res, use_tiled=use_tiled) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 1024, in decode_latent meshes, subs = self.decode_shape_slat(shape_slat, resolution, use_tiled=use_tiled) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 886, in decode_shape_slat ret = self.models['shape_slat_decoder'](slat, return_subs=True, useTiled=use_tiled) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\nn\modules\module.py", line 1751, in _wrapped_call_impl return self._call_impl(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\nn\modules\module.py", line 1762, in _call_impl return forward_call(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\models\sc_vaes\fdg_vae.py", line 126, in forward mesh = [Mesh(*tiled_flexible_dual_grid_to_mesh( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\models\sc_vaes\fdg_vae.py", line 126, in <listcomp> mesh = [Mesh(*tiled_flexible_dual_grid_to_mesh( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\o_voxel\convert\__init__.py", line 25, in tiled_flexible_dual_grid_to_mesh pbar = tqdm(total=len(x_range)*len(y_range)*len(z_range), desc="Fast Tiled Decoding") ^^^^ NameError: name 'tqdm' is not defined

Activity

  1. Lorchie commented on May 26, 2026

    @Lorchie
    Collaborator

    We are working in Trellis2 GGUF.
    What are the components of the computer, the operating system...?

  2. audiblemaple commented on May 27, 2026

    @audiblemaple
    Author

    Its an Asus laptop running:
    OS is Windows 11
    CPU: Ryzen 5 some 16 core one I dont remmember
    GPU: RTX 3060 mobile
    RAM: 16GB

    All drivers are installed, I first compiled Modly from sources and then when it did not work deleted and installed the release executable which also did not work.

  3. Lorchie commented on May 28, 2026

    @Lorchie
    Collaborator

    Hi @audiblemaple ,

    This should be fixed in the latest version of the Trellis2 GGUF extension. The tqdm import was missing in the patched o_voxel/convert/init.py for installs
    where the function was already injected by a previous setup run.

    Could you try the Repair action on the extension? This will re-run setup.py, which now detects the "function present but tqdm missing" case and prepends the import
    automatically (fix in commit c0cbfe9).

    Let us know if the error persists after the repair.

  4. audiblemaple commented on May 29, 2026

    @audiblemaple
    Author

    Hi @Lorchie
    I Redownload the Trellis GGUF with the Fix.
    However, Now the generation fails before I could ge to the tqdm part that was failing before, with tensor sizes mismatch errors, see log:

    Error: Traceback (most recent call last):
    File "C:\Program Files\Modly\resources\api\routers\generation.py", line 170, in _run_generation
    output_path = await loop.run_in_executor(
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "C:\Program Files\Modly\resources\python-embed\Lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "C:\Program Files\Modly\resources\api\routers\generation.py", line 172, in
    lambda: gen.generate(image_bytes, params, progress_cb, cancel_event)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "C:\Program Files\Modly\resources\api\services\extension_process.py", line 240, in generate
    raise RuntimeError(msg.get("traceback") or msg.get("message", "Unknown error"))
    RuntimeError: Traceback (most recent call last):
    File "C:\Program Files\Modly\resources\api\runner.py", line 160, in main
    output_path = gen.generate(image_bytes, params, progress_cb, cancel_evt)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 680, in generate
    return self._run_generate(image_bytes, params, progress_cb, cancel_event)
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "C:\Users\audib\Documents\Modly\extensions\trellis2\generator.py", line 724, in _run_generate
    mesh_with_voxel = self.model.run(
    ^^^^^^^^^^^^^^^^
    File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
    ^^^^^^^^^^^^^^^^^^^^^
    File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 1643, in run
    self.load_sparse_structure_model()
    File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\pipelines\trellis2_image_to_3d.py", line 727, in load_sparse_structure_model
    self.models['sparse_structure_flow_model'] = models.from_pretrained(
    ^^^^^^^^^^^^^^^^^^^^^^^
    File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\trellis2_gguf\models_init
    .py", line 353, in from_pretrained
    model.load_state_dict(sd, strict=False)
    File "C:\Users\audib\Documents\Modly\extensions\trellis2\venv\Lib\site-packages\torch\nn\modules\module.py", line 2593, in load_state_dict
    raise RuntimeError(
    RuntimeError: Error(s) in loading state_dict for SparseStructureFlowModel:
    While copying the parameter named "blocks.0.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.0.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.0.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.0.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.0.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.0.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.0.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.1.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.1.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.1.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.1.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.1.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.1.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.1.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.2.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.2.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.2.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.2.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.2.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.2.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.2.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.3.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.3.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.3.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.3.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.3.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.3.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.3.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.4.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.4.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.4.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.4.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.4.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.4.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.4.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.5.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.5.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.5.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.5.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.5.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.5.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.5.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.6.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.6.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.6.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.6.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.6.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.6.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.6.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.7.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.7.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.7.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.7.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.7.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.7.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.7.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.8.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.8.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.8.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.8.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.8.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.8.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.8.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.9.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.9.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.9.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.9.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.9.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.9.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.9.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.10.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.10.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.10.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.10.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.10.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.10.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.10.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.11.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.11.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.11.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.11.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.11.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.11.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.11.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.12.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.12.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.12.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.12.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.12.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.12.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.12.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.13.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.13.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.13.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.13.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.13.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.13.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.13.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.14.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.14.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.14.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.14.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.14.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.14.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.14.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.15.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.15.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.15.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.15.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.15.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.15.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.15.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.16.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.16.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.16.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.16.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.16.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.16.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.16.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.17.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.17.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.17.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.17.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.17.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.17.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.17.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.18.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.18.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.18.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.18.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.18.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.18.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.18.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.19.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.19.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.19.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.19.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.19.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.19.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.19.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.20.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.20.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.20.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.20.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.20.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.20.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.20.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.21.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.21.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.21.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.21.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.21.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.21.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.21.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.22.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.22.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.22.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.22.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.22.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.22.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.22.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.23.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.23.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.23.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.23.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.23.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.23.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.23.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.24.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.24.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.24.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.24.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.24.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.24.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.24.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.25.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.25.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.25.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.25.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.25.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.25.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.25.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.26.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.26.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.26.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.26.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.26.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.26.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.26.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.27.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.27.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.27.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.27.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.27.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.27.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.27.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.28.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.28.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.28.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.28.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.28.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.28.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.28.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).
    While copying the parameter named "blocks.29.self_attn.to_qkv.weight", whose dimensions in the model are torch.Size([4608, 1536]) and whose dimensions in the checkpoint are torch.Size([4608, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.29.self_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.29.cross_attn.to_q.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.29.cross_attn.to_kv.weight", whose dimensions in the model are torch.Size([3072, 1024]) and whose dimensions in the checkpoint are torch.Size([3072, 1024]), an exception occurred : ('The size of tensor a (1024) must match the size of tensor b (576) at non-singleton dimension 1',).
    While copying the parameter named "blocks.29.cross_attn.to_out.weight", whose dimensions in the model are torch.Size([1536, 1536]) and whose dimensions in the checkpoint are torch.Size([1536, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.29.mlp.mlp.0.weight", whose dimensions in the model are torch.Size([8192, 1536]) and whose dimensions in the checkpoint are torch.Size([8192, 1536]), an exception occurred : ('The size of tensor a (1536) must match the size of tensor b (864) at non-singleton dimension 1',).
    While copying the parameter named "blocks.29.mlp.mlp.2.weight", whose dimensions in the model are torch.Size([1536, 8192]) and whose dimensions in the checkpoint are torch.Size([1536, 8192]), an exception occurred : ('The size of tensor a (8192) must match the size of tensor b (4608) at non-singleton dimension 1',).

  5. Lorchie commented on Jun 11, 2026

    @Lorchie
    Collaborator

    I create new version of trellis GGUF,
    Can you uninstall and install the new version

  6. Lorchie commented on Jun 26, 2026

    @Lorchie
    Collaborator

    I's works ?

  7. audiblemaple commented on Jun 28, 2026

    @audiblemaple
    Author

    Hi,
    Sorry for taking some time, I was preocupied with some other things.
    It still does not work with the same error as before.

    I will try redownloading everything from scratch in case there were some leftovers from previous versions of modly / extensions

  8. Lorchie commented on Oct 18, 2026

    @Lorchie
    Collaborator

    That error came from quantized GGUF weights being copied into a plain nn.Linear when ComfyUI's GGUF ops were not importable. Fixed since 1.0.8: setup patches the standalone GGUF fallback layer and installs city96's GGUF ops where trellis2_gguf looks for them, on Windows and Linux. We re-ran a full generate + texture pass on 1.0.9 without the error. Please Repair or reinstall the extension; closing, feel free to reopen if it comes back.

  9. moved this from Backlog to Done in Modly Boardon Oct 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions