← Back to context

Comment by gdzie-jest-sol

13 hours ago

* How creating dataset? I download it but it is commpresed in binary format.

* How training. In cloud or in my own dev

* How creating a gguf

3 comments

gdzie-jest-sol

Reply
gdzie-jest-sol  13 hours ago

``` uv run python -m guppylm chat

Traceback (most recent call last):

  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/user/gupik/guppylm/guppylm/__main__.py", line 48, in <module>
    main()
  File "/home/user/gupik/guppylm/guppylm/__main__.py", line 29, in main
    engine = GuppyInference("checkpoints/best_model.pt", "data/tokenizer.json")
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/gupik/guppylm/guppylm/inference.py", line 17, in __init__
    self.tokenizer = Tokenizer.from_file(tokenizer_path)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

Exception: No such file or directory (os error 2) ```

  • gdzie-jest-sol  12 hours ago

    meybe add training again (read best od fine) and train again

    ``` # after config device checkpoint_path = "checkpoints/best_model.pt"

    ckpt = torch.load(checkpoint_path, map_location=device, weights_only=False)

    model = GuppyLM(mc).to(device) if "model_state_dict" in ckpt: model.load_state_dict(ckpt["model_state_dict"]) else: model.load_state_dict(ckpt)

    start_step = ckpt.get("step", 0) print(f"Encore {start_step}") ```