Describe the bug
Unable to start letta server in local setup . kindly assist on how to setup letta in local workstation . I followed the steps in https://www.youtube.com/watch?v=EOkpFDBNyEw as well but still got into below issue .
Please describe your setup
- How did you install letta?
pip install letta
- Describe your setup
- What’s your OS (Windows/MacOS/Linux)? Windows
- How are you running
letta? (cmd.exe/Powershell/Anaconda Shell/Terminal) cmd.exe
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
python version
Python 3.10.6
(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta version
0.1.14
encountered same issue in 0.1.16 version as well while trying to follow the setup posted in this video https://www.youtube.com/watch?v=EOkpFDBNyEw
(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta quickstart
(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta configure
(.venv) C:\Users\user\Documents\tutorial\agents\memgpt>letta run
all above 3 commands return below error
Traceback (most recent call last):
File “C:\Users\user\AppData\Local\Programs\Python\Python310\lib\runpy.py”, line 196, in _run_module_as_main
return _run_code(code, main_globals, None,
File “C:\Users\user\AppData\Local\Programs\Python\Python310\lib\runpy.py”, line 86, in run_code
exec(code, run_globals)
File "C:\Users\user\Documents\tutorial\agents\memgpt.venv\Scripts\letta.exe_main.py", line 7, in
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\main.py”, line 328, in call
raise e
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\main.py”, line 311, in call
return get_command(self)(*args, **kwargs)
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py”, line 1161, in call
return self.main(*args, **kwargs)
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\core.py”, line 783, in main
return _main(
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\core.py”, line 225, in _main
rv = self.invoke(ctx)
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py”, line 1697, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py”, line 1443, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\click\core.py”, line 788, in invoke
return __callback(*args, **kwargs)
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\typer\main.py”, line 683, in wrapper
return callback(**use_params) # type: ignore
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\letta\cli\cli.py”, line 178, in quickstart
new_config, config_was_modified = set_config_with_dict(backup_config)
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\letta\cli\cli.py”, line 63, in set_config_with_dict
old_config = LettaConfig.load()
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\letta\config.py”, line 165, in load
llm_config = LLMConfig(**llm_config_dict)
File “C:\Users\user\Documents\tutorial\agents\memgpt.venv\lib\site-packages\pydantic\main.py”, line 212, in init
validated_self = self.pydantic_validator.validate_python(data, self_instance=self)
pydantic_core._pydantic_core.ValidationError: 4 validation errors for LLMConfig
model
Field required [type=missing, input_value={}, input_type=dict]
For further information visit Redirecting...
model_endpoint_type
Field required [type=missing, input_value={}, input_type=dict]
For further information visit Redirecting...
model_endpoint
Field required [type=missing, input_value={}, input_type=dict]
For further information visit Redirecting...
context_window
Field required [type=missing, input_value={}, input_type=dict]
For further information visit Redirecting...
Letta Config
Please attach your ~/.letta/config file or copy paste it below.
There is no documentation steps on how to to setup letta/config
letta quickstart
letta run
letta configure
all return the same error .
If you’re not using OpenAI, please provide additional information on your local LLM setup:
I am using Azure OpenAI and have setup the environmental variables
AZURE_API_KEY=“…”
AZURE_BASE_URL=“…”
AZURE_API_VERSION=“…”
Local LLM details
If you are trying to run Letta with local LLMs, please provide the following information:
- The exact model you’re trying to use (e.g.
dolphin-2.1-mistral-7b.Q6_K.gguf) - The local LLM backend you are using (web UI? LM Studio?)
- Your hardware for the local LLM backend (local computer? operating system? remote RunPod?)