Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAG extract almost finished. but ollama terminal continues gives out "context limit hit - shifting" #104

Open
pecanjk opened this issue Dec 6, 2024 · 2 comments

Comments

@pecanjk
Copy link

pecanjk commented Dec 6, 2024

max_workers = 2 small enough. This happened when KAG extract almost finished. any reason?

[GIN] 2024/12/06 - 11:14:13 | 200 | 6.541379667s | 127.0.0.1 | POST "/api/generate"
time=2024-12-06T11:14:13.537+08:00 level=DEBUG source=sched.go:407 msg="context for request finished"
time=2024-12-06T11:14:13.537+08:00 level=DEBUG source=sched.go:357 msg="after processing request finished event" modelPath=/home/xxx/.ollama/models/blobs/sha256-dde5aa3fc5ffc17176b5e8bdc82f587b24b2678c6c66101bf7da77af9f7ccdff refCount=1
time=2024-12-06T11:14:17.197+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021
time=2024-12-06T11:14:26.496+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021
time=2024-12-06T11:14:35.197+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021
time=2024-12-06T11:14:44.229+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021
time=2024-12-06T11:14:52.911+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021
time=2024-12-06T11:15:01.782+08:00 level=DEBUG source=cache.go:221 msg="context limit hit - shifting" id=0 limit=2048 input=2048 keep=5 discard=1021

@pecanjk
Copy link
Author

pecanjk commented Dec 6, 2024

and then the process is stuck

Processing KAGExtractor: 96%|█████████▋| 53/55 [19:30<00:56, 28.25s/it]INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK"
INFO:httpx:HTTP Request: POST http://localhost:11434/api/generate "HTTP/1.1 200 OK"

Processing KAGExtractor: 98%|█████████▊| 54/55 [20:03<00:29, 29.73s/it]

no more output from terminal

@thundax-lyp
Copy link
Contributor

需要增加ollama上下文窗口长度,建议先用在线接口做测试,现有的做KGExtractor的系统,提示词长度往往超过8K

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants