Fix chat responses being cut off · f8f3f9a012 - heretic - Hermes VPS Git

Ty_Tech/heretic

Fix chat responses being cut off

This commit is contained in:

Philipp Emanuel Weidmann

2025-10-22 12:30:28 +05:30

parent 6359aa44bb

commit f8f3f9a012

1 changed files with 1 additions and 0 deletions

									
										src/heretic/model.py
									
		+1
		
												View File
												
					@@ -309,6 +309,7 @@ class Model:

					        outputs = self.model.generate(

					        outputs = self.model.generate(

					            **inputs,

					            **inputs,

					            streamer=streamer,

					            streamer=streamer,

					            max_new_tokens=4096,

					        )

					        )

					        return self.tokenizer.decode(

					        return self.tokenizer.decode(