fix some error , now can run on mac m2 with 64GB memory

[wacdev]

fix some error , now can run on mac m2 with 64GB memory

upgrade pytorch and compile model for speed up

[wacdev]

run screenshot as image above

[wacdev]

I change max_new_tokens=3000, max_length=20000 in demo.py

use image created by stable-diffusion

then On the basis of this picture, create a detailed, wonderful, fascinating novel story

Generate a story as below :

In a land far, far away, there was a young woman named Li who lived in a small village on the outskirts of the city. She was known for her beauty and grace, and many men in the village had asked for her hand in marriage. However, Li had always declined, saying that she was not ready to settle down.

One day, while Li was out walking near the river, she saw a man standing on the bridge. He was dressed in a white robe with gold embroidery and held a fan in his hand. As she approached, he turned to her and bowed deeply.

“Hello, miss,” he said in a smooth, melodious voice. “My name is Tao, and I am a traveler. I have been traveling for many years and have seen many beautiful sights, but none as lovely as you.”

Li blushed at the compliment and lowered her eyes. “Thank you, sir,” she said softly. “But I am just a simple village girl. There is nothing special about me.”

Tao chuckled. “Oh, but there is, miss. You have a kind heart and a gentle spirit, and those are qualities that are rare and precious. I have never met anyone like you before.”

Li looked up at him, surprised. “You have never met anyone like me?” she asked.

Tao smiled. “No, miss. You are unique and special, and I would like to get to know you better.”

Li hesitated for a moment, wondering if she should trust this stranger. But something about him seemed kind and sincere, and she found herself wanting to believe him.

“Very well,” she said finally. “I will allow you to get to know me better. But you must promise to be respectful and kind.”

Tao bowed again. “I promise, miss. I will do my best to make you happy.”

And with that, the two of them began a journey of discovery and love that would take them to the farthest corners of the earth and beyond.

---

use gpt4 transalted into chinese is :

用gpt4润色后如下

在一个遥远的土地上，有一个名叫丽的年轻女子，她居住在城市边缘的一个小村庄。她因美貌和优雅而闻名于世，村里许多男子都向她求婚。然而，丽总是婉拒他们，称自己还未准备好安定下来。

一天，丽在河边散步时，看到一名男子站在桥上。他身着白色镶金的长袍，手持一把折扇。当丽走近时，他转身向她鞠躬行礼。

“小姐好，”他用柔和悦耳的声音说道，“我叫涛，是一名行者。我游历多年，目睹过世间诸多美景，但都不及你的美丽动人。”

丽听到这番赞美，脸颊泛红，羞涩地低下了头。“谢谢您，先生，”她轻声说，“但我只是一个普通的乡村姑娘，没有什么特别之处。”

涛笑了笑。“哦，但是有的，小姐。你拥有一颗善良的心和温柔的气质，这样的品质实属罕见且珍贵。我从未遇见过像你这样的人。”

丽抬起头，惊讶地看着他。“您从未遇到过像我这样的人？”她问道。

涛微笑着说：“是的，小姐。你独一无二、与众不同，我希望能更多地了解你。”

丽犹豫了一会儿，不知道是否该信任这个陌生人。但他身上似乎有种善意和真诚，她情不自禁地想要相信他。

“好吧，”她最终说道，“我愿意让你更了解我。但你必须承诺尊重我，对我好。”

涛再次鞠躬。“我承诺，小姐。我会竭尽所能让你幸福。”

就这样，他们开始了一段探索与爱情的旅程，这段旅程将带他们到地球的最远角落，乃至更遥远的地方。

[wzrzt]

Followed your branch, and got a problem. Seems the code is using CPU and MPS at the same time. Thank you if you have any advice

RuntimeError: torch.cat(): all input tensors must be on the same device. Received cpu and mps:0

[JakedUp]

How to get past this on the M2?

ResolvePackageNotFound:

• cudatoolkit