RWKV元始智能是一家国产开源非Transformer架构大语言模型提供商,其产品兼具Transformer和RNN的优势:推理效率高且恒定,显存占用少且恒定,支持无限上下文,对芯片友好。RWKV(发音为RwaKuv)是一个具有出色LLM性能的RNN,也可以像GPT转换器一样直接训练(可并行化)。我们在RWKV7“Goose”。
它结合了RNN和transformer的优点太棒了性能、线性时间、恒定空间(无KV缓存)、快速训练、无限CTXLEN和自由文本嵌入。而且它是100无注意力的,以及Linux基金会AI项目。
Congratulations, submitted successfully!
Your edit is under review. You will be notified by email within 1 business day.
Submission failed.
Help others learn about this company, add my impression of this company»
Log in with the following accounts to save your follows