Release v0.6.0

Release Notes

1. Support multi-modal RAG evaluation #149
   • Add CLIP_Benchmark
   • Add end-to-end multi-modal RAG evaluation in Ragas
2. To be compatible with Ragas v0.2.3 #165 #171
3. Support truncating input for CLIP models #163 #164
4. Support saving knowledge graphs when generating datasets in Ragas #175

Bug Fixes

1. Fix issue of abnormal metrics during CMTEB evaluation #157
2. Fix issue of GenerationConfig being None #173
3. Update datasets version constraints #184
4. Add publish workflow #186

Documentation Updates

1. Update VLMEvalKit documentation #166
2. Update multi-modal RAG blog #172

中文说明

特性

1. 添加多模态RAG评测支持 #149
   • 支持CLIP_Benchmark
   • 支持Ragas端到端多模态RAG评测
2. 兼容Ragas v0.2.3 #165 #171
3. 支持CLIP模型截断输入 #163 #164
4. 支持Ragas生成数据集时保存知识图谱 #175

缺陷修复

1. 修复CMTEB评估时指标异常的问题 #157
2. 修复GenerationConfig为None的异常 #173
3. 更新datasets版本限制 #184
4. 增加publish workflow #186

文档更新

1. 更新VLMEvalKit文档 #166
2. 更新多模态RAG博客 #172