# An open call to test OpenVLA

**URL:** <https://discuss.opensource.org/t/an-open-call-to-test-openvla/424>\
**Category:** Open Source AI\
**Tags:** process\
**Created:** [June 23, 2024, 9:34pm UTC](https://discuss.opensource.org/t/an-open-call-to-test-openvla/424 "2024-06-23T21:34:50Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![quaid](https://yyz1.discourse-cdn.com/flex011/user_avatar/discuss.opensource.org/quaid/32/277_2.png) [@quaid](https://discuss.opensource.org/u/quaid)\
**Post date:** [June 25, 2024, 8:16pm UTC](https://discuss.opensource.org/t/an-open-call-to-test-openvla/424/4 "2024-06-25T20:16:22Z")

</div>

I’m cool with that, I didn’t choose ‘sameness’ as an idea per se, and we clearly need a more precise criteria (even if it’s from an imprecise measurement.)

How about ‘‘functionally similar’’? Or ‘‘practically similar’’?

Would it be useful to innumerate some of the value being sought with an Open Data dataset into the proof?

Is this measurement inclusive of the ‘‘model vs model’’ matrix values, looking to keep QA benchmark values within a certain value of the original?

What else matters in a recreated/retrained-from-source model?

---

_[View the full topic](https://discuss.opensource.org/t/an-open-call-to-test-openvla/424)._
