Training data access

[zack]

@lumin

@stefano

• What about AI systems where data is not available, like those trained with federated learning or other privacy-preserving data-sharing techniques?

1. Isn’t the “privacy-preserving” techniques contradictory to open-source at the first place? You might think it is safe to “open-source” a federated learning based on private face data, but I guarantee you there are lots of methods to dump private training data from the model, although not byte-to-byte equivalent.

I concur. More generally, it is entirely possible that there exist use cases / contexts where “open source AI” is just not a good fit. That is why we should not attempt to design our definition around every possible use cases, but rather make it descend from first principles (like the 4 freedoms). Which is what we are doing… except when we add to the debate arguments like “what about this specific context where we cannot open up data”.