Originally published at: https://opensource.org/blog/explaining-the-concept-of-data-information This post clarifies how the draft Open Source AI Definition arrived at its current state, the design principles behind the Data information concept and the constraints (legal and technical) it operate…

[image] Senficon: However, they only allow the reproduction of copyright-protected works (aka copying), but not the making available of those works (aka posting them on the Internet). This is an important point. Even in Japan, which is considered one of the most lenient countries regarding ma…

@shujisado , if you were presented with evidence that it is trivial to extract training data from weights, would that change your perspective? That is, for many models, distributing weights is functionally equivalent to distributing the training data.

Can I get a citation on that? One of the papers I read earlier this year suggested that LLMs memorized I think it was 1-2% of their training data; certainly less than 10%, and talked about how much data could be extracted. The conclusions appeared to be that there definitely was a significant fracti…

From a normative or legal perspective, why does it matter what the % is? Can I violate the AGPL if it’s just a small % of Ghostscript? Knowingly distributing or providing access to a model that generates infringes on 10% of millions of documents is still a pretty material risk surface. Techn…

A concern I have about “data information” is how is it going to be assessed? Is this something we’ll be able to evaluate short of actually trying to recreate the AI system in question?

FYI, even when setting software RNG seeds, disabling any probabilistic hardware featuresets, and fixing all software/driver versions, it is practically impossible to produce the same trained model unless you have access to the exact same hardware environment in very simple setup (e.g., single-node, …

[image] mjbommar: if you were presented with evidence that it is trivial to extract training data from weights, would that change your perspective? In a typical AI model, weights are the result of computations. I am discussing under the assumption that the same intellectual property rights th…

The command line below also creates a “weight” file that is the result of compution. $ gzip linux/fs/ext4/acl.c Do you think GPL-2.0 does not apply to the acl.c.gz version?

[image] mjbommar: Provable “sameness” is probably something to altogether avoid… We should be able to feel confident that “a skilled person can recreate a substantially equivalent system using the same or similar data” isn’t an empty promise.

Thank you. I found this explanation to be extremely valuable and is helping to inform my opinion on this hot topic in the context of the OSAID.

OSI Discuss

Explaining the concept of Data information

Open Source AI

show post in topic

Home
Categories
Guidelines
Terms of Service
Privacy Policy

Powered by Discourse, best viewed with JavaScript enabled