Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fetch/retrieve new and improved licenses from external sources #41

Closed
pombredanne opened this issue Jul 29, 2015 · 2 comments
Closed

Fetch/retrieve new and improved licenses from external sources #41

pombredanne opened this issue Jul 29, 2015 · 2 comments

Comments

@pombredanne
Copy link
Member

SPDX, DejaCode and other would be a good start.
The goal would be to have a single purpose script to fetch, sync and update the ScanCode data

@pombredanne pombredanne changed the title Ftech/retrieve new and improved licenses from external sources Fetch/retrieve new and improved licenses from external sources Jul 29, 2015
@tdruez
Copy link
Contributor

tdruez commented Mar 1, 2016

@jdaguil here's the base to call the DejaCode API in with Requests.
You should be able to write a script to collect all license key based on the following:

import requests

api_url = 'https://enterprise.dejacode.com/api/v2/licenses/?format=json'
headers = {'Authorization': 'Token YOUR_API_KEY_HERE'}

response = requests.get(api_url, headers=headers)
response.json()

pombredanne added a commit that referenced this issue Feb 27, 2017
pombredanne added a commit that referenced this issue Feb 27, 2017
pombredanne added a commit that referenced this issue Feb 27, 2017
pombredanne added a commit that referenced this issue Feb 27, 2017
pombredanne added a commit that referenced this issue Feb 28, 2017
pombredanne added a commit that referenced this issue Feb 28, 2017
pombredanne added a commit that referenced this issue Feb 28, 2017
 * not deleting and deprecating licenses is eventually important for
   proper synchronization with external sources

Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Feb 28, 2017
pombredanne added a commit that referenced this issue Mar 1, 2017
pombredanne added a commit that referenced this issue Mar 1, 2017
pombredanne added a commit that referenced this issue Mar 1, 2017
 * not deleting and deprecating licenses is eventually important for
   proper synchronization with external sources

Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Mar 1, 2017
pombredanne added a commit that referenced this issue Mar 1, 2017
 * this is mostly a data update (as opposed to a license texts)
 * add new urls, fix names, categories and other inconsistencies
 * demote to RULE a few junk licenses
 * refine the License and Rule models to support
  * License copy and relocation
  * tagging a Rule if built from a License
  * relax validation of duplicated URLs

Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Mar 1, 2017
pombredanne added a commit that referenced this issue Mar 1, 2017
 * set to False by default.

Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Mar 1, 2017
pombredanne added a commit that referenced this issue Mar 2, 2017
 * the licenses contains extra metadata following the data update

Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Mar 2, 2017
pombredanne added a commit that referenced this issue Apr 19, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 25, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 25, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 25, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 25, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 25, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 25, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
pombredanne added a commit that referenced this issue Apr 27, 2018
 * this includes some name changes to align with SPDX

Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 27, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 30, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 30, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 30, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 30, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 30, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
pombredanne added a commit that referenced this issue Apr 30, 2018
Signed-off-by: Philippe Ombredanne <[email protected]>
@pombredanne
Copy link
Member Author

This is all done now. The etc/scripts/synclic.py script can sync with SPDX and DejaCode. More sync sources could be added as needed.

pombredanne pushed a commit that referenced this issue Jan 12, 2022
pombredanne pushed a commit that referenced this issue Jan 12, 2022
Fixed #41 - Handled encoding issue when generating ABOUT files
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants