Skip to content
This repository has been archived by the owner on Jul 18, 2024. It is now read-only.

[DataCap Application]FilSwan Multi-chain Storage Product #278

Closed
yoogakim opened this issue Mar 4, 2022 · 81 comments
Closed

[DataCap Application]FilSwan Multi-chain Storage Product #278

yoogakim opened this issue Mar 4, 2022 · 81 comments

Comments

@yoogakim
Copy link

yoogakim commented Mar 4, 2022

Large Dataset Notary Application

To apply for DataCap to onboard your dataset to Filecoin, please fill out the following.

Core Information

  • Organization Name: FilSwan

  • Website / Social Media: https://mcs.filswan.com

  • Total amount of DataCap being requested (between 500 TiB and 5 PiB): 5PiB

  • Weekly allocation of DataCap requested (usually between 1-100TiB): 100TiB

  • On-chain address for first allocation:f1o54sve7ede7im4caux3ug7lsyjmbue7ss3zzl6y

Project details

Share a brief history of your project and organization.

Filswan provides a decentralized edge infrastructure marketplace and software that moves data and processing as close as necessary on Web 3.0. FilSwan multi-chain storage solution gates log files, artifacts, backups, container images, photos and videos on the FIlecoin Network. 
FilSwan Multi-chain storage is a cutting-edge blockchain storage solution providing a data cache and presidency layer for your important files. The smart contract-based multi-chain storage gateway is integrated with oracle technology.  
You will get an IPFS link with a long-term CID for your website's daily usage and benefit from the long-term storage network provided by Filecoin.  
With Filswan multi-chain storage solution, users can: 
*Upload files to the IPFS/Filecoin network  
*Pay with stable coins  
*Swap major cryptocurrencies to Fil Token via the Polygon network at a low cost 
*Mint NFTs on OpenSea while storing data on the IPFS/Filecoin network 

What is the primary source of funding for this project?

FilSwan, Filecoin Foundation's dev grant, Chainlink-FIlecoin joint grant 

What other projects/ecosystem stakeholders is this project associated with?

Polygon with storage providers cross continents.  

Use-case details

Describe the data being stored onto Filecoin

log files, artifacts, backups, container images, photos and videos  

Where was the data in this dataset sourced from?

Users’ data, uploaded by the users. 

Can you share a sample of the data? A link to a file, an image, a table, etc., are good ways to do this.

https://calibration-ipfs.filswan.com/ipfs/QmcZsKyYkxTUWqG2ogbrZTjDK7za8sQ2TgboZD6V9sK4pf

Confirm that this is a public dataset that can be retrieved by anyone on the Network (i.e., no specific permissions or access rights are required to view the data).

yes

What is the expected retrieval frequency for this data?

It should be no more than a weekly base.

For how long do you plan to keep this dataset stored on Filecoin?

540 days, it should be a permanent as soon as the client willing to expend it. 

DataCap allocation plan

In which geographies (countries, regions) do you plan on making storage deals?

All continents.

How will you be distributing your data to storage providers? Is there an offline data transfer process?

We will distribute to storage providers using offline deals 

How do you plan on choosing the storage providers with whom you will be making deals? This should include a plan to ensure the data is retrievable in the future both by you and others.

We use the Filswans auto-bid system, users need to submit their requests, and the system will match storage providers and users automatically. We also build an api for providers to download the dataset query the dataset name, and retrieval via miner id and cid. 

How will you be distributing deals across storage providers?

We are using FilSwan client agent for batch sending deals.  https://github.com/filswan/swan-client

Do you have the resources/funding to start making deals as soon as you receive DataCap? What support from the community would help you onboard onto Filecoin?

Yes. Funding & marketing support from the community.
@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@yoogakim yoogakim changed the title [DataCap Application]FilSwan Multi-chain Service Product [DataCap Application]FilSwan Multi-chain Storage Product Mar 4, 2022
@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@large-datacap-requests
Copy link

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

@large-datacap-requests
Copy link

Thanks for your request!
❗ We have found some problems in the information provided.
We could not find your Filecoin address in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.

@large-datacap-requests
Copy link

Thanks for your request!
❗ We have found some problems in the information provided.
We could not find your Filecoin address in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.

@large-datacap-requests
Copy link

Thanks for your request!
❗ We have found some problems in the information provided.
We could not find your Filecoin address in the information provided

Please, take a look at the request and edit the body of the issue providing all the required information.

@filplus-checker
Copy link

DataCap and CID Checker Report1

  • Organization: FilSwan
  • Client: f1o54sve7ede7im4caux3ug7lsyjmbue7ss3zzl6y

Storage Provider Distribution

The below table shows the distribution of storage providers that have stored data for this client.

If this is the first time a provider takes verified deal, it will be marked as new.

For most of the datacap application, below restrictions should apply.

  • Storage provider should not exceed 25% of total datacap.
  • Storage provider should not be storing duplicate data for more than 20%.
  • Storage provider should have published its public IP address.
  • All storage providers should be located in different regions.

⚠️ 36.60% of total deal sealed by f01947280 are duplicate data.

⚠️ 45.68% of total deal sealed by f01146045 are duplicate data.

⚠️ 55.19% of total deal sealed by f01713152 are duplicate data.

⚠️ 64.68% of total deal sealed by f01876488 are duplicate data.

⚠️ 50.49% of total deal sealed by f079426 are duplicate data.

⚠️ 48.79% of total deal sealed by f01953944 are duplicate data.

⚠️ 23.87% of total deal sealed by f01940076 are duplicate data.

⚠️ f01911369 has unknown IP location.

⚠️ 63.52% of total deal sealed by f0111584 are duplicate data.

⚠️ f01919426 has unknown IP location.

⚠️ f01981571 has unknown IP location.

⚠️ f0520660 has unknown IP location.

⚠️ 20.32% of total deal sealed by f0836160 are duplicate data.

⚠️ 32.38% of total deal sealed by f0697249 are duplicate data.

⚠️ 94.57% of total deal sealed by f01862564 are duplicate data.

⚠️ 33.33% of total deal sealed by f01443744 are duplicate data.

⚠️ 50.00% of total deal sealed by f02401 are duplicate data.

⚠️ 75.00% of total deal sealed by f01915033 are duplicate data.

⚠️ 75.00% of total deal sealed by f0408717 are duplicate data.

⚠️ 49.90% of total deal sealed by f01708981 are duplicate data.

Provider Location Total Deals Sealed Percentage Unique Data Duplicate Deals
f01947280 Hangzhou, Zhejiang, CN 451.28 TiB 14.09% 286.09 TiB 36.60%
f01938223 Montréal, Quebec, CA 399.77 TiB 12.48% 387.25 TiB 3.13%
f01146045new Singapore, Singapore, SG 325.59 TiB 10.17% 176.88 TiB 45.68%
f01955028new Hangzhou, Zhejiang, CN 317.95 TiB 9.93% 275.70 TiB 13.29%
f01955034 Hangzhou, Zhejiang, CN 274.25 TiB 8.56% 260.09 TiB 5.16%
f01955030 Hangzhou, Zhejiang, CN 226.31 TiB 7.07% 199.44 TiB 11.88%
f01786736 Saint-Gabriel, Quebec, CA 196.63 TiB 6.14% 191.94 TiB 2.38%
f01713152new Jakarta, Jakarta, ID 188.56 TiB 5.89% 84.50 TiB 55.19%
f01876488new Ho Chi Minh City, Ho Chi Minh, VN 165.97 TiB 5.18% 58.63 TiB 64.68%
f079426 Singapore, Singapore, SG 151.98 TiB 4.75% 75.25 TiB 50.49%
f01953944 Singapore, Singapore, SG 130.09 TiB 4.06% 66.63 TiB 48.79%
f01940076 Hong Kong, Central and Western, HK 112.47 TiB 3.51% 85.63 TiB 23.87%
f01911369 Unknown 52.97 TiB 1.65% 49.56 TiB 6.43%
f0111584new Tokyo, Tokyo, JP 51.31 TiB 1.60% 18.72 TiB 63.52%
f01919426 Unknown 39.41 TiB 1.23% 38.88 TiB 1.35%
f0240456 Chengdu, Sichuan, CN 22.74 TiB 0.71% 22.72 TiB 0.10%
f01981571 Unknown 8.41 TiB 0.26% 8.41 TiB 0.00%
f01886797 Vancouver, British Columbia, CA 7.45 TiB 0.23% 7.15 TiB 4.04%
f01402814 Singapore, Singapore, SG 7.26 TiB 0.23% 6.96 TiB 4.09%
f01858429 Boston, Massachusetts, US 7.03 TiB 0.22% 6.83 TiB 2.89%
f01072221 Los Angeles, California, US 6.39 TiB 0.20% 6.34 TiB 0.80%
f0187709 Moscow, Moscow, RU 5.80 TiB 0.18% 5.29 TiB 8.75%
f01222595 Moscow, Moscow, RU 5.14 TiB 0.16% 4.90 TiB 4.56%
f01896422 Fremont, California, US 5.10 TiB 0.16% 5.05 TiB 1.00%
f01970622 Hong Kong, Central and Western, HK 4.59 TiB 0.14% 4.59 TiB 0.00%
f03624 Nürnberg, Bavaria, DE 4.56 TiB 0.14% 4.56 TiB 0.00%
f010088 Everett, Washington, US 4.41 TiB 0.14% 3.89 TiB 11.79%
f01225882 Burnaby, British Columbia, CA 3.72 TiB 0.12% 3.72 TiB 0.00%
f0447183 Indianapolis, Indiana, US 3.13 TiB 0.10% 3.13 TiB 0.00%
f047419 North Prairie, Wisconsin, US 2.91 TiB 0.09% 2.91 TiB 0.00%
f01163272 Perm, Perm Krai, RU 2.82 TiB 0.09% 2.61 TiB 7.48%
f01390330 Xi’an, Shaanxi, CN 1.97 TiB 0.06% 1.96 TiB 0.80%
f0717969 Los Angeles, California, US 1.67 TiB 0.05% 1.48 TiB 11.49%
f08399 Seattle, Washington, US 1.53 TiB 0.05% 1.53 TiB 0.00%
f01398391 Chengdu, Sichuan, CN 1.25 TiB 0.04% 1.25 TiB 0.00%
f01840390 Seoul, Seoul, KR 1.12 TiB 0.04% 1.07 TiB 4.18%
f0520660 Unknown 1.05 TiB 0.03% 964.00 GiB 10.74%
f0705704 Taipei, Taiwan, TW 960.00 GiB 0.03% 960.00 GiB 0.00%
f01859603 Shenzhen, Guangdong, CN 872.00 GiB 0.03% 872.00 GiB 0.00%
f01784458 Oslo, Oslo, NO 832.00 GiB 0.03% 832.00 GiB 0.00%
f0143858 Clifton, New Jersey, US 736.00 GiB 0.02% 736.00 GiB 0.00%
f01871352 Seoul, Seoul, KR 708.00 GiB 0.02% 672.00 GiB 5.08%
f0240185 Clifton, New Jersey, US 704.00 GiB 0.02% 704.00 GiB 0.00%
f0214334 Gwangju, Gwangju, KR 640.00 GiB 0.02% 640.00 GiB 0.00%
f08403 Bourton on the Water, England, GB 480.00 GiB 0.01% 480.00 GiB 0.00%
f01931631 Shenzhen, Guangdong, CN 480.00 GiB 0.01% 480.00 GiB 0.00%
f032824 Austin, Texas, US 400.00 GiB 0.01% 400.00 GiB 0.00%
f01870135 Gwangju, Gwangju, KR 320.00 GiB 0.01% 320.00 GiB 0.00%
f0836160 Seoul, Seoul, KR 315.00 GiB 0.01% 251.00 GiB 20.32%
f0697249 Beijing, Beijing, CN 247.05 GiB 0.01% 167.05 GiB 32.38%
f01862564 Xi’an, Shaanxi, CN 122.85 GiB 0.00% 6.68 GiB 94.57%
f01443744 Leipzig, Saxony, DE 84.00 GiB 0.00% 56.00 GiB 33.33%
f02401new Raleigh, North Carolina, US 64.00 GiB 0.00% 32.00 GiB 50.00%
f01915033 Chengdu, Sichuan, CN 16.00 GiB 0.00% 4.00 GiB 75.00%
f0408717 Ansan-si, Gyeonggi-do, KR 16.00 GiB 0.00% 4.00 GiB 75.00%
f01708981 Shenzhen, Guangdong, CN 8.02 GiB 0.00% 4.02 GiB 49.90%
f01211558 Wuhan, Hubei, CN 5.25 GiB 0.00% 5.25 GiB 0.00%

Provider Distribution

Deal Data Replication

The below table shows how each many unique data are replicated across storage providers.

  • No more than 25% of unique data are stored with less than 4 providers.

⚠️ 39.63% of deals are for data replicated across less than 4 storage providers.

Unique Data Size Total Deals Made Number of Providers Deal Percentage
274.05 TiB 289.98 TiB 1 9.06%
174.17 TiB 436.86 TiB 2 13.64%
114.15 TiB 542.36 TiB 3 16.94%
87.83 TiB 425.78 TiB 4 13.30%
72.08 TiB 491.19 TiB 5 15.34%
45.36 TiB 405.38 TiB 6 12.66%
36.09 TiB 393.13 TiB 7 12.28%
11.84 TiB 131.47 TiB 8 4.11%
3.66 TiB 42.34 TiB 9 1.32%
896.00 GiB 8.75 TiB 10 0.27%
576.00 GiB 6.19 TiB 11 0.19%
1.47 TiB 17.63 TiB 12 0.55%
576.00 GiB 7.31 TiB 13 0.23%
64.00 GiB 896.00 GiB 14 0.03%
4.00 GiB 3.17 TiB 22 0.10%

Replication Distribution

Deal Data Shared with other Clients

The below table shows how many unique data are shared with other clients.
Usually different applications owns different data and should not resolve to the same CID.

⚠️ CID sharing has been observed.

Other Client Application Total Deals Affected Unique CIDs Verifier
f1bstbq5bi72kyovhh7zoo2f6l6uivsjz4ey5dnqq FilSwan 1.53 PiB 15,860 LDN v3 multisig
f1r3d25hl2y7rqlsu2mgczdethy4qqjmkfdlmibfq NEXRAD - FilSwan 1.03 PiB 5,403 LDN v3 multisig
f13d6zt424jkp55u7kp67azotkzadtlokwnz2ntxa FilSwan - Slingshot Restore 815.42 TiB 7,433 LDN v3 multisig
f14r2jybmccwiu6hze4fu55jyhclktvwacec56hea FilSwan 421.77 TiB 8,323 LDN v3 multisig
f3wn64jznjqmr3s3qt4tfwynxo6k73wdxkhd6wo2l
4rwpjdyyddirah2ugfaibvlzz2asaj3ehsp7bwc2z
vnia
Jiaxing Yangtze Delta Region Blockchain Technology Research Institute 232.41 TiB 1,246 LDN v3 multisig
f1fkh47gdwclmovclfz2kvorhhdofvgr5y7fjvkmi BigData Exchange 175.00 TiB 1,246 LDN v3 multisig
f3rwypb3nhyzkslf6eb2qoiaqdwvaedcawxiav4hm
hi4cp4w7ptjua42knqoddbl5uabcrtzgq7jajvjro
z54a
dropcool - Slingshot Restore 90.66 TiB 2,710 LDN v3 multisig
f1eto4dfafkoeukxenoc7vzexrvf6i4yqvhszrq2y Haoqian Mx 59.16 TiB 384 LDN v3 multisig
f1j22hqwh5tijbaztl7a7plzk5q2s4cesd67nyv3a FilSwan 35.69 TiB 324 LDN v3 multisig
f3v7x4a2aapgx6o2r477tenoin3u5oadaeqyd7kjd
sitykvf4ok7vq2utcyh34lmu5u7oybs25ff6s4dbu
dpma
LeoCheung - Slingshot Restore 25.69 TiB 168 LDN v3 multisig
f13zfhkvtf6mewd74jhav6iqcggwsojht73tickga X-Order Lab 17.88 TiB 562 LDN v3 multisig
f1pkrmygbvweykpjcut36lf7ewgqdfhjklbhvepda Protocol Labs ( project: Slingshot Evergreen ) 8.00 TiB 97 LDN # 293
f3td7znsz2q6laexewfqogczo74xyiwgbysuf6i75
k2wrdqwzyvln7wvzmxaz3jvqzskwxqerdwaetdvue
jama
Unknown 928.00 GiB 27 Unknown
f3wzua4wihcouehv5datojpgalyapegvdfkhkqamx
dtr4tzcsn7kylkoaapmmxisbp3tzekgijb32lrswf
5t5q
Ninth Heaven Guild 800.00 GiB 25 Neo Ge
f1toz5izxdse43peqyd7zktmyqilvhf6u72z74gfq Starboard Networks 128.00 GiB 4 Steven Li
f13csteap4jcgl3a65qtsvmblzvelp4sgivddtpqa PiKNiK 128.00 GiB 4 LDN v3 multisig
f16akvy4mxvc35nxx4fsjnsflgp3yf5o5pghaufci Unknown 1.21 GiB 4 Unknown

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

@large-datacap-requests
Copy link

The issue reached the total datacap requested. This should be closed

@large-datacap-requests
Copy link

Stats & Info for DataCap Allocation

Multisig Notary address

f01858410

Client address

f1o54sve7ede7im4caux3ug7lsyjmbue7ss3zzl6y

Last two approvers

liyunzhi-666 & kernelogic

Rule to calculate the allocation request amount

total dc reached

DataCap allocation requested

0

Total DataCap granted for client so far

4.12PiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

900TiB

Stats

Number of deals Number of storage providers Previous DC Allocated Top provider Remaining DC
135954 64 370TiB 17.68 90.67TiB

@github-actions
Copy link

This application has not seen any responses in the last 10 days. This issue will be marked with Stale label and will be closed in 4 days. Comment if you want to keep this application open.

@github-actions github-actions bot added the Stale label Jul 21, 2023
@github-actions
Copy link

This application has not seen any responses in the last 14 days, so for now it is being closed. Please feel free to contact the Fil+ Gov team to re-open the application if it is still being processed. Thank you!

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jul 26, 2023

Client f01762699 does not follow the datacap usage rules. More info here.
This application has been failing the requirements for 7 days.
Please take appropiate action to fix the following DataCap usage problems.

Criteria Treshold Reason
Cid Checker score > 25% The client has a CID checker score of 4%. This should be greater than 25%. To find out more about CID checker score please look at this issue: filecoin-project/notary-governance#986
Shared data percent < 20% 60.43% of the clients data is shared with other clients. This should be less than 20%

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests