[DataCap Application] NDLABS - Hyper.ai <4/4>

[NDLABS-Leo]

Data Owner Name

NDLABS

Data Owner Country/Region

Singapore

Data Owner Industry

IT & Technology Services

Website

https://www.ndlabs.io/#/

Social Media

Twitter： @imNDLABS
Slack： @NDLABS-OFFICE

Total amount of DataCap being requested

5PiB

Weekly allocation of DataCap requested

1PiB

On-chain address for first allocation

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

Custom multisig

• Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

ND LABS has technical operation centers and nodes in Singapore, Hong Kong, the United States, and Dubai. Since Fil has launch of the mainnet in 2020, ND has begun to provide technical services to partners to help them complete the construction of storage services. At present, the accumulated storage power of ND exceeds 300P globally. The largest node has 100P storage power, and the node owns exceeds more than 1.4 million FIL. 
ND LABS is positioned as a decentralized storage service provider for WEB3. For a long time, ND not only focuses on building nodes for partners, but also explores how to provide better storage services for potential clients of web3. Since October 2021, ND has been deeply involved in the FilPlus project, vigorously promoting the Filplus project to partners who has effective data storage needs. We also providing them with a complete set of solutions and technical services for storing data in the FIL network. The Singapore and US nodes are the main storage nodes, which was provide real data storage for early customers.

Is this project associated with other projects/ecosystem stakeholders?

Yes

If answered yes, what are the other projects/ecosystem stakeholders

We gonna cooperate with more SPs from other regions

Describe the data being stored onto Filecoin

https://hyper.ai/datasets is an open data web, which collects hundreds of datasets with a total capacity of 1.8P for public use.
Details of Datasets including:
Audi Autonomous Driving Dataset - 2.26T
BDD100K - 1.81T
BDDK - 1.8T
LSUN 20 Object Categories - 1.69T
Youtube 8M - 1.52T
WebVision1.0+2.0 - 1.26T
ApolloSpace - 1.19T
TrackingNet - 1.04T
...
FYI, to release the concern from community members of "one LDN combined smaller sets of data". 
When we prepare the data, different datasets will be tagged variously, to classify into our database. If we need to index later, we can quickly and easily find the file corresponding to the demand. In addition, we are also developing a browser to solve the "merged data"

Where was the data currently stored in this dataset sourced from

Other

If you answered "Other" in the previous question, enter the details here

https://hyper.ai/datasets

How do you plan to prepare the dataset

IPFS, lotus, singularity, graphsplit

If you answered "other/custom tool" in the previous question, enter the details here

No response

Please share a sample of the data

https://hyper.ai/datasets/15610
https://hyper.ai/datasets/11926
https://hyper.ai/datasets/5570
https://hyper.ai/datasets/5678
https://hyper.ai/datasets/5531
https://hyper.ai/datasets/16979
https://hyper.ai/datasets/5197
https://hyper.ai/datasets/16773
https://hyper.ai/datasets/8754
https://hyper.ai/datasets/4889
https://hyper.ai/datasets/17858
https://hyper.ai/datasets/16184
https://hyper.ai/datasets/5191
https://hyper.ai/datasets/5358
https://hyper.ai/datasets/9430

Confirm that this is a public dataset that can be retrieved by anyone on the Network

• I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America

How will you be distributing your data to storage providers

HTTP or FTP server, IPFS

How do you plan to choose storage providers

Slack, Big data exchange, Partners

If you answered "Others" in the previous question, what is the tool or platform you plan to use

No response

If you already have a list of storage providers to work with, fill out their names and provider IDs below

No response

How do you plan to make deals to your storage providers

Boost client, Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

[large-datacap-requests]

Thanks for your request!
Everything looks good. 👌

A Governance Team member will review the information provided and contact you back pretty soon.

[Sunnyiscoming]

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

1PiB

Client address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

[large-datacap-requests]

DataCap Allocation requested

Multisig Notary address

f02049625

Client address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

DataCap allocation requested

256TiB

Id

48f62c11-ead6-47dd-ba72-c43be262011e

[kernelogic]

I have checked https://hyper.ai/datasets and looks like it's very comprehensive for dataset indexing. Willing to support.

[kernelogic]

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacea6nkapbzzhxjaqthkavddbw2tpime6mwe2iese5hge6ofheiqapm

Address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

Datacap Allocated

256.00TiB

Signer Address

f1yjhnsoga2ccnepb7t3p3ov5fzom3syhsuinxexa

Id

48f62c11-ead6-47dd-ba72-c43be262011e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6nkapbzzhxjaqthkavddbw2tpime6mwe2iese5hge6ofheiqapm

[sxxfuture-official]

Base on the answer in #1720
and By checking the public big data set link provided, the information is true and reliable, and ND is not a new account, so I will support the project in this round.

[sxxfuture-official]

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceba5wx6xbto2ez7pzfplzcnqtsxwrgbl4kzzr76hhcagpu22dtogk

Address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

Datacap Allocated

256.00TiB

Signer Address

f1foiomqlmoshpuxm6aie4xysffqezkjnokgwcecq

Id

48f62c11-ead6-47dd-ba72-c43be262011e

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceba5wx6xbto2ez7pzfplzcnqtsxwrgbl4kzzr76hhcagpu22dtogk

[large-datacap-requests]

DataCap Allocation requested

Request number 5

Multisig Notary address

f02049625

Client address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

DataCap allocation requested

1.25PiB

Id

97ecd17a-9010-4f4e-97f4-ed5e6c2d3125

[large-datacap-requests]

Stats & Info for DataCap Allocation

Multisig Notary address

f02049625

Client address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

Rule to calculate the allocation request amount

400% weekly > 2PiB, requesting 2PiB

DataCap allocation requested

1.25PiB

Total DataCap granted for client so far

1.862645149230957e+37YiB

Datacap to be granted to reach the total amount requested by the client (5PiB)

1.862645149230957e+37YiB

Stats

Number of deals	Number of storage providers	Previous DC Allocated	Top provider	Remaining DC
97398	24	2PiB	22.71	526.40TiB

[NDLABS-Leo]

FYI, we are disclosing here for tracking by notaries.
We have located that the reason why ND and the SPs we cooperate with cannot be searched and sampled by Filplus RetrievalBot is that our code is not synchronized with the latest boost code, so the payloadCID (rootCID) cannot be retrieved. However, pieceCID can be retrieved, which can be seen in previous notaries' reviewing process.
ND and the SPs we cooperate with store 100% unseal files, from the beginning to the present. Our engineers are simultaneously modifying the code and updating the architecture, which is expected to be completed early this week. Looking forward to your understanding and signing. Thanks a lot.

[1ane-1]

Request Proposed

Your Datacap Allocation Request has been proposed by the Notary

Message sent to Filecoin Network

bafy2bzacechpu6bl6foxrsmpixusxs5eni34fpsi5avl3dpgpkrwdmitz7vhs

Address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

Datacap Allocated

1.25PiB

Signer Address

f1mdk7s2vntzm6hu35yuo6vjubtrpfnb2awhgvrri

Id

97ecd17a-9010-4f4e-97f4-ed5e6c2d3125

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacechpu6bl6foxrsmpixusxs5eni34fpsi5avl3dpgpkrwdmitz7vhs

[psh0691]

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea6mkq6emnahxajl7l5bxq3hse6ntszkfcooywlfvygekxkndmk2g

Address

f1diyfoa4c3zy7goknerc4q7ogrq24xlzhoddiqbi

Datacap Allocated

1.25PiB

Signer Address

f1qdko4jg25vo35qmyvcrw4ak4fmuu3f5rif2kc7i

Id

97ecd17a-9010-4f4e-97f4-ed5e6c2d3125

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacea6mkq6emnahxajl7l5bxq3hse6ntszkfcooywlfvygekxkndmk2g

[NDLABS-Leo]

Since the project has been signed, the application form will be closed, but we will still synchronize the processing of data in the application form.

[NDLABS-Leo]

checker:manualTrigger

[filplus-checker-app]

DataCap and CID Checker Report Summary¹

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

• Overall Graphsync retrieval success rate: 0.03%
• Overall HTTP retrieval success rate: 0.00%
• Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 85.59% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients²

⚠️ CID sharing has been observed. (Top 3)

• 14.09 TiB - f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy - NDLABS
• 4.88 TiB - f1d2op7ndmbevlthyonqntkxsg4a47qgliztvhj4i - NDLABS
• 4.03 TiB - f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq - Hepta

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval report.

Footnotes

1. To manually trigger this report, add a comment with text checker:manualTrigger ↩

2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

[NDLABS-Leo]

checker:manualTrigger

[filplus-checker-app]

DataCap and CID Checker Report Summary¹

Retrieval Statistics

⚠️ All retrieval success ratios are below 1%.

• Overall Graphsync retrieval success rate: 0.04%
• Overall HTTP retrieval success rate: 0.00%
• Overall Bitswap retrieval success rate: 0.00%

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

Deal Data Replication

⚠️ 85.53% of deals are for data replicated across less than 4 storage providers.

Deal Data Shared with other Clients²

⚠️ CID sharing has been observed. (Top 3)

• 14.09 TiB - f17nerghj2kmg7b4e6asft3xexga5qbzbqe3hi4gy - NDLABS
• 4.88 TiB - f1d2op7ndmbevlthyonqntkxsg4a47qgliztvhj4i - NDLABS
• 4.03 TiB - f1opjqkoajys7fr4yajwcpj2bhuf4akh4s4ppdjwq - Hepta

Full report

Click here to view the CID Checker report.
Click here to view the Retrieval report.

Footnotes

1. To manually trigger this report, add a comment with text checker:manualTrigger ↩

2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

[data-programs]

This user’s identity has been verified through filplus.storage