forked from khalefa-phd/learned-indexes
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathresults.txt
414 lines (333 loc) · 9.91 KB
/
results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
1. python Learned_BTree.py -t full -d random -n 100000 -c 1
*************start Learned NN************
Build Learned NN time 28.661000967025757
Calculate Error
Search time 0.000056
mean error = 0.5821225999999929
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 4.205585956573486
Calculate error
Search time 2.3854489326477052e-05
mean error = 0.0
*************end BTree************
10K
Search time 0.000053
mean error = 0.3987460000000008
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 0.32624316215515137
Calculate error
len(test_set_x): 10000
len(test_set_y): 10000
end_time: 1622611178.194535
Search time 1.3497090339660645e-05
mean error = 0.0
*************end BTree************
50K
Build Learned NN time 21.000842094421387
Calculate Error
Search time 0.000054
mean error = 0.4846544000000001
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 1.9411990642547607
Calculate error
len(test_set_x): 50000
len(test_set_y): 50000
end_time: 1622611328.206592
Search time 1.5199041366577149e-05
mean error = 0.0
100K
Build Learned NN time 33.15876507759094
Calculate Error
Search time 0.000051
mean error = 0.5913151999999947
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 4.051242113113403
Calculate error
len(test_set_x): 100000
len(test_set_y): 100000
end_time: 1623120341.675288
Search time 1.5497288703918456e-05
mean error = 0.0
*************end BTree************
*************start BPlusTree************
Start Build
Build BPlusTree time 3.0310206413269043
Calculate error
end_time: 1623120346.8535318
Search time 1.4780158996582031e-05
mean error = [0.]
*************end BPlusTree************
200K
Build Learned NN time 76.02217197418213
Calculate Error
Search time 0.000052
mean error = 0.5880795999999898
*************end Learned NN************
Build BTree time 9.2165207862854
Calculate error
len(test_set_x): 200000
len(test_set_y): 200000
end_time: 1622611696.015092
Search time 1.8577064275741578e-05
mean error = 0.0
300K
Build Learned NN time 113.14038681983948
Calculate Error
Search time 0.000054
mean error = 0.5674540666666434
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 13.677019119262695
Calculate error
len(test_set_x): 300000
len(test_set_y): 300000
end_time: 1622611916.6569421
Search time 1.82867169380188e-05
mean error = 0.0
*************end BTree************
500K
Build Learned NN time 220.1475031375885
Calculate Error
Search time 0.000058
mean error = 0.5418018399999648
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 25.98939275741577
Calculate error
len(test_set_x): 500000
len(test_set_y): 500000
end_time: 1622612430.0357509
Search time 2.1102035999298095e-05
mean error = 0.0
*************end BTree************
2. python Learned_BTree.py -t full -d exponential -n 10000 -c 1
*************start Learned NN************
Start Train
Build Learned NN time 24.546956062316895
Calculate Error
Search time 0.000096
mean error = 20.392006
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 0.3445091247558594
Calculate error
len(test_set_x): 10000
end_time: 1622486271.856478
Search time 1.3023900985717773e-05
mean error = 0.0
*************end BTree************
50K
Build Learned NN time 53.491650104522705
Calculate Error
Search time 0.000052
mean error = 0.8990496000000007
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 2.075287103652954
Calculate error
len(test_set_x): 50000
len(test_set_y): 50000
end_time: 1622611990.0027552
Search time 1.6298484802246093e-05
mean error = 7.999999999997698e-07
*************end BTree************
100K
Build Learned NN time 98.8081259727478
Calculate Error
Search time 0.000078
mean error = 4.572314900000006
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 4.279552936553955
Calculate error
len(test_set_x): 100000
len(test_set_y): 100000
end_time: 1622612239.2259772
Search time 1.630439281463623e-05
mean error = 2.099999999999387e-06
*************end BTree************
200K
Build Learned NN time 178.51794004440308
Calculate Error
Search time 0.000084
mean error = 7.67600390000002
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 9.594345092773438
Calculate error
len(test_set_x): 200000
len(test_set_y): 200000
end_time: 1622612912.477782
Search time 1.6945124864578246e-05
mean error = 4.349999999999641e-06
*************end BTree************
300K
Build Learned NN time 263.04807305336
Calculate Error
Search time 0.000089
mean error = 12.28657429999999
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 14.032356977462769
Calculate error
len(test_set_x): 300000
len(test_set_y): 300000
end_time: 1622612662.0801432
Search time 1.7894821166992187e-05
mean error = 7.699999999998325e-06
*************end BTree************
500K
Build Learned NN time 490.7198929786682
Calculate Error
Search time 0.000095
mean error = 38.197931799999964
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 22.13231086730957
Calculate error
len(test_set_x): 500000
len(test_set_y): 500000
end_time: 1622613676.8682911
Search time 1.771823024749756e-05
mean error = 1.3259999999999316e-05
*************end BTree************
1000K
Build Learned NN time 1270.934895992279
Calculate Error
Search time 0.000030
mean error = 0.044276270000003816
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 57.16642689704895
Calculate error
len(test_set_x): 1000000
len(test_set_y): 1000000
end_time: 1623119047.7167842
Search time 2.0373126268386842e-05
mean error = 2.5020000000000187e-05
*************end BTree************
5. python Learned_BTree.py -t full -d lognormal -n 10000 -c 1
*************start Learned NN************
Start Train
2021-06-01 18:44:00.009006: I tensorflow/compiler/jit/xla_cpu_device.cc:41] Not creating XLA devices, tf_xla_enable_xla_devices not set
2021-06-01 18:44:00.009572: I tensorflow/core/platform/cpu_feature_guard.cc:142] This TensorFlow binary is optimized with oneAPI Deep Neural Network Library (oneDNN) to use the following CPU instructions in performance-critical operations: AVX2 FMA
To enable them in other operations, rebuild TensorFlow with the appropriate compiler flags.
WARNING:tensorflow:From /Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/tensorflow/python/util/dispatch.py:201: calling dropout (from tensorflow.python.ops.nn_ops) with keep_prob is deprecated and will be removed in a future version.
Instructions for updating:
Please use `rate` instead of `keep_prob`. Rate should be set to `rate = 1 - keep_prob`.
2021-06-01 18:44:00.201753: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:196] None of the MLIR optimization passes are enabled (registered 0 passes)
cross_entropy start
cross_entropy start
Using BTree
Build Learned NN time 2.8124568462371826
Calculate Error
Search time 0.000014
mean error = 0.0019489999999999935
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 0.28274083137512207
Calculate error
len(test_set_x): 10000
len(test_set_y): 10000
end_time: 1622598243.682539
Search time 1.6461801528930664e-05
mean error = 0.0019489999999999935
*************end BTree************
50K
Build Learned NN time 11.82577109336853
Calculate Error
Search time 0.000015
mean error = 0.03013399999999192
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 1.5518598556518555
Calculate error
len(test_set_x): 50000
len(test_set_y): 50000
end_time: 1622612798.7452312
Search time 3.2730679512023926e-05
mean error = 0.009594399999997439
*************end BTree************
100K
Build Learned NN time 20.527963161468506
Calculate Error
Search time 0.000014
mean error = 0.7479447999993902
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 2.6051788330078125
Calculate error
len(test_set_x): 100000
len(test_set_y): 100000
end_time: 1622598345.547555
Search time 4.7373549938201906e-05
mean error = 0.019236699999991856
*************end BTree************
200K
Build Learned NN time 41.961012840270996
Calculate Error
Search time 0.000016
mean error = 0.30312384999999975
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 5.689350128173828
Calculate error
len(test_set_x): 200000
len(test_set_y): 200000
end_time: 1622613150.6785889
Search time 9.231212854385376e-05
mean error = 0.03847330000004398
*************end BTree************
500K
Build Learned NN time 118.586678981781
Calculate Error
Search time 0.000013
mean error = 12.319611239956531
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 10.555787801742554
Calculate error
len(test_set_x): 500000
len(test_set_y): 500000
end_time: 1623098776.3544981
Search time 0.0001924120602607727
mean error = 0.09586560000002191
*************end BTree************
1000K
Build Learned NN time 322.7109212875366
Calculate Error
Search time 0.000010
mean error = 7.234292119966051
*************end Learned NN************
*************start BTree************
Start Build
Build BTree time 20.02080488204956
Calculate error
len(test_set_x): 1000000
len(test_set_y): 1000000
end_time: 1623100498.999255
Search time 0.0003829708309173584
mean error = 0.19141662999997747
*************end BTree************