Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Apache Arrow stream writers #147

Merged
merged 30 commits into from
Oct 10, 2023
Merged
Changes from 1 commit
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
f40c692
Add Apache Arrow stream writers
JesseMckinzie Sep 20, 2023
63000b8
Update Apache Arrow writers to use stream writers
JesseMckinzie Sep 20, 2023
142c80d
Add unit tests for get_arrow_table
JesseMckinzie Sep 20, 2023
0bb41eb
Update name of Gabor parameter
JesseMckinzie Sep 20, 2023
a5b3d2b
Update main_nyxus.cpp
JesseMckinzie Sep 20, 2023
3d121a1
Update get_arrow_table methods
JesseMckinzie Sep 20, 2023
1e69ff4
Remove old arrow writers
JesseMckinzie Sep 20, 2023
1f1ff92
Update new_bindings_py.cpp
JesseMckinzie Sep 21, 2023
13a397a
Update main_nyxus.cpp
JesseMckinzie Sep 21, 2023
83efd66
Fix build on windows
JesseMckinzie Sep 21, 2023
64870fc
Link arrow to GTests
JesseMckinzie Sep 21, 2023
b80dc70
Update get_arrow_file methods
JesseMckinzie Sep 21, 2023
8dead40
Update arrow writers
JesseMckinzie Sep 28, 2023
5fcbfad
Update write method for arrow output
JesseMckinzie Sep 28, 2023
9a6bd2e
Add arrow writers to gtests
JesseMckinzie Sep 28, 2023
bbb808a
Update arrow writers
JesseMckinzie Sep 28, 2023
40d972c
Update arrow writers
JesseMckinzie Sep 28, 2023
6c6bd97
Update test_nyxus.py
JesseMckinzie Sep 28, 2023
28e6370
Initial writer to be null
JesseMckinzie Sep 29, 2023
870dbfb
Update output_2_buffer.cpp
JesseMckinzie Sep 29, 2023
355df10
Remove old unneeded headers
JesseMckinzie Sep 29, 2023
f882c60
Update error handling for arrow output
JesseMckinzie Sep 29, 2023
4f3547b
Update main_nyxus.cpp
JesseMckinzie Sep 29, 2023
2d17221
Update output_writers.cpp
JesseMckinzie Sep 29, 2023
012921e
Update output_writers.h
JesseMckinzie Sep 29, 2023
16db4c1
Update arrow error handling for processing montage
JesseMckinzie Sep 29, 2023
6ae187a
Remove previous implementation of Arrow writers
JesseMckinzie Oct 2, 2023
19434dc
Remove old method for alling get_feature_values
JesseMckinzie Oct 2, 2023
4d100df
Update Arrow writer error handling
JesseMckinzie Oct 4, 2023
d67b72c
Add arrow_table field to ArrowOutputStream
JesseMckinzie Oct 4, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove old method for alling get_feature_values
JesseMckinzie committed Oct 2, 2023
commit 19434dcb122700aad1f56f6b5fb2d5efc7fc581d
2 changes: 0 additions & 2 deletions src/nyx/scan_fastloader_way.cpp
Original file line number Diff line number Diff line change
@@ -274,8 +274,6 @@ namespace Nyxus
#ifdef USE_ARROW
if (arrow_output) {

auto features = Nyxus::get_feature_values();

auto status = theEnvironment.arrow_writer->write(Nyxus::get_feature_values());

if (!status.ok()) {