BERTCpp

A lightly BERT inference project using intel MKL and Protobuf in c++ (working in progress)

Dependency

bertcpp using protobuf to convert pytorch pretrained model in pb file and load it in c++

bertcpp using MKL to implement blas operator

bertcpp using utf8proc to process string

mkdir build & cd build
cmake ..
make -j4

To run unitest

./bert_test

tokenizer part comes from cuBERT