ci: Skip invalid miri test, avoid concurrent undsoundness checks (#870)

ci: Skip invalid miri test, avoid concurrent undsoundness checks (#870) #402