[Bug]: 运行BAAI/bge-m3时候，无论输入是什么，返回特征向量都是同一串。

[caolicaoli]

Your current environment

容器quay.io/ascend/vllm-ascend:main运行huggingface下载的BAAI/bge-m3，启动正常运行正常。

🐛 Describe the bug

无论输入什么，返回值都是-0.009552001953125,-0.006282806396484375,0.024322509765625,0.0094757080078125,0.004878997802734375,0.005474090576171875,0.023651123046875,0.0328369140625,-0.01468658447265625,-0.006076812744140625,0.00377655029296875,-0.0073089599609375,-0.04656982421875,-0.0014333724975585938,0.017181396484375,-0.01221466064453125,-0.0300750732421875,-0.0079193115234375,-0.0126953125,-0.052337646484375,0.0028438568115234375,-0.0192718505859375,0.0021228790283203125,0.003574371337890625,0.01399993896484375,0.041259765625,-0.0223846435546875,-0.02099609375,-0.01554107666015625,-0.0095062255859375,-0.00262451171875,-0.029876708984375,0.0014667510986328125,-0.0404052734375,-0.02557373046875,-0.01399993896484375,0.002956390380859375,0.0300445556640625,-0.06103515625,0.021240234375,-0.021514892578125,-0.01727294921875,-0.0011396408081054688,-0.0028972625732421875,-0.0301055908203125,-0.03997802734375,-0.0027980804443359375,-0.024505615234375,-0.014007568359375,0.005321502685546875,-0.058349609375,0.0001266002655029297,0.010284423828125,-0.01140594482421875,0.0220184326171875,0.013641357421875,-0.013580322265625,-0.071044921875,-0.047088623046875,0.0176544189453125,-0.01087188720703125,-0.007694244384765625,-0.040802001953125,-0.03167724609375,-0.0074005126953125,0.07965087890625,0.0129547119140625,-0.0266571044921875,-0.020782470703125,-0.0584716796875,0.01033782958984375,0.0018215179443359375,0.002407073974609375,-0.004535675048828125,-0.0310516357421875,-0.0204620361328125,0.03485107421875,-0.0121917724609375,0.0321044921875,0.00569915771484375,0.092041015625,0.0127410888671875,0.0540771484375,0.031646728515625,-0.034393310546875,0.06451416015625,-0.00998687744140625,0.0286102294921875,0.0307769775390625,-0.005031585693359375,-0.056365966796875,-0.0477294921875,-0.0162200927734375,-0.035888671875,-0.0300750732421875,0.00262451171875,-0.0171966552734375,-0.0208892822265625,-9.85264778137207e-05,0.0196380615234375,0.0184173583984375,0.0306396484375,-0.0217132568359375,-0.01026153564453125,0.00846099853515625,-0.00025343894958496094,0.0294036865234375,0.0137176513671875,-0.0290679931640625,-0.054443359375,0.004180908203125,0.02081298828125,0.018768310546875,-0.0108489990234375,-0.014434814453125,-0.00191497802734375,-0.02655029296875,-0.0022602081298828125,0.01019287109375,-0.003925323486328125,0.0325927734375,0.0297088623046875,0.053131103515625,-0.03558349609375,-0.0230712890625,0.0309906005859375,0.005382537841796875,0.0191497802734375,-0.05621337890625,-0.0277252197265625,-0.005130767822265625,-0.008087158203125,-0.05328369140625,0.0123748779296875,-0.07452392578125,-0.02587890625,0.0197906494140625,-0.049652099609375,-0.0194244384765625,-0.0196380615234375,-0.009429931640625,0.0006856918334960938,-0.0290679931640625,0.002880096435546875,0.00870513916015625,-0.043182373046875,0.016693115234375,-0.0003657341003417969,-0.01108551025390625,-0.057159423828125,-0.004886627197265625,0.01007843017578125,0.0246124267578125,0.0167236328125,-0.027923583984375,-0.0123443603515625,0.0179290771484375,0.01018524169921875,-0.0037250518798828125,-0.0293731689453125,0.0250396728515625,0.0114288330078125,-0.0275421142578125,-0.022796630859375,-0.038818359375,-0.01012420654296875,-0.01152801513671875,0.0029811859130859375,-0.0247344970703125,0.0293426513671875,-0.01251220703125,-0.0546875,0.0088043212890625,-0.01947021484375,0.0023326873779296875,-0.044921875,0.0142822265625,0.01904296875,0.0199737548828125,-0.0374755859375,-0.01708984375,0.043487548828125,-0.032440185546875,-0.010406494140625,0.01258087158203125,0.0032253265380859375,0.010711669921875,0.001194000244140625,0.04833984375,-0.01027679443359375,-0.0266265869140625,-0.0394287109375,-0.002727508544921875,-0.0263824462890625,-0.0067138671875,-0.0089874267578125,-0.00669097900390625,-0.00115966796875,-0.03851318359375,-0.0223236083984375,-0.0268707275390625,0.00186920166015625,-0.0222625732421875,0.00505828857421875,-0.0047760009765625,0.0226593017578125,-0.037811279296875,-0.0224609375,0.030975341796875,-0.006275177001953125,-0.037567138671875,-0.0015401840209960938,-0.00969696044921875,0.0029582977294921875,-0.0294342041015625,-0.0220489501953125,0.0187530517578125,0.0257720947265625,-0.0154571533203125,0.01346588134765625,-0.024871826171875,0.019561767578125,-0.0016336441040039062,-0.02142333984375,0.026031494140625,-0.0221710205078125,0.035003662109375,0.054595947265625,0.0009555816650390625,-0.0439453125,-0.041259765625,0.034637451171875,-0.0228424072265625,-0.019012451171875,0.0239105224609375,0.01354217529296875,0.005126953125,0.004650115966796875,0.01190948486328125,0.0059814453125,-0.02276611328125,0.0240631103515625,0.01039886474609375,-0.01145172119140625,0.034576416015625,0.0027790069580078125,0.004055023193359375,-0.00014579296112060547,-0.0225067138671875,-0.004283905029296875,0.0023746490478515625,-0.018829345703125,-0.017608642578125,0.00423431396484375,0.018310546875,0.024383544921875,0.054840087890625,0.00044989585876464844,-0.0162506103515625,0.043243408203125,0.00888824462890625,0.0207061767578125,0.00962066650390625,0.055206298828125,0.01161956787109375,-0.01019287109375,-0.0235443115234375,0.00936126708984375,0.0226287841796875,0.023529052734375,-0.0236968994140625,-0.005680084228515625,-0.045196533203125,0.0010042190551757812,-0.004138946533203125,0.02734375,0.0202484130859375,-0.0010318756103515625,0.0215911865234375,0.02581787109375,0.0023250579833984375,0.0200653076171875,0.018402099609375,-0.0023708343505859375,-0.0027313232421875,-0.01580810546875,-0.00199127197265625,-0.033111572265625,-0.0085296630859375,-0.00913238525390625,-0.00827789306640625,0.0100555419921875,0.005603790283203125,0.0222015380859375,0.03271484375,0.01273345947265625,-0.03216552734375,0.57177734375,-0.0390625,-0.0157318115234375,-0.001506805419921875,0.0021495819091796875,-0.005588531494140625,-0.0121612548828125,-0.038360595703125,-0.041534423828125,-0.004795074462890625,-0.04071044921875,-0.01218414306640625,-0.07623291015625,0.01036834716796875,-0.0230560302734375,0.00377655029296875,-0.033477783203125,-0.0251922607421875,0.0384521484375,-0.031585693359375,0.00870513916015625,-0.003360748291015625,0.0251312255859375,-0.014251708984375,0.0019683837890625,-0.042022705078125,0.0147705078125,-0.004489898681640625,-0.028350830078125,0.0005846023559570312,0.005184173583984375,-0.01372528076171875,0.0234832763671875,0.037994384765625,0.0239410400390625,0.0217437744140625,-0.0270233154296875,-0.0006990432739257812,-0.006389617919921875,-0.017578125,-0.00650787353515625,0.01537322998046875,-0.0267333984375,0.00907135009765625,0.01041412353515625,-0.047760009765625,-0.0076446533203125,-0.021728515625,-0.0169677734375,0.0010137557983398438,-0.022796630859375,0.0228729248046875,0.0269012451171875,0.030914306640625,0.0003552436828613281,0.0364990234375,-0.01416778564453125,0.006893157958984375,0.0038051605224609375,0.00562286376953125,-0.01751708984375,-0.030181884765625,0.01788330078125,0.0290374755859375,0.020294189453125,0.019134521484375,0.01467132568359375,-0.0189666748046875,-0.05078125,0.007053375244140625,0.023529052734375,-0.027587890625,-0.0186614990234375,-0.0308074951171875,0.00981903076171875,0.0118408203125,0.01010894775390625,-0.04095458984375,-0.01557159423828125,0.05401611328125,-0.038421630859375,0.051116943359375,-0.002483367919921875,0.038543701171875,-0.04705810546875,-0.04486083984375,0.0112152099609375,-0.005954742431640625,0.008514404296875,0.1614990234375,-0.035186767578125,0.05145263671875,-0.00528717041015625,0.040496826171875,-0.0009694099426269531,0.031890869140625,0.01349639892578125,0.0284423828125,-0.0223541259765625,-0.001674652099609375,-0.00852203369140625,0.0077056884765625,-0.025177001953125,0.026580810546875,0.01031494140625,-0.03155517578125,0.0205078125,-0.0270843505859375,4.458427429199219e-05,-1.2516975402832031e-06,-0.01021575927734375,0.037017822265625,0.012115478515625,-0.020263671875,-0.06103515625,0.0024890899658203125,0.033782958984375,-0.005126953125,0.004680633544921875,-0.007904052734375,0.0171966552734375,0.03717041015625,-0.03448486328125,-0.0192718505859375,-0.0035190582275390625,-0.011199951171875,-0.0008726119995117188,-0.000324249267578125,0.01258087158203125,-0.0172119140625,-0.0154266357421875,-0.010955810546875,0.0273284912109375,0.036529541015625,-0.015472412109375,0.0008139610290527344,-0.0289306640625,-0.003925323486328125,-0.0156097412109375,0.0024738311767578125,-0.004413604736328125,-0.049713134765625,0.01219940185546875,-0.0227813720703125,-0.026580810546875,-0.01142120361328125,-0.0207977294921875,-0.0030307769775390625,-0.0125274658203125,0.00942230224609375,-0.0002281665802001953,-0.0335693359375,-0.0198516845703125,-0.016387939453125,0.01262664794921875,-0.0256805419921875,-0.05908203125,-0.005428314208984375,0.013885498046875,0.00550079345703125,-0.008453369140625,-0.01776123046875,-0.001415252685546875,0.0257568359375,0.006320953369140625,-0.018280029296875,0.018951416015625,0.00783538818359375,0.01922607421875,-0.012054443359375,-0.0489501953125,0.0030422210693359375,-0.0247344970703125,-0.0021800994873046875,0.047332763671875,-0.00839996337890625,0.039825439453125,0.0106201171875,-0.0203857421875,0.017425537109375,-0.015960693359375,-0.0177001953125,0.01256561279296875,-0.051361083984375,-0.0364990234375,0.0014543533325195312,0.01062774658203125,0.003662109375,-0.009979248046875,-0.033966064453125,-0.0046539306640625,-0.0113525390625,0.0138092041015625,0.0170440673828125,-0.021820068359375,-0.002834320068359375,0.0149383544921875,-0.00551605224609375,0.00821685791015625,-0.006683349609375,-0.004505157470703125,-0.0186614990234375,0.005126953125,-0.007030487060546875,0.03143310546875,0.027923583984375,-0.037322998046875,0.012237548828125,0.06048583984375,0.015716552734375,-0.008392333984375,-0.0144195556640625,-0.023651123046875,0.01430511474609375,-0.00597381591796875,-0.052490234375,-0.00017404556274414062,-0.004749298095703125,0.04132080078125,-0.00890350341796875,-0.0098876953125,-0.005062103271484375,-0.063232421875,0.038543701171875,0.0006556510925292969,-0.01413726806640625,0.029632568359375,-0.0053863525390625,0.01451873779296875,0.02947998046875,-0.0047760009765625,-0.0251922607421875,0.0301513671875,-0.0252227783203125,0.0053253173828125,0.0194549560546875,-0.030181884765625,-0.045867919921875,-0.0218658447265625,0.0114288330078125,0.002918243408203125,-0.039398193359375,0.00399017333984375,-0.00484466552734375,-0.005496978759765625,-0.02532958984375,-0.00914764404296875,0.00896453857421875,-0.0082550048828125,-0.0184783935546875,-0.018280029296875,-0.0017156600952148438,0.059478759765625,0.007251739501953125,0.0201568603515625,-0.049957275390625,0.0223388671875,-0.002681732177734375,0.00334930419921875,0.00144195556640625,-0.00887298583984375,-0.002960205078125,0.00193023681640625,0.033782958984375,0.0242462158203125,-0.046295166015625,-0.01531982421875,-0.02423095703125,0.028289794921875,0.01995849609375,0.0024127960205078125,0.0211639404296875,0.039093017578125,-0.00843048095703125,0.006305694580078125,-0.01099395751953125,-0.007747650146484375,-0.0258331298828125,0.006473541259765625,-0.01215362548828125,0.051116943359375,0.0037975311279296875,-0.0303192138671875,-0.0007562637329101562,0.0007352828979492188,-0.0013256072998046875,0.056732177734375,0.0186309814453125,-0.041412353515625,-0.006378173828125,0.00156402587890625,0.00894927978515625,-0.01346588134765625,-0.01087188720703125,-0.044342041015625,-0.00598907470703125,0.00786590576171875,-0.04925537109375,0.0172576904296875,-0.023712158203125,-0.00566864013671875,0.0196380615234375,-0.02642822265625,-0.0290985107421875,0.02960205078125,0.03515625,0.032257080078125,0.007083892822265625,-0.01715087890625,-0.01303863525390625,0.0035648345947265625,0.0226898193359375,-0.0653076171875,0.01515960693359375,0.01157379150390625,-0.01036834716796875,-0.0170135498046875,-0.0157318115234375,0.021026611328125,-0.03887939453125,-0.0233306884765625,-0.02703857421875,-0.007266998291015625,0.02581787109375,-0.006153106689453125,-0.0136871337890625,-0.036651611328125,-0.0192718505859375,0.002101898193359375,0.0005269050598144531,0.00922393798828125,0.01288604736328125,0.0140533447265625,-0.0027618408203125,0.00943756103515625,-0.01403045654296875,-0.01385498046875,0.02325439453125,0.00464630126953125,-0.056915283203125,0.033172607421875,-0.0059356689453125,-0.06121826171875,-0.0281982421875,-0.034637451171875,-0.0012102127075195312,-0.00882720947265625,-0.016754150390625,-0.006771087646484375,-0.02410888671875,-0.0019512176513671875,-0.01311492919921875,-0.0251007080078125,-0.0057525634765625,-0.037841796875,-0.0037059783935546875,-0.0267791748046875,-0.00811004638671875,-0.04608154296875,-0.0175018310546875,0.0024814605712890625,-0.034881591796875,-0.002452850341796875,0.01471710205078125,0.005260467529296875,0.002044677734375,0.00528717041015625,0.015472412109375,-0.031768798828125,-0.0099029541015625,0.045196533203125,-0.0245513916015625,0.001953125,-0.0323486328125,-0.0223236083984375,0.002162933349609375,-0.0137939453125,-0.050079345703125,-0.018035888671875,0.0160675048828125,-0.04388427734375,-0.0277862548828125,0.04278564453125,0.0277099609375,-0.01593017578125,-0.025634765625,-0.00409698486328125,-0.008270263671875,-0.0202789306640625,-0.0014925003051757812,0.035797119140625,0.0021114349365234375,0.0009627342224121094,-0.006458282470703125,0.034149169921875,0.013397216796875,-0.036773681640625,0.01097869873046875,0.016937255859375,0.0012083053588867188,-0.03509521484375,0.0297088623046875,0.0131988525390625,0.0075531005859375,-0.03131103515625,0.0120697021484375,-0.01053619384765625,-0.0377197265625,-0.01503753662109375,0.00907135009765625,-0.01486968994140625,-0.0020904541015625,0.00305938720703125,0.0093536376953125,0.037506103515625,0.0215911865234375,-0.006214141845703125,-0.0038776397705078125,-0.0147857666015625,-0.0333251953125,0.0303192138671875,-0.00011354684829711914,-0.00923919677734375,-0.020294189453125,0.006622314453125,0.01806640625,0.007442474365234375,-0.00201416015625,-0.0240325927734375,0.0108795166015625,-0.0198974609375,0.0531005859375,-0.0024929046630859375,-0.005451202392578125,-0.0186004638671875,-0.01537322998046875,-0.01328277587890625,-0.0025539398193359375,-0.01540374755859375,0.01898193359375,0.04132080078125,-0.005237579345703125,-0.01036834716796875,0.0098114013671875,0.036529541015625,-0.05718994140625,0.0104522705078125,-0.0101165771484375,-0.0225677490234375,-0.0202789306640625,0.0163421630859375,-0.037261962890625,0.03564453125,0.00626373291015625,-0.0251007080078125,0.0384521484375,0.015899658203125,-0.0177459716796875,0.01018524169921875,0.0433349609375,0.00921630859375,-0.0210418701171875,0.0191497802734375,-0.0276641845703125,-0.00485992431640625,0.007518768310546875,-0.040985107421875,0.02471923828125,-0.020050048828125,-0.04022216796875,-0.01091766357421875,0.020233154296875,-0.09393310546875,-0.014617919921875,-0.01218414306640625,-0.012481689453125,-0.030609130859375,0.04486083984375,0.004863739013671875,-0.04119873046875,0.049102783203125,-0.017822265625,0.03887939453125,-0.1015625,0.006053924560546875,0.004734039306640625,-0.01953125,0.0301055908203125,-0.0030307769775390625,-0.0283355712890625,0.0225372314453125,-0.003276824951171875,-0.0020503997802734375,0.01396942138671875,0.0179901123046875,0.0197906494140625,-0.0225067138671875,-0.020538330078125,0.00572967529296875,-0.015838623046875,-0.002105712890625,0.020172119140625,-0.035400390625,0.033111572265625,-0.032806396484375,-0.05328369140625,0.01125335693359375,0.02203369140625,-0.002685546875,0.007427215576171875,-0.0232391357421875,-0.01007080078125,-0.01499176025390625,0.053192138671875,-0.0009064674377441406,-0.02667236328125,0.0263214111328125,0.0318603515625,-0.0550537109375,0.00986480712890625,0.00885772705078125,-0.01422119140625,0.017547607421875,0.0038433074951171875,-0.01336669921875,0.0018634796142578125,-0.00464630126953125,-0.013397216796875,0.0171051025390625,-0.0095367431640625,-0.007049560546875,-0.0185394287109375,-0.01641845703125,-0.02020263671875,-0.0212860107421875,0.013031005859375,0.0135040283203125,-0.0289306640625,0.001434326171875,-0.0297393798828125,0.030548095703125,-0.0016536712646484375,0.004192352294921875,-0.0125885009765625,-0.004009246826171875,0.0034923553466796875,-0.0199737548828125,-0.050140380859375,0.0119171142578125,-0.022308349609375,-0.024932861328125,0.02288818359375,-0.00630950927734375,-0.008697509765625,-0.03607177734375,0.03826904296875,-0.031829833984375,-0.030242919921875,0.00989532470703125,1.5079975128173828e-05,-0.0264129638671875,0.0027904510498046875,-0.0170440673828125,-0.035430908203125,-0.005626678466796875,-0.007244110107421875,0.0004394054412841797,0.00986480712890625,0.055572509765625,-0.025146484375,0.053253173828125,-0.059814453125,0.0290985107421875,0.000263214111328125,-0.0150909423828125,0.02374267578125,-0.04052734375,-0.03778076171875,-0.06109619140625,-0.034576416015625,0.0116729736328125,-0.018768310546875,0.0013093948364257812,-0.01436614990234375,-0.042022705078125,0.026123046875,0.0006012916564941406,-0.047149658203125,-0.0103759765625,0.032073974609375,-0.049407958984375,-0.0045318603515625,0.01238250732421875,-0.010040283203125,-0.03411865234375,-0.00827789306640625,0.0094146728515625,0.020050048828125,0.04058837890625,-0.01323699951171875,-0.030548095703125,-0.0286102294921875,0.006793975830078125,-0.01885986328125,0.0201263427734375,0.007720947265625,0.039642333984375,-0.0220489501953125,0.046661376953125,-0.00695037841796875,0.03985595703125,0.009063720703125,-0.012451171875,0.010467529296875,-0.0205230712890625,0.0148162841796875,0.052520751953125,0.01265716552734375,-0.00852203369140625,0.03741455078125,0.06549072265625,-0.015869140625,-0.042938232421875,0.0015745162963867188,0.00939178466796875,-0.0208282470703125,-0.033782958984375,0.0081939697265625,-0.007251739501953125,0.0260162353515625,-0.019683837890625,-0.015777587890625,-0.0218963623046875,0.01421356201171875,-0.00675201416015625,-0.034820556640625,-0.00899505615234375,-0.02142333984375,-0.0179901123046875,0.0006990432739257812,0.0034923553466796875,0.020172119140625,0.0055694580078125,0.01312255859375,-0.005687713623046875,-0.0173492431640625,0.00738525390625,-0.0275115966796875,-0.0019855499267578125,0.0262298583984375,-0.01357269287109375,-0.05194091796875,-0.017547607421875,-0.0224151611328125,-0.019866943359375,-0.041900634765625,0.051513671875,0.016693115234375,0.0017852783203125,0.0009822845458984375,-0.006320953369140625,0.003467559814453125,0.0296783447265625,-0.01192474365234375,0.054229736328125,0.0092010498046875,0.017486572265625,-0.00981903076171875,0.0218505859375,0.01357269287109375,0.044525146484375,-0.0209503173828125,-0.006450653076171875,0.01222991943359375,0.0159149169921875,-0.02777099609375,-0.01715087890625,0.01531982421875,0.00313568115234375,0.0185089111328125,0.0175628662109375,-0.023834228515625,0.02392578125,-0.03387451171875,-0.0162811279296875,0.0018253326416015625,-0.0162353515625,-0.0195159912109375,0.00904083251953125,0.01439666748046875,-0.025604248046875,-0.038116455078125,-0.0023784637451171875,0.04425048828125,-0.031768798828125,-0.018310546875,0.0220947265625,0.00316619873046875,0.0139923095703125,0.03582763671875,-0.00402069091796875,0.022216796875,-0.0152435302734375,0.008209228515625,0.0274200439453125,-0.03021240234375,-0.004863739013671875,-0.0142822265625,-0.05902099609375,-0.027679443359375,-0.01021575927734375,0.0069732666015625,-0.0035572052001953125,0.007110595703125,0.0020160675048828125,-0.00803375244140625,0.03326416015625,-0.006969451904296875,-0.0119476318359375,0.019989013671875,0.01277923583984375,-0.0023555755615234375,0.0264129638671875,0.019287109375,0.02008056640625,-0.08868408203125,0.0058441162109375

[wangxiyuan]

See the commit message here: #229

known issue will be fixed later

[Yikun]

@caolicaoli Thanks for your feedback, would you mind add my wechat: yikunkero I can invite you to vLLM Ascend wechat group for
better communication.