Skip to content

Adding endpoint routing for AI model base routing logic #2746

Adding endpoint routing for AI model base routing logic

Adding endpoint routing for AI model base routing logic #2746

Triggered via pull request February 4, 2025 15:18
Status Failure
Total duration 1h 6m 18s
Artifacts 2

integration-test.yml

on: pull_request_target
runs_go_integration_tests_on_pull_request
26m 36s
runs_go_integration_tests_on_pull_request
runs_cucumber_integration_tests_on_pull_request
56m 30s
runs_cucumber_integration_tests_on_pull_request
Fit to window
Zoom out
Zoom in

Annotations

12 errors and 2 warnings
runs_go_integration_tests_on_pull_request
Process completed with exit code 1.
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── Could not receive expected response within time. Last received code: 404, last response body: The requested resource is not available. ────────────────────────────────────────────────────────────────────────────────────────── org.wso2.apk.integration.utils.exceptions.TimeoutException: Could not receive expected response within time. Last received code: 404, last response body: The requested resource is not available. at org.wso2.apk.integration.utils.clients.SimpleHTTPClient.executeLastRequestForEventualConsistentResponse(SimpleHTTPClient.java:474) at org.wso2.apk.integration.api.BaseSteps.eventualSuccess(BaseSteps.java:322) at ✽.I eventually receive 401 response code, not accepting(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/MultiEnvironment.feature:98)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── Could not receive expected response within time. Last received code: 200, last response body: ***"data":***"allHumans":[***"name":"string"***,***"name":"string"***,***"name":"string"***,***"name":"string"***]*** ────────────────────────────────────────────────────────────────────────────────────────── org.wso2.apk.integration.utils.exceptions.TimeoutException: Could not receive expected response within time. Last received code: 200, last response body: ***"data":***"allHumans":[***"name":"string"***,***"name":"string"***,***"name":"string"***,***"name":"string"***]*** at org.wso2.apk.integration.utils.clients.SimpleHTTPClient.executeLastRequestForEventualConsistentResponse(SimpleHTTPClient.java:474) at org.wso2.apk.integration.api.BaseSteps.eventualSuccess(BaseSteps.java:322) at ✽.I eventually receive 403 response code, not accepting(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/GraphQL.feature:46)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── expected [202] but found [404] ────────────────────────────────────────────────────────────────────────────────────────── java.lang.AssertionError: expected [202] but found [404] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertEqualsImpl(Assert.java:150) at org.testng.Assert.assertEquals(Assert.java:132) at org.testng.Assert.assertEquals(Assert.java:1419) at org.testng.Assert.assertEquals(Assert.java:1383) at org.testng.Assert.assertEquals(Assert.java:1429) at org.wso2.apk.integration.api.BaseSteps.theResponseStatusCodeShouldBe(BaseSteps.java:138) at ✽.the response status code should be 202(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/MTLSwithOAuth2Optional.feature:180)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── expected [202] but found [404] ────────────────────────────────────────────────────────────────────────────────────────── java.lang.AssertionError: expected [202] but found [404] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertEqualsImpl(Assert.java:150) at org.testng.Assert.assertEquals(Assert.java:132) at org.testng.Assert.assertEquals(Assert.java:1419) at org.testng.Assert.assertEquals(Assert.java:1383) at org.testng.Assert.assertEquals(Assert.java:1429) at org.wso2.apk.integration.api.BaseSteps.theResponseStatusCodeShouldBe(BaseSteps.java:138) at ✽.the response status code should be 202(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/GRPC.feature:144)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── Connect to idp.am.wso2.com:9095 [idp.am.wso2.com/57.155.180.167] failed: Connection timed out ────────────────────────────────────────────────────────────────────────────────────────── org.apache.http.conn.ConnectTimeoutException: Connect to idp.am.wso2.com:9095 [idp.am.wso2.com/57.155.180.167] failed: Connection timed out at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) at org.wso2.apk.integration.utils.clients.SimpleHTTPClient.doPost(SimpleHTTPClient.java:212) at org.wso2.apk.integration.api.BaseSteps.iHaveValidSubscription(BaseSteps.java:467) at ✽.I have a valid subscription(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/GraphQL.feature:221) Caused by: java.net.ConnectException: Connection timed out at java.base/sun.nio.ch.Net.connect0(Native Method) at java.base/sun.nio.ch.Net.connect(Net.java:579) at java.base/sun.nio.ch.Net.connect(Net.java:568) at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) at java.base/java.net.Socket.connect(Socket.java:633) at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) at org.wso2.apk.integration.utils.clients.SimpleHTTPClient.doPost(SimpleHTTPClient.java:212) at org.wso2.apk.integration.api.BaseSteps.iHaveValidSubscription(BaseSteps.java:467) at jdk.internal.reflect.GeneratedMethodAccessor9.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:569) at io.cucumber.java.Invoker.doInvoke(Invoker.java:66) at io.cucumber.java.Invoker.invoke(Invoker.java:24) at io.cucumber.java.AbstractGlueDefinition.invokeMethod(AbstractGlueDefinition.java:47) at io.cucumber.java.JavaStepDefinition.execute(JavaStepDefinition.java:29) at io.cucumber.core.runner.CoreStepDefinition.execute(CoreStepDefinition.java:66) at io.cucumber.core.runner.PickleStepDefinitionMatch.runStep(PickleStepDefinitionMatch.java:63) at io.cucumber.core.runner.ExecutionMode$1.execute(ExecutionMode.java:10) at io.cucumber.core.runner.TestStep.executeStep(TestStep.java:84) a
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── Expected word 'aiMetadata' not found in logs expected [true] but found [false] ────────────────────────────────────────────────────────────────────────────────────────── java.lang.AssertionError: Expected word 'aiMetadata' not found in logs expected [true] but found [false] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertTrue(Assert.java:57) at org.wso2.apk.integration.api.BaseSteps.checkEnforcerLogs(BaseSteps.java:348) at ✽.I see following strings in the enforcer logs(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/APIBackendBasedAIRatelimit.feature:13)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── expected [504] but found [200] ────────────────────────────────────────────────────────────────────────────────────────── java.lang.AssertionError: expected [504] but found [200] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertEqualsImpl(Assert.java:150) at org.testng.Assert.assertEquals(Assert.java:132) at org.testng.Assert.assertEquals(Assert.java:1419) at org.testng.Assert.assertEquals(Assert.java:1383) at org.testng.Assert.assertEquals(Assert.java:1429) at org.wso2.apk.integration.api.BaseSteps.eventualSuccess(BaseSteps.java:325) at ✽.I eventually receive 504 response code, not accepting(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/BackendTimeout.feature:12)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── expected [202] but found [404] ────────────────────────────────────────────────────────────────────────────────────────── java.lang.AssertionError: expected [202] but found [404] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertEqualsImpl(Assert.java:150) at org.testng.Assert.assertEquals(Assert.java:132) at org.testng.Assert.assertEquals(Assert.java:1419) at org.testng.Assert.assertEquals(Assert.java:1383) at org.testng.Assert.assertEquals(Assert.java:1429) at org.wso2.apk.integration.api.BaseSteps.theResponseStatusCodeShouldBe(BaseSteps.java:138) at ✽.the response status code should be 202(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/GRPCMTLS.feature:54)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── expected [202] but found [404] ────────────────────────────────────────────────────────────────────────────────────────── java.lang.AssertionError: expected [202] but found [404] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertEqualsImpl(Assert.java:150) at org.testng.Assert.assertEquals(Assert.java:132) at org.testng.Assert.assertEquals(Assert.java:1419) at org.testng.Assert.assertEquals(Assert.java:1383) at org.testng.Assert.assertEquals(Assert.java:1429) at org.wso2.apk.integration.api.BaseSteps.theResponseStatusCodeShouldBe(BaseSteps.java:138) at ✽.the response status code should be 202(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/JWT.feature:119)
runs_cucumber_integration_tests_on_pull_request
APKIntegrationTestSuite.runScenario ────────────────────────────────────────────────────────────────────────────────────────── expected [4699] but found [4998] ────────────────────────────────────────────────────────────────────────────────────────── java.lang.AssertionError: expected [4699] but found [4998] at org.testng.Assert.fail(Assert.java:111) at org.testng.Assert.failNotEquals(Assert.java:1578) at org.testng.Assert.assertEqualsImpl(Assert.java:150) at org.testng.Assert.assertEquals(Assert.java:132) at org.testng.Assert.assertEquals(Assert.java:656) at org.testng.Assert.assertEquals(Assert.java:666) at org.wso2.apk.integration.api.BaseSteps.theResponseHeadersShouldContain(BaseSteps.java:302) at ✽.the response headers should contain(file:///home/runner/work/apk/apk/apk-repo/test/cucumber-tests/src/test/resources/tests/api/APIBackendBasedAIRatelimit.feature:67)
runs_cucumber_integration_tests_on_pull_request
Process completed with exit code 1.
runs_go_integration_tests_on_pull_request
No test results found!
runs_cucumber_integration_tests_on_pull_request
192 tests run, 0 skipped, 97 failed.

Artifacts

Produced during runtime
Name Size
apk-integration-test-cucmber-logs
122 KB
apk-integration-test-go-logs
71.6 KB