Test runner reports failing tests as passed if actual or expected contains ansi color codes

[bobisageek]

Problem Statement

Using the test runner, a test that has failed is reported as passing if the actual or expected values are strings with ansi color codes in them.

Repro

I have this namespace in a scratch project using deps.edn:

(ns cursive-colors-test
  (:require [clojure.test :refer [deftest is]]))


(defn red [s]
  (str "\u001b[31m" s "\u001b[0m"))

(deftest no-coloring
  (is (= "hi" "hello")))

(deftest color-in-both
  (is (= (red "hi") (red "hello"))))

(deftest color-in-expected
  (is (= (red "hi") "hello")))

(deftest color-in-actual
  (is (= "hi" (red "hello"))))

Executing these tests using run-tests reports that all 4 tests fail (as they should). Executing these tests using the test runner (i.e. by clicking the gutter icon to run tests in the NS) indicates that the tests involving color in the strings passed.

The console output appears to somewhat indicate that the tests failed:

... but perhaps that data structure isn't being read/interpreted correctly.

Context

IntelliJ version

IntelliJ IDEA 2024.2.2 (Ultimate Edition)
Build #IU-242.22855.74, built on September 18, 2024

Cursive Version

1.14.0-eap1-2024.2

[cursive-ide]

This seemed to break the IntelliJ test reporter somehow, you're right that the messages were printed but I'm not sure why they weren't interpreted correctly. Anyway, fixed:

[cursive-ide]

Fix released in 1.14.1-eap1 on 2024-12-11.