Programming exercises: Add Artemis intelligence consistency check

[wasnertobias]

Important

This PR builds on #10156, merge afterwards. The Pyris code is already merged and should work on TS1, TS3, and TS5 (TS3 had some issues, which might still persist. Use TS1 or TS5)

Checklist

General

• I tested all changes and their related features with all corresponding user types on a test server.
• Language: I followed the guidelines for inclusive, diversity-sensitive, and appreciative language.
• I chose a title conforming to the naming conventions for pull requests.

Server

• Important: I implemented the changes with a very good performance and prevented too many (unnecessary) and too complex database calls.
• I strictly followed the principle of data economy for all database calls.
• I strictly followed the server coding and design guidelines.
• I added multiple integration tests (Spring) related to the features (with a high test coverage). -> Follow-up due to time reasons
• I added pre-authorization annotations according to the guidelines and checked the course groups for all new REST Calls (security).
• I documented the Java code using JavaDoc style.

Client

• Important: I implemented the changes with a very good performance, prevented too many (unnecessary) REST calls and made sure the UI is responsive, even with large data (e.g. using paging).
• I strictly followed the principle of data economy for all client-server REST calls.
• I strictly followed the client coding and design guidelines.
• Following the theming guidelines, I specified colors only in the theming variable files and checked that the changes look consistent in both the light and the dark theme.
• I added multiple integration tests (Jest) related to the features (with a high test coverage), while following the test guidelines. -> Follow-up due tue time reasons
• I added authorities to all new routes and checked the course groups for displaying navigation elements (links, buttons).
• I documented the TypeScript code using JSDoc style.
• I added multiple screenshots/screencasts of my UI changes.
• I translated all newly inserted strings into English and German.

Motivation and Context

Although we try our best when creating a programming exercise sometimes there are inconsistencies between problem statement, template repository, solution repository and so one. Those mostly happen when updating an exercise to a different theme or generally forgetting to change something. To catch those inconsistencies, we want to use LLMs to detect them and make the instructors aware about them.

Description

Adds an Artemis Intelligence markdown action on the problem statement of programming exercises called "Check consistency". The action triggers a consistency check pipeline on the Pyris side and displays the result below the problem statement in a dismissible alert.

Steps for Testing

Prerequisites:

• 1 Instructor (Editor or above)
• 1 Programming exercise

Make sure to deploy to a test server with Iris enabled (i.e. TS1, TS5 or TS3 if it is fixed already)

1. Log in to Artemis
2. Navigate to Course Management
3. Navigate to any course
4. Click "Exercises"
5. Click edit on a programming exercise (create one if none exist)
6. Scroll to problem statement
7. Add some inconsistency to the problem statement (i.e. QuickSort instead of MergeSort etc.)
8. Save the problem statement (top right)
9. In the toolbar of the markdown editor, right of "Insert Test Case", click AI [Artemis Intelligence] and then "Check consistency"
10. Wait for a bit, can take 10s or so
11. Below the problem statement a warning alert with the result should be shown
12. The result will not be 100% correct but it might detect some issues (like CodeRabbit does for instance)
13. Click X and the alert should disappear

Testserver States

Note

These badges show the state of the test servers.
Green = Currently available, Red = Currently locked
Click on the badges to get to the test servers.

Review Progress

Code Review

• Code Review 1
• Code Review 2

Manual Tests

• Test 1
• Test 2

Test Coverage

Will be done as follow-up.

Screenshots

Summary by CodeRabbit

Release Notes: Artemis Intelligence Consistency Check Feature

• New Features

  • Added a consistency check functionality for programming exercises.
  • Users can now trigger a consistency check on exercise instructions.
  • Provides real-time status updates and results via WebSocket.
  • New REST endpoint for checking consistency of programming exercises.

• User Interface

  • New alert to display consistency check results in the instructions editor.
  • Added localized translations for consistency check commands and alerts.

• Backend Improvements

  • Introduced new services and resources to support consistency checking.
  • Implemented secure endpoint for initiating consistency checks.
  • Enhanced job management for tracking consistency check status.
  • Improved loading state management for consistency checks.

[coolchock]

code lgtm, just one small nit-pick

[cremertim]

Reapprove latest changes

[EneaGore]

Tested on TS1, worked as described.

[Cathy0123456789]

Re-tested on TS1. Works as expected

Headers appear thrice sometimes though

[SindiBuklaji]

Tested on Ts1. It works as described. 👍