Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test Scenarios for Single config changes #1488

Open
4 tasks
bhanvimenghani opened this issue Jan 31, 2025 · 0 comments
Open
4 tasks

Test Scenarios for Single config changes #1488

bhanvimenghani opened this issue Jan 31, 2025 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@bhanvimenghani
Copy link
Contributor

bhanvimenghani commented Jan 31, 2025

Describe the feature

Test Scenario for Single model Single term config changes

A. /createExperiment api call

Model Test Case:

  1. Valid Input:
  • If input is “cost” → trigger cost model
  • If input is “performance” → trigger performance model
  • Input is case insensitive
  1. Invalid input:
  • If input is anything other than these eg. “abc” results in an error saying only cost and performance models support.
  1. Missing input/Empty input/Whitespaces only:
  • throw error msg
  1. Multiple models:
  • If input has multiple models, then it should say we support only single model

Term Test case:

  1. Valid inputs:
  • If input is “short” → trigger short term
  • If input is “medium” → trigger medium term
  • If input is “long” → trigger long term
  1. Invalid input:
  • If input is anything other than these eg. “abc” results in an error saying unsupported.
  1. Missing input/Empty/Whitespace:
  • throw error
  1. Multiple terms:
  • If multiple terms are mentioned then it should say we support only a single term

B./generateRecommendations api call

  • monitoring flow should work as it is.
  • If user chooses to specify the settings then we should provide everything as per the specification (even if this multi model / multi term requirement)
  • If mode is auto or recreate then check if settings are present or not, if not use defaults. If settings are present, check if they are single or multiple, show error in case of multiple settings. Single settings do as directed.
  • edge case test: If data is available till medium term, and user wants medium term details then it should not show short term recommendations even if they are available.
@bhanvimenghani bhanvimenghani added the enhancement New feature or request label Jan 31, 2025
@bhanvimenghani bhanvimenghani self-assigned this Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant