Delete code, add benchmark report

ServiceNow · Oct 23, 2024 · e58696a · e58696a
1 parent 97b52ac
commit e58696a
Show file tree

Hide file tree

Showing 136 changed files with 8,811 additions and 14,395 deletions.
diff --git a/ATMBuildingClosedTask.html b/ATMBuildingClosedTask.html
diff --git a/ATMUnderPeriodicMaintenanceTaskWithConclusion.html b/ATMUnderPeriodicMaintenanceTaskWithConclusion.html
diff --git a/ATMUnderPeriodicMaintenanceTaskWithConclusionLessExplicit.html b/ATMUnderPeriodicMaintenanceTaskWithConclusionLessExplicit.html
diff --git a/ATMUnderPeriodicMaintenanceTaskWithoutConclusion.html b/ATMUnderPeriodicMaintenanceTaskWithoutConclusion.html
diff --git a/BoundedPredConstraintsBasedOnPredQuantilesTask.html b/BoundedPredConstraintsBasedOnPredQuantilesTask.html
diff --git a/CashDepletedinATMScenarioTask.html b/CashDepletedinATMScenarioTask.html
diff --git a/DecreaseInTrafficInPredictionTask.html b/DecreaseInTrafficInPredictionTask.html
diff --git a/DiffuseHorizontalIrradianceFromCloudStatus.html b/DiffuseHorizontalIrradianceFromCloudStatus.html
diff --git a/DirectNormalIrradianceFromClearsky.html b/DirectNormalIrradianceFromClearsky.html
diff --git a/DirectNormalIrradianceFromCloudStatus.html b/DirectNormalIrradianceFromCloudStatus.html
diff --git a/ElectricityIncreaseInPredictionTask.html b/ElectricityIncreaseInPredictionTask.html
diff --git a/ElectricityIncreaseInPredictionWithDistractorText.html b/ElectricityIncreaseInPredictionWithDistractorText.html
diff --git a/ElectricityIncreaseInPredictionWithDistractorWithDates.html b/ElectricityIncreaseInPredictionWithDistractorWithDates.html
diff --git a/ElectricityIncreaseInPredictionWithSplitContext.html b/ElectricityIncreaseInPredictionWithSplitContext.html
diff --git a/ExplicitDiffuseHorizontalIrradianceFromCloudStatus.html b/ExplicitDiffuseHorizontalIrradianceFromCloudStatus.html
diff --git a/ExplicitDirectNormalIrradianceFromCloudStatus.html b/ExplicitDirectNormalIrradianceFromCloudStatus.html
diff --git a/ExplicitPressureFromSpeedTask.html b/ExplicitPressureFromSpeedTask.html
diff --git a/ExplicitSimilarLocationDaySolarForecastTask.html b/ExplicitSimilarLocationDaySolarForecastTask.html
diff --git a/ExplicitTrafficForecastTaskwithHolidaysInPredictionWindow.html b/ExplicitTrafficForecastTaskwithHolidaysInPredictionWindow.html
diff --git a/ExplicitWithDatesAndDaysTrafficForecastTaskwithHolidaysInPredictionWindow.html b/ExplicitWithDatesAndDaysTrafficForecastTaskwithHolidaysInPredictionWindow.html
diff --git a/ExplicitWithDaysTrafficForecastTaskwithHolidaysInPredictionWindow.html b/ExplicitWithDaysTrafficForecastTaskwithHolidaysInPredictionWindow.html
diff --git a/FullCausalContextExplicitEquationBivarLinSVAR.html b/FullCausalContextExplicitEquationBivarLinSVAR.html
diff --git a/FullCausalContextImplicitEquationBivarLinSVAR.html b/FullCausalContextImplicitEquationBivarLinSVAR.html
diff --git a/GlobalHorizontalIrradianceFromClearsky.html b/GlobalHorizontalIrradianceFromClearsky.html
diff --git a/ImplicitPressureFromSpeedTask.html b/ImplicitPressureFromSpeedTask.html
diff --git a/ImplicitTrafficForecastTaskwithHolidaysInPredictionWindow.html b/ImplicitTrafficForecastTaskwithHolidaysInPredictionWindow.html
diff --git a/IncreasedWithdrawalScenario.html b/IncreasedWithdrawalScenario.html
diff --git a/LICENSE b/LICENSE
@@ -198,4 +198,4 @@
    distributed under the License is distributed on an "AS IS" BASIS,
    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    See the License for the specific language governing permissions and
-   limitations under the License.
+   limitations under the License.
diff --git a/LocaleInfoHalfDaySolarForecastTask.html b/LocaleInfoHalfDaySolarForecastTask.html
diff --git a/LongNewsElectricityIncreaseInPredictionTask.html b/LongNewsElectricityIncreaseInPredictionTask.html
diff --git a/MediumNewsElectricityIncreaseInPredictionTask.html b/MediumNewsElectricityIncreaseInPredictionTask.html
diff --git a/MinimalCausalContextBivarLinSVAR.html b/MinimalCausalContextBivarLinSVAR.html
diff --git a/MinimalInfoHalfDaySolarForecastTask.html b/MinimalInfoHalfDaySolarForecastTask.html
diff --git a/MontrealFireFieldAndGasConvincingToneExplicitCausalConfoundingTask.html b/MontrealFireFieldAndGasConvincingToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldAndGasConvincingToneImplicitCausalConfoundingTask.html b/MontrealFireFieldAndGasConvincingToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldAndGasNeutralToneExplicitCausalConfoundingTask.html b/MontrealFireFieldAndGasNeutralToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldAndGasNeutralToneImplicitCausalConfoundingTask.html b/MontrealFireFieldAndGasNeutralToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldAndTrashConvincingToneExplicitCausalConfoundingTask.html b/MontrealFireFieldAndTrashConvincingToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldAndTrashConvincingToneImplicitCausalConfoundingTask.html b/MontrealFireFieldAndTrashConvincingToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldAndTrashNeutralToneExplicitCausalConfoundingTask.html b/MontrealFireFieldAndTrashNeutralToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldAndTrashNeutralToneImplicitCausalConfoundingTask.html b/MontrealFireFieldAndTrashNeutralToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireFieldFireExplicitShortHistoryTask.html b/MontrealFireFieldFireExplicitShortHistoryTask.html
diff --git a/MontrealFireFieldFireImplicitShortHistoryTask.html b/MontrealFireFieldFireImplicitShortHistoryTask.html
diff --git a/MontrealFireIceRescueExplicitShortHistoryTask.html b/MontrealFireIceRescueExplicitShortHistoryTask.html
diff --git a/MontrealFireIceRescueImplicitShortHistoryTask.html b/MontrealFireIceRescueImplicitShortHistoryTask.html
diff --git a/MontrealFireNauticalRescueAnalogyFullLocalizationMaybeWaterTask.html b/MontrealFireNauticalRescueAnalogyFullLocalizationMaybeWaterTask.html
diff --git a/MontrealFireNauticalRescueAnalogyTargetLocalizationMaybeWaterTask.html b/MontrealFireNauticalRescueAnalogyTargetLocalizationMaybeWaterTask.html
diff --git a/MontrealFireNauticalRescueExplicitShortHistoryTask.html b/MontrealFireNauticalRescueExplicitShortHistoryTask.html
diff --git a/MontrealFireNauticalRescueImplicitShortHistoryTask.html b/MontrealFireNauticalRescueImplicitShortHistoryTask.html
diff --git a/MontrealFireTrashAndBicycleConvincingToneExplicitCausalConfoundingTask.html b/MontrealFireTrashAndBicycleConvincingToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashAndBicycleConvincingToneImplicitCausalConfoundingTask.html b/MontrealFireTrashAndBicycleConvincingToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashAndBicycleNeutralToneExplicitCausalConfoundingTask.html b/MontrealFireTrashAndBicycleNeutralToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashAndBicycleNeutralToneImplicitCausalConfoundingTask.html b/MontrealFireTrashAndBicycleNeutralToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashAndNauticalConvincingToneExplicitCausalConfoundingTask.html b/MontrealFireTrashAndNauticalConvincingToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashAndNauticalConvincingToneImplicitCausalConfoundingTask.html b/MontrealFireTrashAndNauticalConvincingToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashAndNauticalNeutralToneExplicitCausalConfoundingTask.html b/MontrealFireTrashAndNauticalNeutralToneExplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashAndNauticalNeutralToneImplicitCausalConfoundingTask.html b/MontrealFireTrashAndNauticalNeutralToneImplicitCausalConfoundingTask.html
diff --git a/MontrealFireTrashFireExplicitShortHistoryTask.html b/MontrealFireTrashFireExplicitShortHistoryTask.html
diff --git a/MontrealFireTrashFireImplicitShortHistoryTask.html b/MontrealFireTrashFireImplicitShortHistoryTask.html
diff --git a/OraclePredUnivariateConstraintsTask.html b/OraclePredUnivariateConstraintsTask.html
diff --git a/README.md b/README.md
@@ -1,11 +1,11 @@
 # Context is Key: A Benchmark for Forecasting with Essential Textual Information
 
-This codebase supports the following paper:
+This repository hosts the benchmark visualization website at **https://context-is-key-forecasting.github.io/** supporting the following paper:
 
 **Context is Key: A Benchmark for Forecasting with Essential Textual Information**.
 
 Preprint (2024).
-_Andrew Robert Williams, Arjun Ashok, Étienne Marcotte, Valentina Zantedeschi, Jithendaraa Subramanian, Roland Riachi, James Requeima, Alexandre Lacoste, Irina Rish, Nicolas Chapados, Alexandre Drouin_. 
+_Andrew Robert Williams*, Arjun Ashok*, Étienne Marcotte, Valentina Zantedeschi, Jithendaraa Subramanian, Roland Riachi, James Requeima, Alexandre Lacoste, Irina Rish, Nicolas Chapados, Alexandre Drouin_.
 
 
 > Forecasting is a critical task in decision making across various domains. While numerical data provides a foundation, it often lacks crucial context necessary for accurate predictions. Human forecasters frequently rely on additional information, such as background knowledge or constraints, which can be efficiently communicated through natural language. However, the ability of existing forecasting models to effectively integrate this textual information remains an open question. 
@@ -18,4 +18,4 @@ The benchmark can be visualized at https://anon-forecast.github.io/benchmark_rep
 
 ## License
 
-This code is released under an Apache-2 license. Please see [terms](./LICENSE).
+This code is released under an Apache-2 license. Please see [terms](./LICENSE).
diff --git a/SensorMaintenanceInPredictionTask.html b/SensorMaintenanceInPredictionTask.html
diff --git a/SensorPeriodicMaintenanceTask.html b/SensorPeriodicMaintenanceTask.html
diff --git a/SensorSpikeTask.html b/SensorSpikeTask.html
diff --git a/SensorTrendAccumulationTask.html b/SensorTrendAccumulationTask.html
diff --git a/ShortNewsElectricityIncreaseInPredictionTask.html b/ShortNewsElectricityIncreaseInPredictionTask.html
diff --git a/SimilarLocationDaySolarForecastTask.html b/SimilarLocationDaySolarForecastTask.html
diff --git a/SimilarLocationWithReferenceDaySolarForecastTask.html b/SimilarLocationWithReferenceDaySolarForecastTask.html
diff --git a/SpeedFromLoadTask.html b/SpeedFromLoadTask.html
diff --git a/UnemploymentCountyUsingExplicitMultipleStateData.html b/UnemploymentCountyUsingExplicitMultipleStateData.html
diff --git a/UnemploymentCountyUsingMultipleStateData.html b/UnemploymentCountyUsingMultipleStateData.html
diff --git a/UnemploymentCountyUsingSingleStateData.html b/UnemploymentCountyUsingSingleStateData.html
diff --git a/ZenithInfoHalfDaySolarForecastTask.html b/ZenithInfoHalfDaySolarForecastTask.html
diff --git a/cik/__init__.py b/cik/__init__.py
diff --git a/cik/base.py b/cik/base.py
diff --git a/cik/baselines/__init__.py b/cik/baselines/__init__.py