diff --git a/docs/tutorials/components_evaluation/localization_evaluation/localization-evaluation.md b/docs/tutorials/components_evaluation/localization_evaluation/localization-evaluation.md index 989f7df6f17..a0958736a40 100644 --- a/docs/tutorials/components_evaluation/localization_evaluation/localization-evaluation.md +++ b/docs/tutorials/components_evaluation/localization_evaluation/localization-evaluation.md @@ -1,4 +1,4 @@ -## Introduction +### Introduction #### Related Links @@ -36,19 +36,19 @@ You can find the data collected for testing and mapping in this [PR document](ht 1.) Firstly, it is aimed to detect the points where the localization is completely broken and to roughly control the localization. 2.) By extracting the metrics, it is aimed to see concretely how much the localization error has increased and what the level of performance is. -## How to Reproduce Tests +### How to Reproduce Tests -### Test With Raw Data +#### Test With Raw Data If you test with raw data, you need to follow these `Test With Raw Data` instructions. Since you need to repeat all preprocessing operations on the input data in this test, you need to test by switching to the test branches in the sensor kit and individual params repos. You can perform these steps by following the instructions below. -#### Installation +##### Installation 1.) Download and unpack a test map files. - You can also download [the map](https://drive.google.com/file/d/1WPWmFCjV7eQee4kyBpmGNlX7awerCPxc/view?usp=drive_link) manually. -``` +```bash mkdir ~/autoware_ista_map gdown --id 1WPWmFCjV7eQee4kyBpmGNlX7awerCPxc -O ~/autoware_ista_map/ ``` @@ -61,16 +61,16 @@ gdown --id 1WPWmFCjV7eQee4kyBpmGNlX7awerCPxc -O ~/autoware_ista_map/ - You can also download [the rosbag file](https://drive.google.com/file/d/1af-ccDi1-44KNYx3zCpQsn2QYnOkptoE/view?usp=sharing) manually. -``` +```bash mkdir ~/autoware_ista_data gdown --id 1af-ccDi1-44KNYx3zCpQsn2QYnOkptoE -O ~/autoware_ista_data/ ``` -#### Prepare Autoware to Test +##### Prepare Autoware to Test 1.) Checkout autoware_launch: -``` +```bash cd ~/autoware/src/launcher/autoware_launch/ git remote add autoware_launch https://github.com/meliketanrikulu/autoware_launch.git git remote update @@ -79,7 +79,7 @@ git checkout evaluate_localization_issue_7652 2.) Checkout individual_params: -``` +```bash cd ~/autoware/src/param/autoware_individual_params/ git remote add autoware_individual_params https://github.com/meliketanrikulu/autoware_individual_params.git git remote update @@ -88,7 +88,7 @@ git checkout evaluate_localization_issue_7652 3.) Checkout sample_sensor_kit_launch: -``` +```bash cd ~/autoware/src/sensor_kit/sample_sensor_kit_launch/ git remote add sample_sensor_kit_launch https://github.com/meliketanrikulu/sample_sensor_kit_launch.git git remote update @@ -97,36 +97,36 @@ git checkout evaluate_localization_issue_7652 4.) Compile updated packages: -``` +```bash cd ~/autoware colcon build --symlink-install --packages-select sample_sensor_kit_launch autoware_individual_params autoware_launch common_sensor_launch ``` -#### Launch Autoware +##### Launch Autoware -``` +```bash source ~/autoware/install/setup.bash ros2 launch autoware_launch logging_simulator.launch.xml map_path:=~/autoware_ista_map/ vehicle_model:=sample_vehicle sensor_model:=sample_sensor_kit ``` -#### Run Rosbag +##### Run Rosbag -``` +```bash source ~/autoware/install/setup.bash ros2 bag play ~/autoware_ista_data/rosbag2_2024_09_11-17_53_54_0.db3 ``` -### Localization Test Only +#### Localization Test Only If you only want to see the localization performance, follow the `Localization Test Only` instructions. For those who only want to perform localization tests, a second test bag file and a separate launch file have been created for this test. You can perform this test by following the instructions below. -#### Installation +##### Installation 1.) Download and unpack a test map files. - You can also download [the map](https://drive.google.com/file/d/1WPWmFCjV7eQee4kyBpmGNlX7awerCPxc/view?usp=drive_link) manually. -``` +```bash mkdir ~/autoware_ista_map gdown --id 1WPWmFCjV7eQee4kyBpmGNlX7awerCPxc -O ~/autoware_ista_map/ ``` @@ -139,16 +139,16 @@ gdown --id 1WPWmFCjV7eQee4kyBpmGNlX7awerCPxc -O ~/autoware_ista_map/ - You can also download [the localization rosbag file](https://drive.google.com/file/d/1yEB5j74gPLLbkkf87cuCxUgHXTkgSZbn/view?usp=sharing) manually. -``` +```bash mkdir ~/autoware_ista_data gdown --id 1yEB5j74gPLLbkkf87cuCxUgHXTkgSZbn -O ~/autoware_ista_data/ ``` -#### Prepare Autoware to Test +##### Prepare Autoware to Test 1.) Checkout autoware_launch: -``` +```bash cd ~/autoware/src/launcher/autoware_launch/ git remote add autoware_launch https://github.com/meliketanrikulu/autoware_launch.git git remote update @@ -157,26 +157,26 @@ git checkout evaluate_localization_issue_7652 2.) Compile updated packages: -``` +```bash cd ~/autoware colcon build --symlink-install --packages-select autoware_launch ``` -#### Launch Autoware +##### Launch Autoware -``` +```bash source ~/autoware/install/setup.bash ros2 launch autoware_launch urban_environment_localization_test.launch.xml map_path:=~/autoware_ista_map/ ``` -#### Run Rosbag +##### Run Rosbag -``` +```bash source ~/autoware/install/setup.bash ros2 bag play ~/autoware_ista_data/rosbag2_2024_09_12-14_59_58_0.db3 ``` -## Test Results +### Test Results #### Test 1: Simple Test of Localization @@ -190,7 +190,7 @@ From this point on, we move on to the bridge scenario. This is one of the bridge After this part there is another tunnel(Kagithane - Bomonti) and localization behaves similar to Eurasia tunnel . However, at the exit of this tunnel, it recovers localization on its own without the need for re-initialization. -###### Test 1 Summary +##### Test 1 Summary In summary, the places where there was visible deterioration with our test route were the tunnels. This was already an expected situation. Apart from this, we anticipated that we could have problems on the bridges, but I could not observe any deterioration in the localization on the bridges. Of course, it is useful to remind you at this point that these tests were conducted with a single data. @@ -211,7 +211,7 @@ Ground Truth : In these tests, the post-processed GNSS / INS data was used as gr During these tests, I compared the NDT and EKF exposures with Ground Truth and presented the results. I am sharing the test results below as png. However, if you want to examine this data in more detail, I have created an executable file for you to visualize and take a closer look at. You can access this executable file from [here](https://drive.google.com/drive/folders/145QXl6wfV7IB9NS-PzFQtsNnxnAn6a9o?usp=sharing) Currently there is only a version that works on Ubuntu at this link, but I plan to add it for Windows as well. You need to follow these steps: -``` +```bash cd /your/path/show_evaluation_ubuntu ./pose_main ```