Web Interface
(→realsens camera) |
(→how to use the interface) |
||
Line 6: | Line 6: | ||
= how to use the interface= | = how to use the interface= | ||
− | 1. go to the | + | Go to the robots ip address, accessible as http://flexbot.local/ in the browser. |
+ | |||
+ | To the left we have the status panels, the top one is the status of ROS. It says connected if everything is right with ROS. Remember to refresh each time the robot boots or restarts. | ||
+ | The next panel is the mission status. This indicates what it is currently doing, like receiving mission, checking for syntax and so forth. The third panel is more in depth detail of what the robot is doing currently. For example could this be "1: mov 2". At last we have the start and stop bottom, it will automatically go back to idle when the mission is complete. | ||
+ | |||
+ | The "legs" tab is a table with the status of each leg. | ||
+ | |||
+ | The "Cameras" tab is 2 video feeds, one for color and one for depth. Keep in mind that the feed with depth is 16bit gray and thus JavaScript can't present it correctly so everything greater than 255 is getting rounded down to 255. | ||
+ | |||
+ | The "Mission" tab holds the mission text area where a new mission can be written and submitted or the current mission can be extracted. | ||
+ | |||
+ | |||
+ | |||
+ | == TODO == | ||
+ | Explain where to change things! | ||
=PUT IMAGE HERE= | =PUT IMAGE HERE= |
Revision as of 16:36, 30 January 2020
Contents |
Packages added/made for ROS
- ROSbridge (For connecting ROS to the local network)
- Realsense (For visual data as ROS topics)
- mission_pkg (Handles mission files)
- syntax_pkg (Checks mission for syntax errors when committing)
how to use the interface
Go to the robots ip address, accessible as http://flexbot.local/ in the browser.
To the left we have the status panels, the top one is the status of ROS. It says connected if everything is right with ROS. Remember to refresh each time the robot boots or restarts. The next panel is the mission status. This indicates what it is currently doing, like receiving mission, checking for syntax and so forth. The third panel is more in depth detail of what the robot is doing currently. For example could this be "1: mov 2". At last we have the start and stop bottom, it will automatically go back to idle when the mission is complete.
The "legs" tab is a table with the status of each leg.
The "Cameras" tab is 2 video feeds, one for color and one for depth. Keep in mind that the feed with depth is 16bit gray and thus JavaScript can't present it correctly so everything greater than 255 is getting rounded down to 255.
The "Mission" tab holds the mission text area where a new mission can be written and submitted or the current mission can be extracted.
TODO
Explain where to change things!
PUT IMAGE HERE
This is the how the basic structure is for the web interface.
TODO
Change launch lauch file name for camera.
Put in image for basic structure of the web interface.
make hard links to html relevant files
realsens camera
To start of with we run the following command to reconfigure it to ros melodic:
sudo apt install ros-melodic-ddynamic-reconfigure
After that we can follow the guide given here, but i'll write my approach below https://github.com/IntelRealSense/realsense-ros#step-3-install-intel-realsense-ros-from-sources
Here the commands used to download and install the ros package can be seen:
cd ~/flexbot_ws/src/ git clone https://github.com/IntelRealSense/realsense-ros.git cd realsense-ros/ git checkout `git tag | sort -V | grep -P "^\d+\.\d+\.\d+" | tail -1` cd ~/flexbot_ws
At last we build and source it using
catkin_make source ~/flexbot_ws/devel/setup.sh
To launch it use, remember to source or be in the right directory before launch
roslaunch realsense2_camera rs_flexbot.launch
roslibjs
Installing rosbridge
This library makes it possible to use ros commands with javascript over a chosen port. The first two lines goes to the source in the catkin workspace and creates a package for ros:
cd ~/flexbot_ws/src catkin_create_pkg robot_gui_bridge rosbridge_server
Next we install the rosbridge package
apt-get install ros-melodic-rosbridge-server
Now we create the launch file directory and the file used for launch
mkdir ~/flexbot_ws/src/robot_gui_bridge/launch touch ~/flexbot_ws/src/robot_gui_bridge/launch/websocket.launch
Now at last we write the the necessary launch commands into the file and source it so we can use it from any directory om this terminal:
echo '<launch> <include file="$(find rosbridge_server)/launch/rosbridge_websocket.launch"/></launch>' >> ~/flexbot_ws/src/robot_gui_bridge/launch/websocket.launch source ~/flexbot_ws/devel/setup.bash
To test if it works run and look for errors:
roslaunch robot_gui_bridge websocket.launch
Setting up the connection
First check if the following command gives multiple ip's if so find a way to extract the correct one:
hostname -I
Now to setup the client, which is the computer not on the robot, write the following 3 lines in your "~/.bashrc" script:
# write these inside ~/.bashrc export ROS_HOSTNAME='hostname -I' export ROS_IP="hostname -I" export ROS_MASTER_URI='http://flexbot.local:11311/'
Now to setup the server, which is the computer on the robot, write the following 2 lines in the "~/.bashrc" script:
# write these inside ~/.bashrc export ROS_IP=flexbot.local export ROS_MASTER_URI='http://flexbot.local:11311/'
finalizing the server
Install apache to be able to access remotely :
sudo apt install apache2
Now insert the desired HTML, CSS and javascript files into
/var/www/html/
At last create a script inside
/etc/network/if-up.d/
Which will be executed when connecting to a network. To ensure it not happening multiple times a flag is set when run the first time. The script can be seen in
/etc/network/if-up.d/robotAutoStart.sh
and has a hardlink file in ~/flexbot_ws to make it easily accessible
syntax package
Not much to say, the package files are located inside
~/flexbot_ws/src/syntax_pkg/
and it checks for valid syntax in the submitted code. If there is error it returns the error type and where. If successful it saves the code in
~/flexbot_ws/mission.txt
Furthermore to add new commands simply add the word and how many arguments it takes inside the struct declaration in the file:
~/flexbot_ws/src/include/cmds.h
and build the code again
mission package
The package files are located inside
~/flexbot_ws/src/mission_pkg/
This package hasn't got any specific use now since it at the moment only reads the mission, runs the corresponding function and returns what line it is running at the moment. It is possible to cancel a mission but not to pause and resume it.
TODO
Make the defined functions actually do things rather than only giving feedback to the user and implement new commands if desired.