Difference between revisions of "S19: Tech Savy"

• Create and establish GitLab repository
• Establish slack channel and invite Preet
• Look through previous years projects and study it
• Distribute major roles among team members

• Create a Bill of Materials.
• Select and order an RC car.
• Make Repo on Gitlab for all modules - Follow Naming Convention.

• Select Part Number for Sensors (Halak, Aakash)
• Designing and deciding PCB tool(Prashant, Vatsal)
• Finalizing GPS module by doing some research (Vidushi)
• Finalize and order LCD (Aakash, Vidushi)
• Finalize Motor and Order it (Vatsal)
• Environmental setup of Android (Saumil, Akshata)

• Understand DBC and implement the DBC file compatible with all the controllers.
• Test motor driving in different situations, begin to listen to CAN for controls.
• Establish communication across all the CAN controllers over CAN bus based on the DBC file.
• Verify the power-up interactions and configurations between Master and the other controllers.
• 03/26/2019 DBC File
• 03/26/2019 DEMO: CAN communication between controllers.

• Check and Resolve power issue for RC Car.
• Finalize high-level system block diagram and control scheme.
• Circuit Simulation in Diptrace Tool.
• PCB Layout Design in Diptrace Tool.
• Finalize Components placement on PCB.
• Establish a connection over Bluetooth and Android app.
• Establish a communication between Bluetooth devices.
• Interfacing of ultrasonic sensors to the SJOne board and check for basic functionality.
• Interface and get the reading of Lidar sensor with SJOne over UART.
• Chalk out the Message IDs based on the priority of the messages and the data to be sent across nodes.
• Interface of Servo & DC motor to the SJOne board and check for basic functionality.
• Interface Compass module with SJOne board using I2C serial bus.
• Interface bluetooth HC-05 module with SJOne board using serial Communication.
• Configure bluetooth HC-05 module name as Tech Savy using HC-05 Communication Mode.
• Explore UI designing of LCD.
• Finish motor controller API. Test motor driving in different situations, begin to listen to CAN for controls.
• Add a TextView for displaying the Bluetooth connection status in Android App.

• Parse data of Lidar Sensor depending on distance and angle and send it to master using dbc.
• Implement basic obstacle avoidance algorithm based on sensor data and test the same.
• Continue testing motor driver via commands from CAN bus.
• Build in speed steps to reverse motor for reverse to work correctly.
• Mount all the sensors and test for any dead band and modify their positions for maximum coverage.
• Integrate the fusion of LIDAR and Ultrasound sensor to get overall feedback from all the directions.
• Develop algorithm to avoid obstacles and plan the car's further navigation path.
• Complete final prototype of the obstacle avoidance feature.
• Calibrate Compass Module. Develop code for Compass module communication over CAN.
• 16 April 2019 DEMO: Motors driven by wheel feedback and sensors, Basic obstacle avoidance.
• Final Wiki Schedule.

• Configure GPS device baud rate and interface it with SJOne board using UART.
• Send and receive current location, destination and checkpoint coordinates to and from App and Geo module via BRIDGE.
• Calibrate sensors readings and work on filtering algorithm with Master & Sensor
• Begin work on LCD to show vehicle live status(speed, fuel-status, obstacles, distance to destination etc.) in a GUI.
• Finish implementing speed control on motor (to make sure requested speed is met based on RPM read).
• Work on Car reversing using Motor Controllers.
• Integrate all modules with the Master to test the data flow.
• Validation & Verification of obstacle avoidance, steering logic with rear sensor inputs and reversing.
• Start incorporating GEO Controller information to Master module Steering logic.
• Decide, implement and test data exchange between Geo Controller and BRIDGE.
• Calculate and send simple bearing angle and destination status on CAN to figure out initial challenges.
• Add a Google Map for setting the car's destination.
• Send car location to app and check points received to Geo module.
• Verify the stringent requirement of Start-up Sync, Periodic heart-beat messages.
• Update Wiki Schedule with Test Reports.

• Testing & Validation of the LCD UI and display run time vehicle status and looking forward for feedback from team if any.
• Improve & Validate Navigation logic with multiple checkpoints, bearing angle and destination information.
• Identify and mitigate GPS locking, Location Accuracy and Number of Satellite-In-View coming.
• Validate Accuracy of Compass Calibration with iPhone Compass.
• Determine and add DBC Changes and finalized.
• Implement the steering logic with bearing angle and status provided by GEO-Module.
• Consistently Communicate current car location to App, get check points from App and relay them to Geo module.
• Send additional vehicle status information from can bus to the App for display.
• Send the request to Google for getting the checkpoints(use the Google Maps Directions API).
• Field test and check for obvious issues in obstacle avoidance, navigation, maintaining speed (up/down hill).
• Provide feed backs to each team on identified short comings.
• Update Wiki with new details and information.
• DEMO: GPS driving

• FIELD TESTING - CRITICAL WEEK
• Implement turning indicators, break lights and head light.
• Check for Corner cases for steering logic under various conditions and locations.
• Analyse field test results for GPS and CMPS and work on it if required.
• Test the accuracy of check-points from the Blue-tooth controller, location data from the Geo-controller sensor and Navigation Algorithm.
• Check overall robustness of the complete system.
• Establish complete connection on PCB
• Update wiki with details.

• All hands on testing and final bug fixes.
• Check for tuning or calibration of modules if required.
• Complete end-to-end testing for various scenarios and conditions.
• Create the semester long project activity video and upload to YouTube.
• Update and finalize wiki.

• DEMO: Final Project
• SUBMISSION: Final Project Wiki

• Micro-Controller Eval-Boards

• LPC 1758 (Purchased from Preet Kang)

• 5

• 80.00

• RC Car

• Traxxas 1/10 Slash 2WD RTR with 2.4GHz Radio

• 1

• 205.99

• Lithium-Ion Battery

• Traxxas 7600mAh 7.4V 2-Cell 25C LiPo Battery

• 1

• 74.95

• Lithium-Ion Battery 2

• Traxxas 2872X 5000mAh 11.1V 3S 25C LiPo Battery

• 1

• 69.95

• RC Car Battery Charger

• Amazon Traxxas 2970 EZ-Peak Plus 4-Amp NiMH/LiPo Fast Charger

• 1

• 49.95

• Bluetooth Breakout Board

• Bluetooth Module HC-05

• 1

• 8.49

• RC Car Display

• 4D systems 4D systems LCD Display

• 1

• 79.00

• Ultrasonic Sensors

• LV Maxsonar EZ0 & Ultrasonic sensors

• 2

• 30.00

• RP-LIDAR Sensor

• LIDAR Sensor

• 1

• 99.00

• GPS Antenna

• Amazon

• 1

• 5.00

• CAN Transreceivers

• Microchip Samples

• 20

• FREE

• Compass

• DFRobot CMPS11 Compass

• 2

• 30.00

• RPM Sensor

• Amazon RPM Sensor

• 1

• 10.00

• GPS Breakout Board

• Amazon GPS Module

• 1

• 43.00

• PCB parts and other Miscellaneous parts

• Anchor Electronics and Digikey

• 1

• 130.00

• PCB Fabrication

• JLCPCB

• 5

• 29.53

• D1

• D2 MOTOR

• D3 MOTOR

• D4 MOTOR

• D5 MOTOR

• D6 BRIDGE

• D7 BRIDGE

• D8 GPS

• D9 GPS

• D10 GPS

• D11 SENSOR

• D12 SENSOR

• D13 SENSOR

• D14 SENSOR

• D15 SENSOR

• D16 MASTER

• D17 MASTER

• D18 MASTER

• D19 MASTER

• D1

• D2 MOTOR

• D3 MOTOR

• D4 MOTOR

• D5 MOTOR

• D6 BRIDGE

• D7 BRIDGE

• D8 GPS

• D9 GPS

• D10 GPS

• D11 SENSOR

• D12 SENSOR

• D13 SENSOR

• D14 SENSOR

• D15 SENSOR

• D16 MASTER

• D17 MASTER

• D18 MASTER

• D19 MASTER

Compass Mount

Since we needed to keep the Compass sensor away from DC Motor's interference, we decided to keep the compass at certain height above the PCB. So we used 3D printing to print the support plate with the mounting holes of same dimension as M3X10 screw standoffs.

Sensor Node

We used 2 sensor modules to achieve accurate and reliable obstacle avoidance system.
1. Lidar - Main controller to detect obstacle. Giving 360-degree view with a range up to 6 meters in distance.

• RPLidar works on a mechanism known as laser triangulation ranging principle. The system measures distance data in more than 2000 times’ per second and with high-resolution distance output. RPLIDAR emits modulated infrared laser signal and the laser signal is then reflected by the object to be detected. The returning signal is sampled by vision acquisition system in RPLIDAR A1 and the DSP embedded in RPLIDAR starts processing the sample data and output distance value and angle value between object and RPLIDAR A1 through the communication interface.
  

Lidar Working Schematic

2. Ultrasonic Sensor (Maxbotix LV-MaxSonar-EZ0) - One Ultrasonic sensor with a maximum range of 600 cm was used to detect very small objects at the front that Lidar might miss because of it's leveled placement.

ultrasonic beam

• Ultrasonic sensor uses a high-frequency beam to detect an object. It first throws light and reads the time taken for light to receive back, depending on the time calculated, it identifies the obstacle. It calibrates after it's first to read cycle, then it can continuously read data of light. The beam depending on the range is shown in figure.
  

Sensor Node Code

GitLab link to Sensor Code

Hardware Design

• The Lidar is communicating with SJOne board through UART, we have used UART 2 here as shown in Pin config below.
  
• Ultrasonic Sensor is simple Interrupt based, hence it connected through GPIO pins of SJOne board as shown in diagram.
  

Sensor Pin connection

• Figure shows the usage of 4 LEDS and LCD display to notify us the position of obstacle.
  

LED indication

LCD screen showing the value of track of obstacle at respective direction

Implementation

Ultrasonic

LV Maxsonar ultrasonic sensor is used at the very front of the RC car to provide wide range sonar detection ranging from 0 to 645 cm. It supports LiDAR sensor to detect very small obstacles like stone that can hinder car from moving forward. so we have purposefully mounted it at a lower level than LiDAR.

LiDAR

RPLidar works on UART. We have used UART 2 of SJOne Board to establish communication between them.

• Figure shows the several operation provided by RPLidar for better performance and reliable data.
  

Various Operations of RPLidar

Algorithm to establish communication through UART

• In order to start the scanning of Lidar, first send the 0X20 via uart2.putchar(0x20). Before that, we can check the health status of RPLidar by sending 0x52. It waits for some time (timeout = 500ms), and if return status is not true throws error indicating Lidar is not initialized properly and hence it gets reset.
  

• As soon as correct scan command is received by Lidar, it starts sending data frames continuously on UART. The frame consists of 5 bytes including the start bit, Angle, quality and distance, which are useful to identify the exact position of obstacle.
  

• This data is processed and divided into tracks of 25 cm each.
  

• By looking at the track, we choose the sector value which depends on angle detected. Below figure shows the division of angle for respective sector value.
  

Figure shows the division of angles

• The obstacle information is sent to Master Node through CAN.
  

Software Design

Ultrasonic

• It works with the help of interrupt.
• After configuring GPIO pins as RX and TX, set RX pin high.
• PW pin gets the input, identify the type of interrupt
  • Rising edge interrupt.
  • Falling edge interrupt
• Calculate distance to obstacle,
  • ultrasonic_data.distance = (stop_time - start_time)/147;

LiDAR

Below diagram shows the code flow of sensor module. A separate task was used to send sensor data over CAN, which continuously sends data in while(1) loop.

CAN DBC Messages Send from Sensor

  BO_ 105 SENSOR_NODE: 5 SENSOR
   SG_ SENSOR_FRONT_cm : 0|10@1+ (1,0) [0|645] "cm" MASTER,MOTOR,BRIDGE
   SG_ LIDAR_Obstacle_FRONT : 10|3@1+ (1,0) [0|0] "" MASTER,MOTOR,BRIDGE
   SG_ LIDAR_Obstacle_RIGHT : 13|3@1+ (1,0) [0|0] "" MASTER,MOTOR,BRIDGE
   SG_ LIDAR_Obstacle_LEFT : 16|3@1+ (1,0) [0|0] "" MASTER,MOTOR,BRIDGE
   SG_ LIDAR_Obstacle_BACK : 19|3@1+ (1,0) [0|0] "" MASTER,MOTOR,BRIDGE
   SG_ LIDAR_Obstacle_BACK_RIGHT : 22|3@1+ (1,0) [0|0] "" MASTER,MOTOR,BRIDGE
   SG_ LIDAR_Obstacle_BACK_LEFT : 25|3@1+ (1,0) [0|0] "" MASTER,MOTOR,BRIDGE

LED Blinking signals for SENSOR CONTROLLER ON CAR

* RED LED ON: MASTER HEARTBEAT STATUS on CAR
* BLUE LED ON: Obstacle detected at front of CAR
* Rightmost GREEN LED ON: Obstacle detected at right of CAR
* YELLOW LED ON: Obstacle detected at back of CAR
* Leftmost GREEN LED ON: Obstacle detected at left of CAR.

Technical Challenges

Ultrasonic

• When mounted initially on CAR, ultrasonic was giving sometimes faulty readings as it was detecting ground as and obstacle.
  • We designed a 3D mount for it and adjusted it on such a angle that it gives perfect readings.
• Initialization issue: Sometimes on power-up we noticed that Ultrasonic sensor was giving faulty readings(it was getting stuck on some fixed value).
  • After reading the datasheet accurately, I found that it calibrates itself during the first read cycle and so the obstacle should be at least 14 inches far from the sensor.
• Ultrasonic Failure - When the CAR got crashed, Ultrasonic sensor failed and started giving incorrect data.
  • We replaced it's wired to get it working.
    

LiDAR

• Identifying obstacle data and separating it.
  • Initially I lost a lot of time in figuring out the data frame as it consists of quality, angle, distance and start bit.
  • Dividing the frame bits appropriately and storing it separately in struct variables resolved the issue. Also after that depending on the angle, every 360 times data was fetched in a loop to cover each and every angle value.
• Task overrun because of receiving a large number of data continuously over UART.
  • Used a separate task, that receives data continuously in a loop, i.e while(1).
  • Instead of receiving whole data in a single frame, took data character by character in a for loop 360 times, to get the value of obstacle at each degree.
• Angle detection problem - When large angles were taken, for example, 30 degrees on the right, it was detecting nearer objects correctly but far objects were getting detected in some other range (for example in front instead of right) of angle because of angle spread. I divided the range into 10 degrees each and store it in the same variable to send it over CAN.
  For example, to get 30 degrees in right, 0-10,10-20 & 20-30 values are taken.
• Received variable initialization problem.
  • I didn't initialize the character variable to get data from UART to 0 and hence it was taking garbage value.
    Thanks to Preet, at time of my code review he pointed out this problem and later I checked it with Unit Testing.
• Some bugs here and there in the code.
  • I identified and resolved a few bugs after Unit testing the code.
• Delay in sending data because of large CAN buffer size.
  • We were facing this issue with master, motor and sensor communication. The response time was slow as data was getting accumulated before sending because of large buffer size taken.

Motor Controller

Motor Controller is responsible to control the DC and Servo Motor, RPM Sensor measurements and LCD control. The motor control logic controls the steering and the speed of the vehicle using a servo and DC motor respectively based on the CAR_CONTROL_t CAN message from the master. It takes input from RPM sensor as a feedback for maintaining a constant speed and based on the RPM sensor reading, a PID loop calculates duty-cycle for PWM signal which are then given to DC motor. Based on other can messages from the sensor controller, geo controller and bridge controller, motor controller processes and communicates the information to the LCD by refreshing the data periodically in 10Hz function.

Hardware Design

The hardware interface details of MOTOR Module with SJOne board are given below:

RPM Sensor, DC and Servo Motor Hardware Interfacing

LCD Hardware Connections

Hardware Interface

Electronic Speed Controller (ESC)

We made use of the Traxxas ESC XL-05 which comes with the RC car. ESC stands for Electronic Speed Control. It is used to control the DC motor using PWM signals from the controller. It powers up when we connect a LiPo or NiMH battery of 7.4v. The ESC has a dc-to-dc converter which converts 7.4v to 6v and provides it to DC motor. It can provide high current to the power hungry DC motors running at faster speeds. It has an LED and a button which is used for calibration and setting different modes for the car.

Traxxas ESC XL5

DC Motor

Traxxas DC Motor

The DC motor is controlled using the ESC which get PWM pulses for controlling it. A PWM signal wire is connected to the microcontroller and the required current is provided by the LiPo battery and the ESC.

The DC motor is controlled using PWM at 100Hz.

NOTE: Before using the Traxxas ESC to give PWM signal to DC motor calibrate it by going to this website:

https://traxxas.com/support/Programming-Your-Traxxas-Electronic-Speed-Control

The ESC must be given a pulse of 1.5ms when we turn it on or else the DC motor won't respond to PWM pulses.

Step 1: Give 2.00ms on-time pulses when LED blinks red once.

Step 2: Give 1.50ms on-time pulses when LED blinks red twice.

Step 3: Give 1.00ms on-time pulses and the LED color changes from red to green showing that the calibration was successful.

Servo Motor

Traxxas Servo Motor

The direction the vehicle's front wheels turn is dependent on the servo motor in the vehicle. Based on various PWM signals, the servo steers the front wheels of the vehicle in the left and right direction. The servo has 3 wires of which one is for the PWM input signal whereas the other two are to power up the servo. We powered our servo motor using the 6v power supply from the battery elimination circuit present in the ESC so that a single switch to turn on and off both the servo and DC motor. PWM signals to control the servo is provided by the motor controller. Based on the PWM signal from the SJOne board, the shaft shall be rotated to a certain degree left or right

RPM Sensor

Traxxas Speed Sensor

RPM sensor is used as a feedback element in the PID to maintain a constant speed of the vehicle. The RPM sensor mounts on the rear DC motor shaft compartment with a special assembly also provided by Traxxas. We make use of one magnet and we get one pulse on one wheel rotation The sensor works on the hall effect principle where it provides a current across its terminal when placed in a magnet's field. These pulses are read by the SJOne board and fed to the speed control algorithm. The RPM sensor has 3 wires, the white where are the output wire that provides the pulses to the SJone board and the other wires power the sensor.

Implementation

1. The idea is that every time the motor completes 1 whole revolution, it reaches very close to the sensor. And when the sensor detects the magnet nearby, it sends out a high pulse until the magnet moves away from it. Therefore, upon detecting the X number of a rising edge in Y seconds we can say that rpm was X revolutions/Y seconds.
2. During our initial testing of RPM Sensor with SJOne board, we saw that regardless of whether we bring the magnet close to the sensor or not, the signal voltage was always high. After some trail and errors, we found out that the signal pin(white wire) had to be connected to the VCC(red wire) across a 1K resistor which can act as weak pull down when it detects the magnet.

uLCD32-PTU

uLCD32-PTU by 4D systems has a 3.2" TFT LCD Display module. The module comes with a display resolution of 240x320 pixels. 4D Systems provides a programming cable based on UART for burning the LCD code to the module. The project is burnt to a uSD card which is used for display during booting of the LCD. It is recommended that we use the programming adapter provided by 4D systems as it has a special reset button that can be used to download the built project to the LCD display.Once the LCD display was configured with different widgets and screens, the motor module was coded to display information in LCD through UART. Workshop4 IDE was used to program the GUI, and data was transmitted from the SJOne board through UART communication. The LCD displays the main menu screen with options of all the modules: Sensor, Motor, Bridge, GPS, Compass and MIA information.

These modules represent the page numbers of the display whose information can be found from the pre-processed data format of the LCD.This data format contains the following fields:

• The write command
• Type of the object
• Object ID
• MSB and LSB values to be displayed in the LED.
• The last pair of hex value is for checksum.

The following figure shows the programming cable and the pins used for uLCD32-PTU.

LCD connections

Software Design

The dc motor and servo motor operation is fundamentally based on PWM (Pulse Width Modulation). We set the PWM frequency to 100Hz for both dc and servo motor.

Pseudo code for initializing PWM to 100Hz.

PWM *motor_control;     //pointer object defined globally
PWM *servo_control;
void init_pwm(long unsigned int freq) {
    motor_control = new PWM(PWM::pwm1, freq);      // using PWM constructor to initialize the PWM 2.0 pin to desired frequency
    servo_control = new PWM(PWM::pwm2, freq);
}

DC Motor

The DC motor is connected to pin P2.0 on SJONE board. The DC motor is commanded every 100ms to change or maintain its speed or direction(FORWARD, REVERSE and STOP). A switch case is used to check the command that we are receiving over CAN bus from master.

Pseudo code for dc motor and speed control

float speed = get_speed();
float _error = calculate_error_PID(drive_forward->MOTOR_mps, speed, &dc_motor);
*PWM_percent += _error
set_pwm_value(motor_1, *PWM_percent);

Servo Motor

The Servo motor is connected to pin P2.1 on SJONE board. The servo motor is commanded every 10ms to change or maintain its angle between 0 and 180 degrees. We receive angle in the range of -90(full left), 0(neutral) and +90(full right) from master. The calculate PWM_duty_cycle_servo function maps the angle received from master to PWM signal and rotates the servo motor accordingly.

Pseudo code for servo motor and angle calculation

on_time = 10 + ((servo->MOTOR_STEER_cmd + 90) * (10/180));
set_pwm_value(servo_2, on_time);

RPM Sensor

The RPM sensor is connected to pin P2.6 of SJONE board. When the wheel rotates once we get one pulse. We make use of interrupt to register these pulses in a 400ms time frame and then calculate the speed in m/s based on the formula:

speed_m_per_sec = (circumference * rotation_per_sec) / (constant);

After every 400ms we reset the pulse counter. We have an ISR which increments these pulses.

void eint3_handler(void){
    pulse++;
}

LED Blinking signals for MOTOR CONTROLLER

• RED LED ON: MASTER HEARTBEAT STATUS on CAR
• BLUE LED ON: Car is moving in reverse direction
• YELLOW LED ON: Car is stopped
• GREEN LED ON: Car is moving in forward direction

LCD Software Flow Chart

LCD Software Flowchart: 1Hz Task

Programming SJONE Board for LCD Display

• As raw data often cannot be displayed on the LCD directly, the values to be displayed had to be converted to appropriate byte-sized values.
• Communication with SJOne board was established at the baud rate of 115200 bps.
• Commands for writing data and reading acknowledgment for various gauges were coded in the SJ1 board.

Creating a project using Workshop 4 IDE and programming the LCD display

• After finalizing the design of the LCD's layout, a genie project was created using Workshop 4.
• The layout was split into different forms (pages) and appropriate buttons and gauges were added for display.
• uLCD-32PTU was programmed with the help of programming cable provided by 4D systems.

The steps taken for interfacing the LCD display with the SJONE board is shown on the right:

Each of the reading is considered as a object with the object type ID and object number. Below are the list of objects used for lcd.

#define GPS_DEST_LATITUDE_OBJ        0
#define GPS_DEST_LONGITUDE_OBJ       1
#define GPS_CURRENT_LATITUDE_OBJ     2
#define GPS_CURRENT_LONGITUDE_OBJ    3
#define GPS_HEADING_OBJ              13
#define GPS_BEARING_OBJ              14
#define GPS_DISTANCE_OBJ             3
#define MOTOR_SPEED_MS_OBJ           8
#define MOTOR_PWM_OBJ                12
#define MOTOR_RPM_OBJ                4
#define MOTOR_TURNING_ANGLE_OBJ      9
#define MOTOR_DISTANCE_COVERED_OBJ   10
#define MOTOR_DISTANCE_LEFT_OBJ      11

So our approach was to send a LCDquery at 1Hz task using the below function.

void lcd_screen_query(void)
{
   char comm[] = {0, 0x0a, 0, 0x0a};
   for (int i = 0; i < (int)sizeof(comm); i++)
   {
       uart3_put_char(comm[i], 0);
   }
}

This query sends a a array of character to LCD and LCD acknowledges it and sends the pre-formated data to the controller using lcd_receive() called at every 10Hz. The receive() will contain the page number(lcd_screen) based on the screen it is currently into and prints the data corresponding to that screen i.e. GPS screen will call GPS_print function to print the GPS values.

void lcd_print()
{
   switch (lcd_screen)
   {
       case menu:
           lcd_print_menu_screen();
           break;
       case bridge:
           lcd_print_bridge_screen();
           break;
       case gps:
           lcd_print_gps_screen();
           break;
       case sensor:
           lcd_print_sensor_screen();
           break;
       case motor:
           lcd_print_motor_screen();
           break;
       case home:
           lcd_print_home_screen();
           break;
       case mia:
           lcd_print_mia_screen();
           break;
       case compass:
           lcd_print_compass_screen();
           break;
       default:
           break;
   }
}

LCD Screens

Main Screen

Module Selection Screen

MOTOR Screen

Sensors Screen

MID Status Screen

GPS Screen

Compass Screen

Bluetooth Screen

Flow charts

Technical Challenges

PWM frequency setting problem

The PWM frequency won't set if we were making use of global objects directly using the SJONE PWM drivers. We verified using logic analyzer that our frequency was getting set to 1.19KHz instead of 100Hz.

PWM motor_control(PWM::pwm1, freq);
PWM servo_control(PWM::pwm2, freq);

Solution: After trying out many things we made use of global pointer objects to solve the problem.

PWM *motor_control;     //pointer object defined globally
PWM *servo_control;
void init_pwm(long unsigned int freq) {
    motor_control = new PWM(PWM::pwm1, freq);      // using PWM constructor to initialize the PWM 2.0 pin to desired frequency
    servo_control = new PWM(PWM::pwm2, freq);
} 

DC motor shooting randomly

When we were testing our DC motor, we found that our dc motor would shoot randomly in forward and reverse direction when using GPP board. We checked our code and the entire wiring but were not able to fix it.

Solution: When our PCB arrived we tested the DC motor on it and it worked fine. One suggestion would be to use the PCB as soon as possible as it won't waste your time on debugging unnecessary problems.

PID Calibration for uphill and downhill

It uses an extensive amount of time to get the PID loop working which gives proper error values which maneuvers the car without stopping on uphill and controls speed during the downhill.

Solution:You should start using PID for maneuvering uphill and downhill conditions from the beginning.

LCD Refreshing

During testing the data received in LCD, we noticed that LCD was not getting refreshed quickly i.e even though PCAN dongle was updating data quickly but LCD was showing the data after few seconds. At one point, the LCD stopped updating data.

Solution:We used snprintf() for GPS and Sensor values.For Compass and Motor, we implemented MSB and LSB approach where lower 8 bits of data(int) was stored in LSB and upper 8 bits in MSB, followed by our custom display function lcd_put_comm() which converted the data to the pre-formatted data and displayed data over UART using uart_put_char(). Below is an example

   char msb,lsb = 0;
   int local_heading = gps_bearing * 100;
   lsb = (char)((char) local_heading & 0xff);
   msb = (char)((char) (local_heading >> 8) & 0xff);
   lcd_put_comm(WRITE_OBJ, LED_DIGITS, GPS_HEADING_OBJ, msb, lsb);

Geographical Controller

Geographical Controller is one the most important controller in the autonomous car which helps it to navigate to its destination. This modules continuously update the position and orientation of the car with respect to geographical north and send the data to Master, Motor and Android controller boards. We are using the Adafruit Ultimate GPS module and CMPS11.

• GEO CONTROLLER Git Link: [1]

Hardware Design

The hardware interface details of GPS and Compass Module with SJOne board are given below:

GPS & CMPS11 Module Hardware Interfacing

• LED Blinking signals for GEO CONTROLLER ON CAR

* RED LED ON: MASTER HEARTBEAT STATUS on CAR
* BLUE LED ON: Shows GPS FIX STATUS on CAR
* GREEN LED ON: COMPASS Data Indication

GPS

• GPS PinOut

* VCC: 3.3V Power 
* GND: Ground 
* TXD: Serial Transmit pin connected to RXD2 of SJOne board
* RXD: Serial Receive  pin connected to TXD2 of SJOne board 
* FIX: States if GPS is fixed not

GPRMC NMEA DATA

GPS is a global navigation satellite system that provides geolocation and time information to a GPS receiver anywhere on or near the Earth where there is an unobstructed line of sight to four or more GPS satellites.

The GPS module used in this project runs on UART communication protocol. Its default baud rate is 9600bps and we are working on the same baud rate to extract GPS data. The GPS module works on NMEA 0183 standards which define the electrical and data specification for communication between the GPS module and its controller. We are using the Recommended minimum specific GPS/Transit data (GPRMC) command. It provides us with three important data which are Fix, Latitude, and Longitude, required for localization and navigation of the car. The update rate of these data from the GPS module is configured at 10Hz and 5Hz for fix control status.

• GPS Configurations:

GPS configuration Settings that we have used for the Adafruit GPS module is shown in the following picture. As per Arduino data-sheet, we can use different commands setting to set the different update rate from once a second (1 Hz) to 10 times a second (10 Hz) as per user requirements.

GPS Configuration Settings

Compass

• Compass PinOut

* VCC: 3.3V Power 
* GND: Ground 
* SCL: Serial Clock pin connected to SCL of SJOne board
* SDA: Serial DATA pin connected to SDA of SJOne board

A Compass is an instrument used for navigation and orientation that shows direction relative to the geographic cardinal directions (or points). Compass is communicating over I2C with SJ One board. The register 2 and 3 of the compass provide the compass bearing angle (0- 360 range). Calibrating the compass is an important part. We are calibrating it on ‘horizontal calibration mode’, it works for us because the compass has tilt calibration.

We are using the compass in I2C mode of operation. The following table on the left shows the registers and their functions and the software flow chart for getting/setting compass data and calibration on demand and We are using the Compass bearing (16-bit) given by the compass registers 2 and 3 to calculate our car heading.

Registers of CMPS11

Registers of CMPS11

Software Design & Implementation

The Geographical Controller is in place for navigation purpose. It has two essential parts, namely GPS and compass. It provides direction to the car, by calculating the heading angle and the distance between the coordinates, based on GPS and compass readings. To calculate the heading angle, we need a compass bearing angle and angle between the line joining the two coordinates and the true north(bearing angle for GPS).

Hard Power ON Flow Chart

SFMC for 1HZ

SFMC for 10Hz

Distance between the two coordinates calculation

The distance between the two coordinates can be calculated using the Haversine formula.

 a = sin²(Δφ/2) + cos φ1 ⋅ cos φ2 ⋅ sin²(Δλ/2)
 c = 2 ⋅ atan2(√a, √(1−a))
 d = R ⋅ c
 where,
       φ1 = Latitude of 1st Coordinate
       φ2 = Latitude of 2nd Coordinate
       λ1 = Longitude of 1st Coordinate
       λ2 = Longitude of 2nd Coordinate
       Δφ = φ2 - φ1
       Δλ = λ2 - λ1
       d  = distance between the two coordinates
       R  = earth’s radius (mean radius = 6,371km)
 Note: All the angles should be in radians.

GPS Heading angle calculation

Bearing angle calculation

With reference to the figure, the Heading angle for GPS is the angle between the line joining the two coordinates and the true north. To calculate it graphically, draw a vector pointing towards the destination coordinates from the start point coordinate and measure the angle between the vector and the true north. Use the below formula to calculate the angle mathematically.

 Heading angle(α) = atan2(sin Δλ ⋅ cos φ2 , cos φ1 ⋅ sin φ2 − sin φ1 ⋅ cos φ2 ⋅ cos Δλ)
 where,
       φ1 = Latitude of 1st Coordinate
       φ2 = Latitude of 2nd Coordinate
       λ1 = Longitude of 1st Coordinate
       λ2 = Longitude of 2nd Coordinate
       Δλ = λ2 - λ1

GPS Checkpoint Navigation

The car reads the value of current coordinates from the GPS module to determine its Euclidean distance from the first checkpoint. It also checks the value on the compass to know which direction it should preferably move in i.e. Heading angle. The sensor readings help it ascertain that there isn't an obstacle to hinder its movement in the determined direction.

We have selected 23 checkpoints on the location where the demo is going to takes place and we have filled these coordinates in a Checkpoint Array as shown below.

Selected Checkpoints

Checkpoints Array

• The Car begins navigating its way from its current location to the final destination using enlisted checkpoints. When the car arrives at a first checkpoint, then GEO Controller will look into its GPS checkpoints constant array to look for next nearest checkpoint.
• While selecting Checkpoint we are using Linear Searching technique to select next checkpoint which is closer to the current location and as well as closer to the final destination.

The Software state machine flow chart for GPS Navigation is shown below:

GPS Checkpoint Navigation

Technical Challenges

• Issues 1 - GPS doesn’t retain configuration settings; GPS module was forgetting its baud setting of 57600bps configuration settings after a long run testing of GPS module(we kept GPS for overnight testing to capture logs of GPRMC to check its location consistency) before the implementation of Distance calculation so after 4-5 hours its start giving Null values for latitude and longitude after reviewing the logs of the data captured that was giving garbage data as UART baud mismatching gives then it has to be configured again that means baud rate setting using PMTK command.

 Solution - As per recommendation is given in Arduino Data sheet we should use default baud settings of 9600 later we never faced this issue and it was giving a good fix.

• Issue 2 - One of the most important thing with GPS is to get a quick fix. Our First Time to fix was coming approx 50seconds even in the open sky which is not good for self-driving car the moment engine of the car turns on we should have Coordinates of the car to navigate this to the destination location. So first Time to fix was one the hurdle for us.

 Solution - We have followed one of the Arduino Forum in which one of the experts give few tips on how to improve this GPS Fix issue and one of the tips worked for us was the of the Cell battery with the voltage of more than 2.89v. This resolves GPS fix the issue for us. 

• Issue 3 - Compass frequently losing its calibration when we were using CMPS11 in calibrated Mode.

 Solution - Using CMPS11 in default calibration mode helped us to get rid of this problem

• Issue 4 Ahhhh!! Faced task overrun issue with GPS NMEA data. When we were using NMEA parsing and shortest path algorithm in one task or even in two different tasks code was crashing like anything. However, NMEA parsing and Path Finding algorithm were working fine.

 Solution - Preet's easy parsing function(using sscanf) and his advice of using separate task using FreeRTOS helped us resolving this problem.

• Issue 5 During parsing of GPS Coordinates we have faced one issue with data type Float. Due to can transmission, we were using float data type for Latitude and longitude and what we have noticed that after getting data in string/char* and converting it to float then last two-three decimal places of latitude and longitude were changing frequently due to which Calculated distance from SOurce to destination was changing randomly even car is sitting at one location.

 Solution - GPS coordinates require double datatype so, we took coordinates as double and then while sending data on CAN we were typecasting that to float. As we were doing all calculation related to coordinates, distance and checkpoints calculations on GEO Controller itself. So after doing all the calculations in double, we were type casting data to float and we were sending that to MASTER & BRIDGE.

Bridge Controller Communication

Bridge Controller is used for communication between the SJOne board and the android phone using the HC-05 Bluetooth module. The main purpose of the bridge Controller is to receive the start/stop command and destination location from the Android app. Bridge controller will transmit all the sensor information and debug information and this information will be displayed on the android app.

• BRIDGE CONTROLLER Git Link: [2]

Hardware Design

Bluetooth Module Hardware Interfacing:

We are using an HC-05 Bluetooth module to send and receive the data from our android application to Controller. The Bridge controller is connected to the Bluetooth module through the Serial interface(UART2) of SjOne board and we have configured HC-05 at 38400 baud rate 8-bit data and 1 stop bit using modules Communication Mode. Bridge Controller is connected to other SJOne Boards using CAN bus. The Bluetooth module communicates with the SJOne board using UART communication at 38400 baud rate.

HC-05 Module Hardware Interfacing

HC-05 Bluetooth module

HC-05 Bluetooth Module is used to set up wireless communication between the Car and the Android phone. This module is based on the Cambridge Silicon Radio BC417 2.4 GHz BlueTooth Radio chip. This is a complex chip which uses an external 8 Mbit flash memory It includes the Radio and Memory chips, 26 MHz crystal, antenna, and RF matching network. The right section of the Bluetooth Board has connection pins for power and signals as well as a 5V to 3.3V Regulator, LED, and level shifting.

• HC-05 PinOut

* EN:  In a case brought HIGH before power is applied, forces AT Command Setup Mode 
* VCC: 5V Power 
* GND: Ground 
* TXD: Serial Transmit pin connected to RXD2 of SJOne board
* RXD: Serial Receive  pin connected to TXD2 of SJOne board 
* STATE: States if connected or not

• LED Blinking signals

* Flashing RED Fast: Ready for Pairing with nearby Bluetooth device available
* Flashing RED Slow: Paired and Connected

Software Design

Technical Challenges

• Android App was crashing due to the parsing function when there was no GPS data coming from the Bluetooth module. To solve this problem we added checks in the bridge controller to not to send GPS data if the GPS is not yet fixed.
• Bridge controller's task was getting overrun when used snprint and printf in a task. (printf was just used for initial testing).Then after debugging, we found this problem and removed printf. snprintf and sprintf are working fine in 100Hz function.

Master Module

Hardware Design

Design and Implementation

• As name suffice, Master Node acts as the brain of the RC car and gives controlled signals to every other module.
  
• It manages the communication among all the modules, including Motor, Sensor, Geographical and Bridge Controller.
  
• Master receives periodically data from CAN bus based on message ID of the sender module.
  
• Below shows the connection of Master module on the CAN bus, connected with CAN Transceiver.

Master-CAN Interfcaing

Software Design

• As the Master takes all the decisions, it has the highest priority and hence the lowest message Id on CAN DBC.
• Figure illustrates the high-level bus flow from master to every module.

Master Control Flow

Implementation

Heartbeat Message of All Modules

• As Master node handles all the communication from other modules, each node continuously sends its heartbeat to master, confirming that it is active and working properly.
• If all the heartbeats are not received by the master, it sends STOP command to bridge so CAR doesn't run into a stage when any one of a node is not working. This mechanism provides us to eliminate running into an error state.
• If the heartbeat is not received, Master handles this using MIA.
• Code below displays heartbeat synchronization and MIA handling of all nodes.

  bool hbt_sync_from_all_node(void)
  {
    is_hbt_sync_flag = sensor_hbt_sync & motor_hbt_sync & gps_hbt_sync & bridge_hbt_sync;
    return is_hbt_sync_flag;
  }

  void master_mia_handler(void)
  {
    if (dbc_handle_mia_SENSOR_HEARTBEAT(&sensor_hbt, 25))
    {
       sensor_hbt_sync = false;
    }
    if (dbc_handle_mia_MOTOR_HEARTBEAT(&motor_hbt, 25))
    {
       motor_hbt_sync = false;
    }
    if (dbc_handle_mia_GPS_HEARTBEAT(&gps_hbt, 25))
    {
       gps_hbt_sync = false;
    }
    if (dbc_handle_mia_BRIDGE_HEARTBEAT(&bridge_hbt, 25))
    {
       bridge_hbt_sync = false;
    }
  }

Heartbeat LED of all nodes on Master

Testing and Technical Challenges

• Delay in sending steer command to the motor.
  • Initially there was some delay observed while receiving the sensor obstacle information and sending relevant command to motor, because of this synchronization problem we were suffering from the delayed response.
  • After plenty of hardware and software debugging, we noticed the buffer size of CAN RX/TX was much larger than required. It was corrected on sensor and motor side as well.
• Taking time in reversing even though the reverse command was send
  • Motor took time to reverse as it has to break it's PID loop.
  • The solution to this was to send a stop command(0), before sending the reverse command.

<Bullet or Headings of a module>

Improper Unit Testing

• The problem of CAN buffer described above was detected by Unit Testing itself.
  • Along with that bug, I found few more bugs from unit testing the code.

Mobile Application

Software Design

1. Enable Bluetooth and Connect to bridge controller

Wireless communication with the car takes places with communication over Bluetooth protocol. Android Application is created which provides an interface to exchange data and configure the car parameters.

The android app connects to the HC-05 BLE module of the bridge controller. The Bluetooth ask the user for permission to access location and prompts to enable Bluetooth if it's already OFF. Our app is designed to connect to only TechSavy Bluetooth module and no other Bluetooth device to ease the setup of Bluetooth communication. A Bluetooth adapter connects to the HC-05 module and opens a Bluetooth Socket over which read and write messages are sent. A thread runs in the background which checks for available data, reads it and the data can then be processed. Data is written via the same Bluetooth socket. Refer to the following link to get started with Bluetooth on Android app and connection to HC-05 module ([3]).

2. Start/Stop Command and Log Sensor values

Start and Stop commands are sent to the RC car via the application. When Start/Stop button is pressed 1 or 0 commands are sent to the bridge controller when then transmits it to the CAN Bus for processing. Bluetooth status, Sensor Values, Motor parameters, GPS location, compass heading angle, distance to the checkpoint is displayed for debugging purpose. Sensor, GPS, motor Messages coming from CAN bus are decoded by the bridge controller and sent to the Android application as a string. The android app parses the string and categorizes the data to store it in appropriate variables. The data is then displayed as a text view in Bluetooth activity. To visit the Map Activity for setting destination and checkpoints a button is added. The map Activity opens on pressing the button.

The user is asked to enable Bluetooth

User should allow to enable Location

Connecting to the Tech Savy CAR

Connected to the module

3. Map Activity

The map activity is used in our app to show the current location of the car and set the destination marker which the car will navigate too. When map loads in the app the cars current location is indicated coming from the GPS as the source location (Red Marker). The desired location on the map can be set as the destination by long clicking on the map (Light Green marker). The destination can be changed as desired by long pressing again. When the start button is pressed command 1 is sent to the CAN bus via Bluetooth to start the car. A thread starts in the background to indicate the current position of the car when the car moves (light blue marker). Also, a polyline is drawn between the source and destination marker to indicate the direction in which the car will move. For adding Google map to app refer the following [4](Refer to Maps and geolocation section)

Testing and Technical Challenges

1. We faced the problem of adding Bluetooth functionality in the app. There is a lack of tutorials online which shows how to develop an android app with Bluetooth capability and communicating with the HC-05 module. Fortunately, we found this webpage [5] which helped us and Youtube videos of Coding with Mitch.

2. It was difficult to design the UI on the app with little java and Android experience. We designing UI from mainly two resources [6] [7]and searching online for problems faced by us.

3. Initially, we developed the app such that we had to manually connect to a paired device to use Bluetooth functionality. This gave us problems while sending commands to the bridge controller. We solved this problem by fixing the device connection only to our HC-05 module and adding only a single Bluetooth connection button on the app bar for Bluetooth connection.

4. When we received too many sensor values and debug messages from the bridge controller continuously, the app was crashing due to the input buffer overflow. We solved this problem by adding a 1000ms sleep time to limit the input data coming to the app.

5. There was a requirement to continuously update a marker on the map indicating the current location of the car for user feedback. We achieved this using a thread in the background which updated cars position every 1 second.

Suggestions for Future Students

• For Master Controller
  • Don't make your obstacle avoidance complex by implementing reverse condition. Just keep your code simple.
  • One good approach a developer should follow is to unit test their own code. Would you buy a product which is suppose to be tested later?
  • Remember the KISS approach when you code. (Keep It Simple and Stupid).
  • For this controller, one should know the basics in C/ C++ and some good debugging skills. Because if you don't have one, you will eventually end up spending more time debugging your problem.
• For Hardware Team
  • Order Hardware and Components as early as possible.
  • Select components wisely don't try to save money on this part of the project as bad quality hardware can't help you even with best software implementation.
  • Try to power up all modules using 6V coming from LiPo battery. Use IC boosters for converting 6V to 5V and 3.3V. This way there won't be a need of separate power bank and overall weight will be reduced.
  • While designing PCB keep the tracing width of power lines to 1 mm so that sufficient current can be pass through it.
  • PCB spacing should be 12-15 mil.
  • To reduce the magnetic interference from DC Motor, place the compass on the center or near the front side of the car at a height using standoffs.
  • Another alternative to standoffs could be implementing ground rings for compass and GPS Antenna which allows passing the EMI directly to the ground.
  • Get more samples of CAN transceiver IC's as it can get damaged easily.
• For SENSOR Controller Team
  • LIDAR - It has some limitations when tests/demo takes place in bright sunlight. when direct light falls on it, so gives faulty readings.
  • LIDAR Consumes more power, hence need a separate power source for it due to which battery consumption of overall CAR is double as compared to the CAR use ultrasonic sensors for obstacle detection.
  • LIDAR is not even cost effective hence should use Ultrasonic instead we realized it very late.
  • Sensor Implementation doesn't need any averaging or complex algorithms.
• For GEO Controller Team
  • Suggestions for GEO Controller software development is used FreeRTOS separate Tasks instead of using periodic tasks for NMEA receiving and parsing.
  • For GPS Checkpoint navigation use simple and stupid coding no need to implement Dijkstra and complex algorithms for short distance calculation on Geo Controller linear or binary searching technique is enough to implement it successfully.
  • For Compass use default calibration mode no need to add any checks and calibrations. Factory mode should be enough to get accurate results.
• For Motor Controller Team
  • Use global pointers while using PWM drivers of SJONE board and set the frequency appropriately before testing it on motor(50Hz or 100Hz is fine).
  • Calibrate the ESC first for any RC car you purchase and get that right or the DC motor wont work.
  • Clear the CAN buffer periodically or the car might react to the commands with some delay.
• Tips for getting GOOD Grades and to remain in top 3 teams
  • Select your team mates wisely, and make sure every one dedicates them self for this project.
  • Be an active member of your team and review rubrics every week before going to demonstrate your CAR.
  • As soon as the professor mentioned about the project please start working on the project right from the beginning otherwise at the end you have struggled with finals and you will be left with less time for testing and you have to struggle in demo.
  • Although you can get lots of information from seniors still don't take this project light this is a really interesting and challenging project.

Conclusion

It was a really great working experience for all of us. We were really thrilled from the beginning that we will to work on something that is quite relevant in the industries these days. We worked as a team of 8 which helped us all to know the importance of team-work and co-ordination. We learned many great stuff like

• CAN bus communication,
• LIDAR, ultrasonic sensors,
• PCB designing, GPS, Compass, Android Application development.
• Unit testing was a great tool and it helped us to get great results in less amount of time. We also learnt how to debug and interpret CAN messages using BusMaster.
• Git also plays important role to maintain the source code.There were a lot of problems while doing this project but it was a steep learning curve. In the end we were able to achieve our objective with really good results.

Project Video

Tech Savy Project Video

Project Source Code

• Sourceforge Source Code Link

• Git Project Link: Tech Savy
  

References

Acknowledgement

We would like to express our gratitude to Professor Preetpal Kang for generously sharing his time and knowledge with us and guiding us through the completion of this project. We would also like to thank the Pratap(ISA) for their valuable advice and constructive feedback.

References Used

LIDAR

• RPLidar Documentation

PID Control

• PID Controller Design
• Good Strategies for PID Tuning

LCD

• Connecting LCD to Host

Android GUI

• Create App Icons with Image Asset Studio
• Building a Dynamic UI with Fragments
• Android Tutorial

Google Maps

• Adding Maps
• Markers
• Google Maps Directions API

Datasheets

[1] XL-MaxSonar-EZ4 Ultrasonic Sensor
[2] 4D Systems LCD
[3] CAN Transceiver
[4] GPS Module
[5] Compass Module