System and method for configuring at least one sensor system of a vehicle

1. Field of the Invention

The present invention generally relates to systems and methods for configuring at least one sensor system of a vehicle. More specifically, the invention relates to configuring sensor systems for vehicles that may utilize removable accessories.

2. Description of Related Art

Vehicles, such as automobiles, light trucks, heavy-duty trucks, tractors, mining trucks, farm vehicles, etc. have been equipped with sensor systems to detect the location of objects external to the vehicle. For example, some vehicles include sensor systems that when detecting an external object near the vehicle will provide a warning to the operator of the vehicle. This warning may be in the form of a visual, audible, and/or tactile feedback to the operator. Furthermore, the detection of an external object near the vehicle may also actuate certain vehicle safety systems, such as braking or steering systems, to minimize or prevent any collision with the detected external object.

However, vehicles, especially vehicles that are made to be utilized with external accessories, such as farm tractors or construction vehicles routinely have different accessories attached to the vehicle. For example, a farm tractor may have a plow located in front of and/or behind the tractor. Construction vehicles may also have certain accessories attached to them, such as backhoes and shovels. As to automobiles, light trucks and heavy-duty trucks, these vehicles may also have certain accessories attached to them as well. For example, some automobiles may have a trailer or storage unit attached to the rear of the vehicle. Furthermore, some trucks may include snowplow equipment attached to the front and/or rear of the vehicle. It should be understood that the above examples are merely examples and there could be anyone of a number of different configurations between different vehicles and different accessories. Furthermore, it should be understood that a vehicle may be attached to more than one accessory.

When one or more accessories are attached to the vehicle, the sensor system for the vehicle may provide to the operator or other vehicle system false positives regarding the presence of external objects. For example, in the case of a construction vehicle, the sensor for detecting external objects may be detecting an accessory that is attached to the vehicle, such as a backhoe or shovel. This creation of false positives reduces the effectiveness of the sensor system because the operator of the vehicle may think that any warning provided to the operator is false. Furthermore, in vehicles that control one or more safety systems, the safety systems may be unnecessarily actuated when an accessory is attached to a vehicle because the system believes that the accessory is an external object and is attempting to prevent any collision with the external object.

A system for configuring at least one sensor system of a vehicle includes a processor, at least one sensor, and a memory device. The processor is configured to execute the method that may include the steps of, during a learning mode, receiving signals from the at least one sensor regarding one or more objects attached to the vehicle, storing in a memory device at least one location of one or more objects attached to the vehicle and detected by the at least one sensor.

In an operating mode, the method may include the steps of receiving signals from at least one sensor regarding the location of one or more objects external to the vehicle, determining if the location of any of the objects external to the vehicle are different from the locations of any objects stored in the memory device during the learning mode, and reporting to a vehicle system when one or more objects external to the vehicle have a one or more locations different from the locations stored in the memory device during the learning mode.

The method may also involve creating a two-dimensional data structure that is a representation of the area external to the vehicle. The two-dimensional data structure may be a grid having a plurality of grid elements. Here, during the learning mode, the method may include the steps of receiving signals from the at least one sensor of the area external from the vehicle and marking the grid elements of the grid with an indicator when the one or more objects attached to the vehicle are present in the area the grid element represents. During the operating mode, the method may include the steps of receiving signals from the at least one sensor of the area external from the vehicle and determine when at least one object is present in the area where a grid element is unmarked. After that, the method may report to the vehicle system when at least one object is present in the area where the grid elements are unmarked.

Further objects, features, and advantages of this invention will become readily apparent to persons skilled in the art after a review of the following description, with reference to the drawings and claims that are appended to and form a part of this specification.

FIGS. 1A-1D illustrate different examples of vehicles and attached accessories incorporating the system for configuring one or more sensors of the vehicle;

FIGS. 2A and 2B illustrate block diagrams of different examples of the system for configuring one or more sensors of a vehicle;

FIG. 3 illustrates a method for configuring one or more sensors of the vehicle;

FIGS. 4A-4C illustrate two-dimensional data structures that may be utilized with the system and method for configuring one or more sensors of the vehicle;

FIG. 5 illustrates a two-dimensional data structure having an object that overlaps grid elements of a two-dimensional data structure;

FIG. 6 illustrates a two-dimensional data structure in an operating mode; and

FIGS. 7A and 7B illustrate two-dimensional data structures utilizing a learning mode where the vehicle and/or accessory is moved during the learning mode.

Referring to FIG. 1A , illustrated is a vehicle 10 having a system 12 for configuring one or more sensors 14 A and 14 B of the vehicle 10 . In this example, the system 12 is located within a vehicle 10 . It should be understood that the components making the system 12 could be located anywhere in, on, or near the vehicle 10 . Further, it should be understood that the system 12 could take any one of a number of different forms. For example, the system 12 could be packaged within an electronic component type housing or could be distributed throughout the vehicle 10 . Further, the system 12 may also utilize sensors already found in the vehicle 10 . For example, the sensors 14 A and/or 14 B may already be part of the vehicle and the system 12 merely utilizes the sensors.

Here, the vehicle 10 is a construction vehicle. It should be understood that the vehicle 10 may be any type of vehicle capable of moving between two separate points. As such, while the vehicle 10 is illustrated to be a construction vehicle, it should be understood that the vehicle 10 may be any vehicle, such as a tractor, automobile, light truck, heavy-duty truck, tractor trailer, and the like. Furthermore, it should be understood that the vehicle 10 may not be limited to just land based vehicles, but could also include non-land based vehicles such as airplanes and boats.

As stated before, the vehicle 10 includes the system 12 for configuring at least one sensor of the vehicle 10 . In this embodiment, the vehicle 10 includes two sensors 14 A and 14 B. Of course, it should be understood that the vehicle 10 may have any one of a number of different sensors. The sensors 14 A and 14 B may be in communication with the system 12 . The sensors 14 A and 14 B are capable of scanning an area 16 that the vehicle 10 is operating in.

The sensors 14 A and/or 14 B may be any type of sensor capable of detecting objects in the area 16 . For example, the sensors 14 A and/or 14 B may be radar sensors capable of transmitting and receiving radar signals 18 A and 18 B. These radar signals 18 A and 18 B may come into contact with an external object, wherein they are reflected from the external object and returned to the sensors 14 A and/or 14 B. In this example, the radar signals 18 A come into contact with external object 20 which then bounces at least a portion of these signals back to the sensor 14 A.

Of course, it should be understood that any type of sensor could be utilized. As such, the sensors 14 A and/or 14 B may be cameras, infrared detectors, or any type of sensor capable of detecting an external object. Furthermore, it should be understood that while multiple sensors may be utilized, the multiple sensors may include more than one type of sensor. So, for example, the sensors could include both a camera and a radar sensor.

Referring to FIG. 1B , shown is another example of the vehicle 10 . In this example, the vehicle 10 has a shovel accessory 21 attached to the vehicle 10 . The shovel accessory 21 is generally removably attached to the vehicle 10 . As such, when the operator desires to move dirt or snow or other material, the operator can have the shovel accessory 21 attached to the vehicle 10 . Referring to FIG. 1C , another example of the vehicle 10 is shown. In this example, attached to the vehicle 10 is a backhoe accessory 22 . As such, the backhoe accessory 22 is removably attached to the vehicle 10 and may be added or removed by the operator based on the needs of the operator.

Finally, referring to FIG. 1D , yet another example of the vehicle 10 is shown. In this example, the vehicle 10 includes both the shovel accessory 20 and the backhoe accessory 22 attached to the vehicle 10 . As mentioned briefly in the background section, one problem with attaching one or more accessories to a vehicle involves that the accessories could be detected by the sensors 14 A and/or 14 B. Prior art systems, when detecting the attached accessories would provide notice to an operator that an external object is located in the area that the vehicle is operating in. However, as will be explained in the paragraphs that follow, the system 12 has both a learning mode and an operating mode, when the system 12 can learn the location of the accessories 21 and/or 22 so as to prevent the false reporting of objects.

Referring to FIG. 2A one example of the system 12 is shown. In this example, the system 12 includes sensors 14 A and 14 B that as previously mentioned can transmit and receive signals 18 A and 18 B respectively. As mentioned before, the system 12 may include any one of a number of sensors and any one of a number of different types of sensors. The system 12 also includes a processor 30 that is in communication with the sensors 14 A and 14 B. The processor may be a single processor may be multiple processors working in concert to receive signals from the sensors 14 A and 14 B. The processor 30 is configured to receive signals from the sensors 14 A and 14 B and, based on these received signals, be able to determine the location of any objects external to the vehicle 10 .

The processor 30 may be in communication with a memory device 32 . The memory device 32 may be any type of memory device capable of storing digital information. For example, the memory device may be a solid-state memory device, magnetic device, or optical device. Furthermore, the memory device 32 may be incorporated within the processor 30 or may be separate as shown.

In addition to receiving signals from the sensors 14 A and 14 B, the processor is also configured to receive a triggering signal 34 . The triggering signal 34 , as will be explained later, initiates the learning mode for the system 12 . The triggering signal 34 may be initiated by an input device 36 . For example, the input device 36 may be a button or switch that can be actuated by the operator of the vehicle 10 . This actuation of the button or switch then sends the signal 34 to the processor 30 . The input device 36 could also be a device that detects when the vehicle 10 starts up. When the vehicle 10 starts up, the triggering signal 34 could be initiated. This example could be advantageous because it would require that the learning mode is entered into every time the vehicle 10 starts up.

It should be understood that the device 36 being a button, switch or associated with the startup of the vehicle 10 are merely but a few examples. The device 36 could be any device capable of accepting input. For example, the device 36 could also be a remote device, such as a mobile phone or tablet that is capable of sending the signal 34 to the processor 30 either wired or wirelessly. Additionally, the device 36 could be a sensor that senses when an accessory, like the shovel accessory 21 or the backhoe accessory 22 , is attached and/or removed from the vehicle 10 . When the accessory is attached or removed from the vehicle 10 , the device 36 would then send the signal 34 to the processor 30 .

In the event that the processor 30 determines that an external object is a valid target (an object the operator of the vehicle 10 should be informed about that generally does not include the attached accessory to the vehicle 1 ), the processor 30 is configured to send a signal 38 to a device that may be external from the system 12 . Here, the device 40 is another vehicle system that may relay the detection of a valid target to the operator through some form of audible, visual, and/or tactile feedback. Additionally, the device 40 may be a vehicle safety system that is capable of controlling the vehicle 10 so minimize contact with the valid target. This control of the vehicle 10 could include steering or braking of the vehicle 10 so as to prevent or minimize any collision with a valid target.

As will be explained in the paragraphs that follow, the processor 30 may be configured with a set of instructions 42 for executing the method later described. The instructions 42 may be stored within the processor 30 or may also be stored externally, such as in the memory device 32 .

Referring to FIG. 2B , another example of the system 12 is shown. In this example, the triggering signal 34 is initiated by the processor 30 such that the processor 30 controls when the triggering signal is generated.

Referring to FIG. 3 , a method 50 for configuring the sensor system 12 of the vehicle 10 is shown. The method 50 begins by first determining if the triggering signal 34 has been received, as shown in step 52 . In the case that a triggering signal 34 has been received, the method 50 , in step 54 , enters into a learning mode. The learning mode essentially allows the system 12 to learn the locations of any accessories or objects attached to the vehicle 10 . For example, as illustrated in the earlier figures, the objects attached to the vehicle 10 could include a shovel accessory 21 or a backhoe accessory 22 .

In step 56 , the processor 30 receives signals from the sensors 14 A and/or 14 B. In step 58 , the processor 30 stores the location of the one or more objects attached to the vehicle in the memory device 32 . After that, in step 60 , the method 50 exits the learning mode.

After exiting the learning mode, the method 50 may then proceed to enter into an operating mode, as shown in step 62 . Generally, the operating mode is the mode in which the vehicle operates when under regular use. Furthermore, the operating mode may be entered into if no triggering signal is received in step 52 .

During the operating mode, the processor 30 receives signals from at least one of the sensors 14 A and/or 14 B as shown in step 64 .

In step 66 , the processor 30 determines the locations of the objects detected by the at least one sensor 14 A and/or 14 B. In step 68 , the processor 30 then determines if the objects detected in the operating mode are in a location different from the stored locations that were stored in the learning mode. If the objects detected are in the same location, these objects are most likely the objects that were attached to the vehicle. In such a case, the method 50 returns to step 52 .

In such a case that an object is detected with a different location from the stored locations, the method 50 proceeds to step 70 where the processor reports to the vehicle system 40 regarding detection of an external object. The vehicle system 70 may then provide some form of feedback to the operator or may actuate one or more safety systems to prevent or minimize a collision with the external object. Thereafter, the method 50 returns to step 52 .

It should be understood that when a method 50 is in the learning mode 54 , the vehicle 10 may be parked or may be moving. In a case where the vehicle is moving, the processor 30 may receive signals from the sensors 14 A and/or 14 B regarding one or more objects in the area 16 in which the vehicle 10 is located. In one example, the vehicle 10 having the system 12 may be in an environment that does not have any real targets near the sensors 14 A and/or 14 B during the learning mode. This prevents the system 12 from inadvertently considering real targets, such as people or other vehicles, as being an object that is attached to the vehicle 10 .

However, it should be additionally understood that the system 12 could include additional software so as to be able to prevent real targets that are located in the environment during the learning mode from being considered as an object that is attached to the vehicle 10 . For example, during the learning mode, the vehicle 10 may be moved around so that the system 12 could distinguish which objects are truly attached to the vehicle 10 in which objects are simply located in the environment.

The processor 30 may determine which objects in the area are attached to the vehicle and which objects are not attached to the vehicle. Thereafter, the processor 30 will store in the memory device 32 the location of the objects attached to the vehicle. Furthermore, some original equipment manufacturers require sending a message, such as a controller area network message, to a bus of the vehicle 10 to notify other controllers when an external object is attached or removed from the vehicle 10 . However, it should be understood that this is not always the case, especially with vehicles that do not utilize this form of communication infrastructure.

Referring to FIG. 4A , there are numerous ways in which the location of objects attached to the vehicle, such as backhoe 22 , could be stored in the memory. Here, a two-dimensional data structure in the form of a grid 51 is shown. The grid 51 includes a plurality of grid elements along rows labeled 1-8 and columns labeled A-F. In this example, the grid 51 is a representation of the area 16 external to the vehicle and detected by the sensor 14 B.

During the learning mode, the sensor 14 B provides signals to the processor 30 , as stated previously. The processor 30 may store the location of the backhoe 22 in the memory of the device 32 by utilizing the two-dimensional data structure grid 51 . For example, as shown in FIG. 4B , grid elements 1 C, 1 D, 2 C, 2 D, 3 C, and 3 D all contain a checkmark. This checkmark is a visual representation of storing in the memory device 32 which grid elements, which are a representation of the area 16 in which the vehicle operates, as containing the backhoe 22 . In the operating mode, if any objects are detected in the other grid elements that are not marked, the processor 30 will then inform the vehicle system that an object is present in the grid element is not attached to the vehicle.

FIG. 4C shows another methodology for marking multiple grid elements. In this example, the sensor 14 B scans the area 16 multiple times. The processor 30 then counts every time a grid element is determined to have an object located within. Each grid element would have an associated count indicator indicating the number of counts. In the learning mode, if an object is determined over a pre-determined number of times, the grid element is marked as containing an object that is attached to the vehicle.

For example, assume that the sensor 14 B performs 30 scans in the area 16 . Elements 1 C and 1 D each were determined to have an object located in the grid in 30 out of 30 scans. Grid elements 2 C and 2 D were determined to have an object located in these elements 25 out of 30 scans. In grid elements 3 C and 3 D, these grid elements were determined to have an object located within them 15 out of 30 scans. Finally, regarding elements 4 C and 4 D, these grid elements were determined to have an object present in only 2 of 30 scans. As such, the processor 30 could set a threshold amount, in this case, 15 or higher. If a grid element has a count that is above this threshold, it will be determined that this grid element contains an object that is attached to the vehicle. In this example, since the threshold has been set to 15 or higher, only elements 1 C, 1 D, 2 C, 2 D, 3 C, and 3 D are determined to have an object located within the grid element. As to grid elements 4 C and 4 D, since these grid elements had fewer than 15 counts, these grid elements are not marked to contain an object attached to the vehicle. These grid elements may have determined on only 2 of 30 occasions that an element is present because of a number of different factors, such as noise.

Referring to FIG. 5 , there can be certain situations where an object, such as object 20 is located on the border of separate grid elements. In a case where an object 20 is located across the border of separate grid elements, such as case grid elements 1 C, 1 D, 2 C, and 2 D, all of the grid elements could be marked to indicate that an object is present. If count indicators are utilized, the processor 30 may be configured to increase the count indicators of the contiguous grid elements 1 C, 1 D, 2 C, and 2 D when one or more objects are present on a border between two areas that the grid elements represent.

As to FIG. 6 , this figure illustrates the grid 51 during an operating mode. As stated before, elements 1 C, 1 D, 2 C, 2 D, 3 C, and 3 D were each marked as having an object attached to the vehicle located within. In this case, element 1 B is determined to have an object that does not match the previous objects to be determined to be connected to the vehicle. In this case, since there is an object located in grid element 1 B, the processor 30 would report this finding to the vehicle system.

FIGS. 7A and 7B illustrate another methodology for marking the gird elements of the grid 51 . In this case, the backhoe 22 is allowed, during the learning mode, to move in a variety of different directions as indicated by arrows 60 and 62 . The processor 30 during the learning mode, can then mark additional grid elements that the backhoe 22 may be located within when the backhoe is moving around. As such, as best shown in FIG. 7B , in addition to the elements previously marked, elements 4 C, 4 D, 2 B, 2 E, 1 B, and 1 E are marked in addition to those elements previously mentioned. As such, these additional grid elements will be added to the stored locations. Objects that are detected that are not the same as these stored locations will cause the processor 30 to inform the other vehicle system of the presence of these external objects.

In an alternative embodiment, dedicated hardware implementations, such as application specific integrated circuits, programmable logic arrays, and other hardware devices, can be constructed to implement one or more of the methods described herein. Applications that may include the apparatus and systems of various embodiments can broadly include a variety of electronic and computer systems. One or more embodiments described herein may implement functions using two or more specific interconnected hardware modules or devices with related control and data signals that can be communicated between and through the modules, or as portions of an application-specific integrated circuit. Accordingly, the present system encompasses software, firmware, and hardware implementations.

In accordance with various embodiments of the present disclosure, the methods described herein may be implemented by software programs executable by a computer system. Further, in an exemplary, non-limited embodiment, implementations can include distributed processing, component/object distributed processing, and parallel processing. Alternatively, virtual computer system processing can be constructed to implement one or more of the methods or functionality as described herein.

Further, the methods described herein may be embodied in a computer-readable medium. The term “computer-readable medium” includes a single medium or multiple media, such as a centralized or distributed database, and/or associated caches and servers that store one or more sets of instructions. The term “computer-readable medium” shall also include any medium that is capable of storing, encoding or carrying a set of instructions for execution by a processor or that cause a computer system to perform any one or more of the methods or operations disclosed herein.

As a person skilled in the art will readily appreciate, the above description is meant as an illustration of the principles of this invention. This description is not intended to limit the scope or application of this invention in that the invention is susceptible to modification, variation, and change, without departing from the spirit of this invention, as defined in the following claims.