USPatent applicationPatented

Device for monitoring a vehicle environment

Granted 15 Jan 2019 · 7 office actions

Assignee: Robert Bosch GmbH

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Michael Schoenherr, Christian Hoffmann · Examiner: Chikaodili E Anyikire · AU 2487 · TC 2400

Life of the application

21 dated events
⤢ drag to zoom20142016201820202022202420262028203020322034ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

A device for monitoring the vehicle environment includes: a first sensor for sensing the vehicle environment, the first sensor featuring a first sensing region; a second sensor for sensing the vehicle environment; and an evaluation unit. The second sensor for sensing the vehicle environment is situated within the first sensing region, and a diagnosis of the second sensor is achieved with the aid of the evaluation unit.

Description

4 parts
›BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a device for monitoring a vehicle environment.

2. Description of the Related Art

Motor vehicles are increasingly equipped with devices for monitoring the vehicle environment, which improve the general view and thus can assist in maneuvering or parking, as well. Different types of sensors, e.g., ultrasonic sensors, video cameras, lidar sensors etc. are used for this purpose. Because of functionalities in the automotive field that feature a high degree of automation, such as fully automatic parking, the demands on sensors with regard to accuracy, robustness and reliability become ever greater. The diagnosis or self-diagnosis possibilities of sensors are therefore of increasing importance. Devices for monitoring the vehicle environment with the aid of multiple sensors, such as ultrasonic sensors combined with rear-view cameras, are known from the related art. The related art furthermore includes sensors having additional systems for self-diagnosis. The German patent application publication DE 10 2006 044 786 A1 describes a camera system in a camera-based assistance system of a vehicle, in which a check beam is generated in order to check for soiling of a transparent check body situated on the camera, whereupon a partial beam of the check beam indicative of soiling is detected. The German patent application publication DE 10 2004 028 860 A1 describes an object detection device for vehicles, which is provided in order to detect adhering dirt on a radar. The device includes a dirt-detection circuit for this purpose, which can determine whether dirt adheres to the radar on the basis of time measurements.

›BRIEF SUMMARY OF THE INVENTION

It is the object of the present invention to provide a device for monitoring the vehicle environment, which has at least one first sensor and one second sensor for sensing the vehicle environment and which allows a state detection or diagnosis of the second sensor with the aid of the first sensor.

The present invention is based on a device for monitoring the vehicle environment, which includes a first sensor for sensing the vehicle environment, a second sensor for sensing the vehicle environment, as well as an evaluation unit, the first sensor for sensing the vehicle environment having a first sensing region. The core of the invention is that the second sensor for sensing the vehicle environment is disposed within the first sensing region, and a diagnosis of the second sensor is possible with the aid of the evaluation unit. As a result, a diagnosis of the second sensor with the aid of the first sensor is implemented according to the present invention. The diagnosis of the second sensor advantageously does not require any self-diagnosis system within or on the second sensor. It is also advantageous that the first sensor is used not only for monitoring the vehicle, but additionally enables a diagnosis of the second sensor as a second functionality. According to one advantageous development of the present invention, the first sensor is a camera. The camera advantageously makes it possible to sense the external state of the second sensor, and it can be ascertained in particular whether the second sensor is dirty or also damaged on the outside. It is especially advantageous that the second sensor is situated within the opening angle of the camera. Rear-view cameras for sensing the vehicle environment often have a wide-angle lens. The second sensor is advantageously situated within the opening angle of this wide-angle lens of the camera. This makes it possible to optically detect and evaluate the external state, especially the wear degree of the second sensor, in a direct manner. According to one advantageous development of the present invention, the second sensor is an ultrasonic sensor. Ultrasonic sensors are usually disposed in the bumper in order to ensure sensing of the vehicle environment by distance detection in the near range. However, ultrasonic sensors also get dirty very easily in this installation location. The diagnosis of the ultrasonic sensor is therefore of special importance for the device for monitoring the vehicle environment. According to another advantageous further development of the present invention, the second sensor is a camera. In camera-based devices for monitoring the vehicle environment, this makes it possible for a first camera to diagnose the second camera, or for two or more cameras to diagnose each other. In one advantageous development of the present invention, superficial soiling of the second sensor is able to be diagnosed. The first sensor for sensing the vehicle environment is advantageously situated outside the second sensor for sensing the vehicle environment, so that it is able to determine the external state, in particular superficial soiling, of the second sensor. Such superficial soiling is not easily diagnosable by a possible self-test of the second sensor, because the internal functionalities of the sensor are often not affected by such soiling.

The present invention also relates to a method for diagnosing a second sensor for sensing the vehicle environment with the aid of a device for monitoring the vehicle environment, which includes a first sensor and a second sensor for sensing the vehicle environment, as well as an evaluation unit, the first sensor for sensing the vehicle environment having a first sensing region, and the second sensor for sensing the vehicle environment being situated within the first sensing region. The method of the present invention is characterized by the following steps:

(A) Data acquiring in a first sensing region using the first sensor

(B) Supplying the acquired data in the evaluation unit

(C) Supplying reference data in the evaluation unit

(D) Comparing the acquired data with the reference data

(E) Diagnosing the second sensor by analyzing the comparison carried out in step (D).

The method of the present invention advantageously allows a diagnosis of the second sensor. It is possible, in particular, to determine, by a comparison with reference data, a change in the second sensor as compared to an earlier state, which has been stored in the form of the reference data.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a vehicle having a system made up of a first sensor and a second sensor for sensing the vehicle environment of the device for vehicle environment monitoring according to the present invention.

FIG. 2 schematically illustrates a device for monitoring the vehicle environment according to the present invention.

FIG. 3 schematically illustrates a method for diagnosing a second sensor for monitoring the vehicle environment according to the present invention.

›DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 shows a vehicle provided with a system of a first sensor and a second sensor for sensing the vehicle environment of the device for monitoring the vehicle environment according to the present invention. The exemplary embodiment shows a vehicle 1 having a first sensor 10 for monitoring the vehicle environment, which is mounted on a rear end of the vehicle. Sensor 10 features a sensing region 100 , which is delimited by an opening angle 110 and the range of the sensor. Sensor 10 may be a rear-view camera, for example. A second sensor 20 for sensing the vehicle environment is situated in the sensing region of first sensor 10 . Second sensor 20 , for example, may be an ultrasonic sensor, which is situated on the rear bumper of vehicle 1 . The placement of second sensor 20 in sensing region 100 of first sensor 10 makes it possible for first sensor 10 to detect second sensor 20 as well. In the scenario described here, where first sensor 10 is a camera, this means that the camera optically detects second sensor 20 and therefore is able to reproduce an image of the external state of this second sensor 20 . Changes in the external state of second sensor 20 in comparison with an earlier or reference state are able to be ascertained with the aid of image processing means. Determined changes in the state of second sensor 20 can be evaluated in order to ascertain whether this sensor is soiled, for example, or damaged on the outside. This makes it possible to obtain information or an evaluation regarding the reliability of second sensor 20 , which may be considered in its further use for sensing the vehicle environment.

FIG. 2 schematically depicts a device for monitoring the vehicle environment according to the present invention. FIG. 2 schematically illustrates vehicle 1 on which first sensor 10 and second sensor 20 have been mounted mechanically. First sensor 10 has a sensing region 100 , which also includes second sensor 20 . Data 1000 acquired by first sensor 10 are forwarded to an evaluation unit 30 , where reference data 2000 are stored. By comparing the acquired data 1000 with reference data 2000 , the state of second sensor 20 is able to be inferred, and second sensor 20 therefore be diagnosed.

FIG. 3 schematically shows a method for diagnosing a second sensor for sensing the vehicle environment according to the present invention. The operating method is carried out by a device according to the present invention as described above. The method of the present invention is characterized by the steps:

(A) Acquiring data 1000 in the first sensing range 100 using first sensor 10

(B) Supplying acquired data 1000 in evaluation unit 30

(C) Supplying reference data 2000 in evaluation unit 30

(D) Comparing acquired data 1000 to reference data 2000

(E) Diagnosing second sensor 20 by analyzing the comparison carried out in step (D).

In the method according to the present invention, step (A) must be executed prior to step (B). Step (C) is independent of steps (A) and (B). However, steps (B) and (C) must take place prior to step (D). Step (E) follows step (D).

Claims as granted

12 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

7 codes
IPC · International Patent Classification
Section B — Performing operations; transporting
  • B60R1/00
Section G — Physics
  • G06K9/00
  • G01S15/02
  • G01S7/52
  • G01S15/86
  • G01S15/931
Section H — Electricity
  • H04N17/00

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJan 2014Jul 2014Jan 2015Jul 2015Jan 2016Jul 2016Jan 2017Jul 2017Jan 2018Jul 2018Jan 2019USPTOApplicantNon-final rejectionResponse after finalFinal rejectionNotice of appeal filedResponse after non-finalNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
5.1 y
1,873 days filing → grant
Office actions
7
non-final + final
Responses
7
no RCE
Examiner
Chikaodili E Anyikire
art unit 2487 · TC 2400
Citations: 21 back · 0 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom2016201820202022202420262028203020322034Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock